00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1011 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3678 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.123 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.125 The recommended git tool is: git 00:00:00.126 using credential 00000000-0000-0000-0000-000000000002 00:00:00.135 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.173 Fetching changes from the remote Git repository 00:00:00.176 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.206 Using shallow fetch with depth 1 00:00:00.206 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.206 > git --version # timeout=10 00:00:00.224 > git --version # 'git version 2.39.2' 00:00:00.224 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.236 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.237 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.594 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.605 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.615 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.615 > git config core.sparsecheckout # timeout=10 00:00:05.626 > git read-tree -mu HEAD # timeout=10 00:00:05.642 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.668 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.668 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.763 [Pipeline] Start of Pipeline 00:00:05.776 [Pipeline] library 00:00:05.777 Loading library shm_lib@master 00:00:05.777 Library shm_lib@master is cached. Copying from home. 00:00:05.793 [Pipeline] node 00:00:05.800 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.802 [Pipeline] { 00:00:05.810 [Pipeline] catchError 00:00:05.811 [Pipeline] { 00:00:05.824 [Pipeline] wrap 00:00:05.833 [Pipeline] { 00:00:05.841 [Pipeline] stage 00:00:05.844 [Pipeline] { (Prologue) 00:00:06.050 [Pipeline] sh 00:00:06.339 + logger -p user.info -t JENKINS-CI 00:00:06.359 [Pipeline] echo 00:00:06.361 Node: GP11 00:00:06.370 [Pipeline] sh 00:00:06.672 [Pipeline] setCustomBuildProperty 00:00:06.685 [Pipeline] echo 00:00:06.686 Cleanup processes 00:00:06.692 [Pipeline] sh 00:00:06.978 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.978 2088308 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.991 [Pipeline] sh 00:00:07.274 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.274 ++ grep -v 'sudo pgrep' 00:00:07.274 ++ awk '{print $1}' 00:00:07.274 + sudo kill -9 00:00:07.274 + true 00:00:07.288 [Pipeline] cleanWs 00:00:07.298 [WS-CLEANUP] Deleting project workspace... 00:00:07.298 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.305 [WS-CLEANUP] done 00:00:07.309 [Pipeline] setCustomBuildProperty 00:00:07.324 [Pipeline] sh 00:00:07.611 + sudo git config --global --replace-all safe.directory '*' 00:00:07.741 [Pipeline] httpRequest 00:00:08.077 [Pipeline] echo 00:00:08.079 Sorcerer 10.211.164.20 is alive 00:00:08.089 [Pipeline] retry 00:00:08.090 [Pipeline] { 00:00:08.105 [Pipeline] httpRequest 00:00:08.109 HttpMethod: GET 00:00:08.110 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.110 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.119 Response Code: HTTP/1.1 200 OK 00:00:08.119 Success: Status code 200 is in the accepted range: 200,404 00:00:08.119 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.657 [Pipeline] } 00:00:13.674 [Pipeline] // retry 00:00:13.682 [Pipeline] sh 00:00:13.966 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.985 [Pipeline] httpRequest 00:00:14.364 [Pipeline] echo 00:00:14.366 Sorcerer 10.211.164.20 is alive 00:00:14.379 [Pipeline] retry 00:00:14.382 [Pipeline] { 00:00:14.397 [Pipeline] httpRequest 00:00:14.402 HttpMethod: GET 00:00:14.402 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.403 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.423 Response Code: HTTP/1.1 200 OK 00:00:14.423 Success: Status code 200 is in the accepted range: 200,404 00:00:14.424 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:06.508 [Pipeline] } 00:01:06.528 [Pipeline] // retry 00:01:06.536 [Pipeline] sh 00:01:06.830 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:10.134 [Pipeline] sh 00:01:10.422 + git -C spdk log --oneline -n5 00:01:10.422 c13c99a5e test: Various fixes for Fedora40 00:01:10.422 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:10.422 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:10.422 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:10.422 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:10.440 [Pipeline] withCredentials 00:01:10.451 > git --version # timeout=10 00:01:10.462 > git --version # 'git version 2.39.2' 00:01:10.481 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:10.484 [Pipeline] { 00:01:10.491 [Pipeline] retry 00:01:10.493 [Pipeline] { 00:01:10.506 [Pipeline] sh 00:01:10.793 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:11.077 [Pipeline] } 00:01:11.100 [Pipeline] // retry 00:01:11.105 [Pipeline] } 00:01:11.125 [Pipeline] // withCredentials 00:01:11.135 [Pipeline] httpRequest 00:01:11.460 [Pipeline] echo 00:01:11.462 Sorcerer 10.211.164.20 is alive 00:01:11.474 [Pipeline] retry 00:01:11.475 [Pipeline] { 00:01:11.493 [Pipeline] httpRequest 00:01:11.498 HttpMethod: GET 00:01:11.499 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:11.499 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:11.503 Response Code: HTTP/1.1 200 OK 00:01:11.503 Success: Status code 200 is in the accepted range: 200,404 00:01:11.503 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:16.973 [Pipeline] } 00:01:16.991 [Pipeline] // retry 00:01:17.001 [Pipeline] sh 00:01:17.294 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:19.213 [Pipeline] sh 00:01:19.505 + git -C dpdk log --oneline -n5 00:01:19.505 eeb0605f11 version: 23.11.0 00:01:19.505 238778122a doc: update release notes for 23.11 00:01:19.505 46aa6b3cfc doc: fix description of RSS features 00:01:19.505 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:19.505 7e421ae345 devtools: support skipping forbid rule check 00:01:19.516 [Pipeline] } 00:01:19.530 [Pipeline] // stage 00:01:19.540 [Pipeline] stage 00:01:19.542 [Pipeline] { (Prepare) 00:01:19.562 [Pipeline] writeFile 00:01:19.577 [Pipeline] sh 00:01:19.865 + logger -p user.info -t JENKINS-CI 00:01:19.879 [Pipeline] sh 00:01:20.165 + logger -p user.info -t JENKINS-CI 00:01:20.180 [Pipeline] sh 00:01:20.467 + cat autorun-spdk.conf 00:01:20.467 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.467 SPDK_TEST_NVMF=1 00:01:20.467 SPDK_TEST_NVME_CLI=1 00:01:20.467 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.467 SPDK_TEST_NVMF_NICS=e810 00:01:20.467 SPDK_TEST_VFIOUSER=1 00:01:20.467 SPDK_RUN_UBSAN=1 00:01:20.467 NET_TYPE=phy 00:01:20.467 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:20.467 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:20.475 RUN_NIGHTLY=1 00:01:20.481 [Pipeline] readFile 00:01:20.513 [Pipeline] withEnv 00:01:20.515 [Pipeline] { 00:01:20.528 [Pipeline] sh 00:01:20.815 + set -ex 00:01:20.815 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:20.815 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.815 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.815 ++ SPDK_TEST_NVMF=1 00:01:20.815 ++ SPDK_TEST_NVME_CLI=1 00:01:20.815 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.815 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.815 ++ SPDK_TEST_VFIOUSER=1 00:01:20.815 ++ SPDK_RUN_UBSAN=1 00:01:20.815 ++ NET_TYPE=phy 00:01:20.815 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:20.815 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:20.815 ++ RUN_NIGHTLY=1 00:01:20.815 + case $SPDK_TEST_NVMF_NICS in 00:01:20.815 + DRIVERS=ice 00:01:20.815 + [[ tcp == \r\d\m\a ]] 00:01:20.815 + [[ -n ice ]] 00:01:20.815 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:20.815 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:20.815 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:20.815 rmmod: ERROR: Module irdma is not currently loaded 00:01:20.815 rmmod: ERROR: Module i40iw is not currently loaded 00:01:20.815 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:20.815 + true 00:01:20.815 + for D in $DRIVERS 00:01:20.815 + sudo modprobe ice 00:01:20.815 + exit 0 00:01:20.825 [Pipeline] } 00:01:20.841 [Pipeline] // withEnv 00:01:20.846 [Pipeline] } 00:01:20.860 [Pipeline] // stage 00:01:20.870 [Pipeline] catchError 00:01:20.871 [Pipeline] { 00:01:20.887 [Pipeline] timeout 00:01:20.887 Timeout set to expire in 1 hr 0 min 00:01:20.889 [Pipeline] { 00:01:20.903 [Pipeline] stage 00:01:20.905 [Pipeline] { (Tests) 00:01:20.920 [Pipeline] sh 00:01:21.202 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.202 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.202 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.202 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:21.202 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.202 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:21.202 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:21.202 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:21.202 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:21.202 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:21.202 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:21.202 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.202 + source /etc/os-release 00:01:21.202 ++ NAME='Fedora Linux' 00:01:21.202 ++ VERSION='39 (Cloud Edition)' 00:01:21.202 ++ ID=fedora 00:01:21.202 ++ VERSION_ID=39 00:01:21.202 ++ VERSION_CODENAME= 00:01:21.202 ++ PLATFORM_ID=platform:f39 00:01:21.202 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:21.202 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:21.202 ++ LOGO=fedora-logo-icon 00:01:21.202 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:21.202 ++ HOME_URL=https://fedoraproject.org/ 00:01:21.202 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:21.202 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:21.202 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:21.202 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:21.202 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:21.202 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:21.202 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:21.202 ++ SUPPORT_END=2024-11-12 00:01:21.202 ++ VARIANT='Cloud Edition' 00:01:21.202 ++ VARIANT_ID=cloud 00:01:21.202 + uname -a 00:01:21.202 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:21.202 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:22.142 Hugepages 00:01:22.142 node hugesize free / total 00:01:22.142 node0 1048576kB 0 / 0 00:01:22.142 node0 2048kB 0 / 0 00:01:22.142 node1 1048576kB 0 / 0 00:01:22.142 node1 2048kB 0 / 0 00:01:22.142 00:01:22.142 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:22.142 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:22.142 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:22.142 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:22.401 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:22.401 + rm -f /tmp/spdk-ld-path 00:01:22.401 + source autorun-spdk.conf 00:01:22.401 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.401 ++ SPDK_TEST_NVMF=1 00:01:22.401 ++ SPDK_TEST_NVME_CLI=1 00:01:22.401 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.401 ++ SPDK_TEST_NVMF_NICS=e810 00:01:22.401 ++ SPDK_TEST_VFIOUSER=1 00:01:22.401 ++ SPDK_RUN_UBSAN=1 00:01:22.401 ++ NET_TYPE=phy 00:01:22.401 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:22.401 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.401 ++ RUN_NIGHTLY=1 00:01:22.401 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:22.401 + [[ -n '' ]] 00:01:22.401 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.401 + for M in /var/spdk/build-*-manifest.txt 00:01:22.401 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:22.401 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.401 + for M in /var/spdk/build-*-manifest.txt 00:01:22.401 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:22.401 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.401 + for M in /var/spdk/build-*-manifest.txt 00:01:22.401 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:22.401 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.401 ++ uname 00:01:22.401 + [[ Linux == \L\i\n\u\x ]] 00:01:22.401 + sudo dmesg -T 00:01:22.401 + sudo dmesg --clear 00:01:22.401 + dmesg_pid=2089004 00:01:22.401 + [[ Fedora Linux == FreeBSD ]] 00:01:22.401 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:22.401 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:22.401 + sudo dmesg -Tw 00:01:22.401 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:22.401 + [[ -x /usr/src/fio-static/fio ]] 00:01:22.401 + export FIO_BIN=/usr/src/fio-static/fio 00:01:22.401 + FIO_BIN=/usr/src/fio-static/fio 00:01:22.401 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:22.401 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:22.401 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:22.401 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:22.401 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:22.401 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:22.401 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:22.401 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:22.401 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:22.401 Test configuration: 00:01:22.401 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.401 SPDK_TEST_NVMF=1 00:01:22.401 SPDK_TEST_NVME_CLI=1 00:01:22.401 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.401 SPDK_TEST_NVMF_NICS=e810 00:01:22.401 SPDK_TEST_VFIOUSER=1 00:01:22.401 SPDK_RUN_UBSAN=1 00:01:22.401 NET_TYPE=phy 00:01:22.401 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:22.401 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.401 RUN_NIGHTLY=1 13:35:02 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:22.401 13:35:02 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:22.401 13:35:02 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:22.401 13:35:02 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:22.401 13:35:02 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.401 13:35:02 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.401 13:35:02 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.401 13:35:02 -- paths/export.sh@5 -- $ export PATH 00:01:22.401 13:35:02 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.401 13:35:02 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:22.401 13:35:02 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:22.401 13:35:02 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732883702.XXXXXX 00:01:22.401 13:35:02 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732883702.GGjwAC 00:01:22.401 13:35:02 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.401 13:35:02 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:22.401 13:35:02 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:22.401 13:35:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.401 13:35:02 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:22.401 13:35:02 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:22.401 13:35:02 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:22.401 13:35:02 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.401 13:35:02 -- spdk/autobuild.sh@16 -- $ date -u 00:01:22.401 Fri Nov 29 12:35:02 PM UTC 2024 00:01:22.401 13:35:02 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:22.401 LTS-67-gc13c99a5e 00:01:22.401 13:35:02 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:22.401 13:35:02 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:22.401 13:35:02 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:22.401 13:35:02 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:22.401 13:35:02 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:22.401 13:35:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.401 ************************************ 00:01:22.401 START TEST ubsan 00:01:22.401 ************************************ 00:01:22.401 13:35:02 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:22.401 using ubsan 00:01:22.401 00:01:22.401 real 0m0.000s 00:01:22.401 user 0m0.000s 00:01:22.401 sys 0m0.000s 00:01:22.401 13:35:02 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:22.401 13:35:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.401 ************************************ 00:01:22.401 END TEST ubsan 00:01:22.401 ************************************ 00:01:22.401 13:35:02 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:22.401 13:35:02 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:22.401 13:35:02 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:22.401 13:35:02 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:22.401 13:35:02 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:22.401 13:35:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.401 ************************************ 00:01:22.401 START TEST build_native_dpdk 00:01:22.401 ************************************ 00:01:22.401 13:35:02 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:22.401 13:35:02 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:22.401 13:35:02 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:22.401 13:35:02 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:22.401 13:35:02 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:22.401 13:35:02 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:22.401 13:35:02 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:22.401 13:35:02 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:22.401 13:35:02 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:22.401 13:35:02 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:22.401 13:35:02 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:22.401 13:35:02 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:22.401 13:35:02 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:22.401 13:35:02 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.401 13:35:02 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.401 13:35:02 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:22.401 13:35:02 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.401 13:35:02 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:22.401 eeb0605f11 version: 23.11.0 00:01:22.401 238778122a doc: update release notes for 23.11 00:01:22.401 46aa6b3cfc doc: fix description of RSS features 00:01:22.401 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:22.401 7e421ae345 devtools: support skipping forbid rule check 00:01:22.401 13:35:02 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:22.401 13:35:02 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:22.401 13:35:02 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:22.401 13:35:02 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:22.401 13:35:02 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:22.402 13:35:02 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:22.402 13:35:02 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:22.402 13:35:02 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:22.402 13:35:02 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:22.402 13:35:02 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:22.402 13:35:02 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:22.402 13:35:02 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:22.402 13:35:02 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:22.402 13:35:02 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:22.402 13:35:02 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:22.402 13:35:02 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:22.402 13:35:02 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:22.402 13:35:02 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:22.402 13:35:02 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:22.402 13:35:02 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:22.402 13:35:02 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:22.402 13:35:02 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:22.402 13:35:02 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:22.402 13:35:02 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:22.402 13:35:02 -- scripts/common.sh@343 -- $ case "$op" in 00:01:22.402 13:35:02 -- scripts/common.sh@344 -- $ : 1 00:01:22.402 13:35:02 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:22.402 13:35:02 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:22.402 13:35:02 -- scripts/common.sh@364 -- $ decimal 23 00:01:22.402 13:35:02 -- scripts/common.sh@352 -- $ local d=23 00:01:22.402 13:35:02 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:22.402 13:35:02 -- scripts/common.sh@354 -- $ echo 23 00:01:22.402 13:35:02 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:22.402 13:35:02 -- scripts/common.sh@365 -- $ decimal 21 00:01:22.402 13:35:02 -- scripts/common.sh@352 -- $ local d=21 00:01:22.402 13:35:02 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:22.402 13:35:02 -- scripts/common.sh@354 -- $ echo 21 00:01:22.402 13:35:02 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:22.402 13:35:02 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:22.402 13:35:02 -- scripts/common.sh@366 -- $ return 1 00:01:22.402 13:35:02 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:22.402 patching file config/rte_config.h 00:01:22.402 Hunk #1 succeeded at 60 (offset 1 line). 00:01:22.402 13:35:02 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:22.402 13:35:02 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:22.402 13:35:02 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:22.402 13:35:02 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:22.402 13:35:02 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:22.402 13:35:02 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:22.402 13:35:02 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:22.402 13:35:02 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:22.402 13:35:02 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:22.402 13:35:02 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:22.402 13:35:02 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:22.402 13:35:02 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:22.402 13:35:02 -- scripts/common.sh@343 -- $ case "$op" in 00:01:22.402 13:35:02 -- scripts/common.sh@344 -- $ : 1 00:01:22.402 13:35:02 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:22.402 13:35:02 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:22.402 13:35:02 -- scripts/common.sh@364 -- $ decimal 23 00:01:22.402 13:35:02 -- scripts/common.sh@352 -- $ local d=23 00:01:22.402 13:35:02 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:22.402 13:35:02 -- scripts/common.sh@354 -- $ echo 23 00:01:22.402 13:35:02 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:22.402 13:35:02 -- scripts/common.sh@365 -- $ decimal 24 00:01:22.402 13:35:02 -- scripts/common.sh@352 -- $ local d=24 00:01:22.402 13:35:02 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:22.402 13:35:02 -- scripts/common.sh@354 -- $ echo 24 00:01:22.402 13:35:02 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:22.402 13:35:02 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:22.402 13:35:02 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:22.402 13:35:02 -- scripts/common.sh@367 -- $ return 0 00:01:22.402 13:35:02 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:22.402 patching file lib/pcapng/rte_pcapng.c 00:01:22.402 13:35:02 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:22.402 13:35:02 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:22.402 13:35:02 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:22.402 13:35:02 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:22.402 13:35:02 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:26.606 The Meson build system 00:01:26.606 Version: 1.5.0 00:01:26.606 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:26.606 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:26.606 Build type: native build 00:01:26.606 Program cat found: YES (/usr/bin/cat) 00:01:26.606 Project name: DPDK 00:01:26.606 Project version: 23.11.0 00:01:26.606 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:26.606 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:26.606 Host machine cpu family: x86_64 00:01:26.606 Host machine cpu: x86_64 00:01:26.606 Message: ## Building in Developer Mode ## 00:01:26.606 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:26.606 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:26.606 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:26.606 Program python3 found: YES (/usr/bin/python3) 00:01:26.606 Program cat found: YES (/usr/bin/cat) 00:01:26.606 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:26.606 Compiler for C supports arguments -march=native: YES 00:01:26.606 Checking for size of "void *" : 8 00:01:26.606 Checking for size of "void *" : 8 (cached) 00:01:26.606 Library m found: YES 00:01:26.606 Library numa found: YES 00:01:26.606 Has header "numaif.h" : YES 00:01:26.606 Library fdt found: NO 00:01:26.606 Library execinfo found: NO 00:01:26.606 Has header "execinfo.h" : YES 00:01:26.606 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:26.606 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:26.606 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:26.606 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:26.606 Run-time dependency openssl found: YES 3.1.1 00:01:26.606 Run-time dependency libpcap found: YES 1.10.4 00:01:26.606 Has header "pcap.h" with dependency libpcap: YES 00:01:26.606 Compiler for C supports arguments -Wcast-qual: YES 00:01:26.606 Compiler for C supports arguments -Wdeprecated: YES 00:01:26.606 Compiler for C supports arguments -Wformat: YES 00:01:26.606 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:26.606 Compiler for C supports arguments -Wformat-security: NO 00:01:26.606 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:26.606 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:26.606 Compiler for C supports arguments -Wnested-externs: YES 00:01:26.606 Compiler for C supports arguments -Wold-style-definition: YES 00:01:26.606 Compiler for C supports arguments -Wpointer-arith: YES 00:01:26.606 Compiler for C supports arguments -Wsign-compare: YES 00:01:26.606 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:26.606 Compiler for C supports arguments -Wundef: YES 00:01:26.606 Compiler for C supports arguments -Wwrite-strings: YES 00:01:26.606 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:26.606 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:26.606 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:26.606 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:26.606 Program objdump found: YES (/usr/bin/objdump) 00:01:26.606 Compiler for C supports arguments -mavx512f: YES 00:01:26.606 Checking if "AVX512 checking" compiles: YES 00:01:26.606 Fetching value of define "__SSE4_2__" : 1 00:01:26.606 Fetching value of define "__AES__" : 1 00:01:26.606 Fetching value of define "__AVX__" : 1 00:01:26.606 Fetching value of define "__AVX2__" : (undefined) 00:01:26.606 Fetching value of define "__AVX512BW__" : (undefined) 00:01:26.606 Fetching value of define "__AVX512CD__" : (undefined) 00:01:26.606 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:26.606 Fetching value of define "__AVX512F__" : (undefined) 00:01:26.606 Fetching value of define "__AVX512VL__" : (undefined) 00:01:26.606 Fetching value of define "__PCLMUL__" : 1 00:01:26.606 Fetching value of define "__RDRND__" : 1 00:01:26.606 Fetching value of define "__RDSEED__" : (undefined) 00:01:26.606 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:26.606 Fetching value of define "__znver1__" : (undefined) 00:01:26.606 Fetching value of define "__znver2__" : (undefined) 00:01:26.606 Fetching value of define "__znver3__" : (undefined) 00:01:26.606 Fetching value of define "__znver4__" : (undefined) 00:01:26.606 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:26.606 Message: lib/log: Defining dependency "log" 00:01:26.606 Message: lib/kvargs: Defining dependency "kvargs" 00:01:26.606 Message: lib/telemetry: Defining dependency "telemetry" 00:01:26.606 Checking for function "getentropy" : NO 00:01:26.606 Message: lib/eal: Defining dependency "eal" 00:01:26.606 Message: lib/ring: Defining dependency "ring" 00:01:26.606 Message: lib/rcu: Defining dependency "rcu" 00:01:26.606 Message: lib/mempool: Defining dependency "mempool" 00:01:26.606 Message: lib/mbuf: Defining dependency "mbuf" 00:01:26.606 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:26.606 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.606 Compiler for C supports arguments -mpclmul: YES 00:01:26.606 Compiler for C supports arguments -maes: YES 00:01:26.606 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:26.606 Compiler for C supports arguments -mavx512bw: YES 00:01:26.606 Compiler for C supports arguments -mavx512dq: YES 00:01:26.606 Compiler for C supports arguments -mavx512vl: YES 00:01:26.606 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:26.606 Compiler for C supports arguments -mavx2: YES 00:01:26.606 Compiler for C supports arguments -mavx: YES 00:01:26.606 Message: lib/net: Defining dependency "net" 00:01:26.606 Message: lib/meter: Defining dependency "meter" 00:01:26.606 Message: lib/ethdev: Defining dependency "ethdev" 00:01:26.606 Message: lib/pci: Defining dependency "pci" 00:01:26.606 Message: lib/cmdline: Defining dependency "cmdline" 00:01:26.606 Message: lib/metrics: Defining dependency "metrics" 00:01:26.607 Message: lib/hash: Defining dependency "hash" 00:01:26.607 Message: lib/timer: Defining dependency "timer" 00:01:26.607 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:26.607 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:26.607 Message: lib/acl: Defining dependency "acl" 00:01:26.607 Message: lib/bbdev: Defining dependency "bbdev" 00:01:26.607 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:26.607 Run-time dependency libelf found: YES 0.191 00:01:26.607 Message: lib/bpf: Defining dependency "bpf" 00:01:26.607 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:26.607 Message: lib/compressdev: Defining dependency "compressdev" 00:01:26.607 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:26.607 Message: lib/distributor: Defining dependency "distributor" 00:01:26.607 Message: lib/dmadev: Defining dependency "dmadev" 00:01:26.607 Message: lib/efd: Defining dependency "efd" 00:01:26.607 Message: lib/eventdev: Defining dependency "eventdev" 00:01:26.607 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:26.607 Message: lib/gpudev: Defining dependency "gpudev" 00:01:26.607 Message: lib/gro: Defining dependency "gro" 00:01:26.607 Message: lib/gso: Defining dependency "gso" 00:01:26.607 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:26.607 Message: lib/jobstats: Defining dependency "jobstats" 00:01:26.607 Message: lib/latencystats: Defining dependency "latencystats" 00:01:26.607 Message: lib/lpm: Defining dependency "lpm" 00:01:26.607 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:26.607 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:26.607 Message: lib/member: Defining dependency "member" 00:01:26.607 Message: lib/pcapng: Defining dependency "pcapng" 00:01:26.607 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:26.607 Message: lib/power: Defining dependency "power" 00:01:26.607 Message: lib/rawdev: Defining dependency "rawdev" 00:01:26.607 Message: lib/regexdev: Defining dependency "regexdev" 00:01:26.607 Message: lib/mldev: Defining dependency "mldev" 00:01:26.607 Message: lib/rib: Defining dependency "rib" 00:01:26.607 Message: lib/reorder: Defining dependency "reorder" 00:01:26.607 Message: lib/sched: Defining dependency "sched" 00:01:26.607 Message: lib/security: Defining dependency "security" 00:01:26.607 Message: lib/stack: Defining dependency "stack" 00:01:26.607 Has header "linux/userfaultfd.h" : YES 00:01:26.607 Has header "linux/vduse.h" : YES 00:01:26.607 Message: lib/vhost: Defining dependency "vhost" 00:01:26.607 Message: lib/ipsec: Defining dependency "ipsec" 00:01:26.607 Message: lib/pdcp: Defining dependency "pdcp" 00:01:26.607 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.607 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:26.607 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:26.607 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:26.607 Message: lib/fib: Defining dependency "fib" 00:01:26.607 Message: lib/port: Defining dependency "port" 00:01:26.607 Message: lib/pdump: Defining dependency "pdump" 00:01:26.607 Message: lib/table: Defining dependency "table" 00:01:26.607 Message: lib/pipeline: Defining dependency "pipeline" 00:01:26.607 Message: lib/graph: Defining dependency "graph" 00:01:26.607 Message: lib/node: Defining dependency "node" 00:01:28.533 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:28.533 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:28.533 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:28.533 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:28.533 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:28.533 Compiler for C supports arguments -Wno-unused-value: YES 00:01:28.533 Compiler for C supports arguments -Wno-format: YES 00:01:28.533 Compiler for C supports arguments -Wno-format-security: YES 00:01:28.533 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:28.533 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:28.533 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:28.533 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:28.533 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.533 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:28.533 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:28.533 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:28.533 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:28.533 Has header "sys/epoll.h" : YES 00:01:28.533 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:28.533 Configuring doxy-api-html.conf using configuration 00:01:28.533 Configuring doxy-api-man.conf using configuration 00:01:28.533 Program mandb found: YES (/usr/bin/mandb) 00:01:28.533 Program sphinx-build found: NO 00:01:28.533 Configuring rte_build_config.h using configuration 00:01:28.533 Message: 00:01:28.533 ================= 00:01:28.533 Applications Enabled 00:01:28.533 ================= 00:01:28.533 00:01:28.533 apps: 00:01:28.533 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:28.533 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:28.533 test-pmd, test-regex, test-sad, test-security-perf, 00:01:28.533 00:01:28.533 Message: 00:01:28.533 ================= 00:01:28.533 Libraries Enabled 00:01:28.533 ================= 00:01:28.533 00:01:28.533 libs: 00:01:28.533 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:28.533 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:28.533 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:28.533 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:28.533 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:28.533 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:28.533 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:28.533 00:01:28.533 00:01:28.533 Message: 00:01:28.533 =============== 00:01:28.533 Drivers Enabled 00:01:28.533 =============== 00:01:28.533 00:01:28.533 common: 00:01:28.533 00:01:28.533 bus: 00:01:28.533 pci, vdev, 00:01:28.533 mempool: 00:01:28.533 ring, 00:01:28.533 dma: 00:01:28.533 00:01:28.533 net: 00:01:28.533 i40e, 00:01:28.533 raw: 00:01:28.533 00:01:28.533 crypto: 00:01:28.533 00:01:28.533 compress: 00:01:28.533 00:01:28.533 regex: 00:01:28.533 00:01:28.533 ml: 00:01:28.533 00:01:28.533 vdpa: 00:01:28.533 00:01:28.533 event: 00:01:28.533 00:01:28.533 baseband: 00:01:28.533 00:01:28.533 gpu: 00:01:28.533 00:01:28.533 00:01:28.533 Message: 00:01:28.533 ================= 00:01:28.533 Content Skipped 00:01:28.533 ================= 00:01:28.533 00:01:28.533 apps: 00:01:28.533 00:01:28.533 libs: 00:01:28.533 00:01:28.533 drivers: 00:01:28.533 common/cpt: not in enabled drivers build config 00:01:28.533 common/dpaax: not in enabled drivers build config 00:01:28.533 common/iavf: not in enabled drivers build config 00:01:28.533 common/idpf: not in enabled drivers build config 00:01:28.533 common/mvep: not in enabled drivers build config 00:01:28.533 common/octeontx: not in enabled drivers build config 00:01:28.533 bus/auxiliary: not in enabled drivers build config 00:01:28.533 bus/cdx: not in enabled drivers build config 00:01:28.533 bus/dpaa: not in enabled drivers build config 00:01:28.533 bus/fslmc: not in enabled drivers build config 00:01:28.533 bus/ifpga: not in enabled drivers build config 00:01:28.533 bus/platform: not in enabled drivers build config 00:01:28.533 bus/vmbus: not in enabled drivers build config 00:01:28.533 common/cnxk: not in enabled drivers build config 00:01:28.533 common/mlx5: not in enabled drivers build config 00:01:28.533 common/nfp: not in enabled drivers build config 00:01:28.533 common/qat: not in enabled drivers build config 00:01:28.533 common/sfc_efx: not in enabled drivers build config 00:01:28.533 mempool/bucket: not in enabled drivers build config 00:01:28.533 mempool/cnxk: not in enabled drivers build config 00:01:28.533 mempool/dpaa: not in enabled drivers build config 00:01:28.533 mempool/dpaa2: not in enabled drivers build config 00:01:28.533 mempool/octeontx: not in enabled drivers build config 00:01:28.533 mempool/stack: not in enabled drivers build config 00:01:28.533 dma/cnxk: not in enabled drivers build config 00:01:28.533 dma/dpaa: not in enabled drivers build config 00:01:28.533 dma/dpaa2: not in enabled drivers build config 00:01:28.533 dma/hisilicon: not in enabled drivers build config 00:01:28.533 dma/idxd: not in enabled drivers build config 00:01:28.533 dma/ioat: not in enabled drivers build config 00:01:28.533 dma/skeleton: not in enabled drivers build config 00:01:28.533 net/af_packet: not in enabled drivers build config 00:01:28.533 net/af_xdp: not in enabled drivers build config 00:01:28.533 net/ark: not in enabled drivers build config 00:01:28.533 net/atlantic: not in enabled drivers build config 00:01:28.534 net/avp: not in enabled drivers build config 00:01:28.534 net/axgbe: not in enabled drivers build config 00:01:28.534 net/bnx2x: not in enabled drivers build config 00:01:28.534 net/bnxt: not in enabled drivers build config 00:01:28.534 net/bonding: not in enabled drivers build config 00:01:28.534 net/cnxk: not in enabled drivers build config 00:01:28.534 net/cpfl: not in enabled drivers build config 00:01:28.534 net/cxgbe: not in enabled drivers build config 00:01:28.534 net/dpaa: not in enabled drivers build config 00:01:28.534 net/dpaa2: not in enabled drivers build config 00:01:28.534 net/e1000: not in enabled drivers build config 00:01:28.534 net/ena: not in enabled drivers build config 00:01:28.534 net/enetc: not in enabled drivers build config 00:01:28.534 net/enetfec: not in enabled drivers build config 00:01:28.534 net/enic: not in enabled drivers build config 00:01:28.534 net/failsafe: not in enabled drivers build config 00:01:28.534 net/fm10k: not in enabled drivers build config 00:01:28.534 net/gve: not in enabled drivers build config 00:01:28.534 net/hinic: not in enabled drivers build config 00:01:28.534 net/hns3: not in enabled drivers build config 00:01:28.534 net/iavf: not in enabled drivers build config 00:01:28.534 net/ice: not in enabled drivers build config 00:01:28.534 net/idpf: not in enabled drivers build config 00:01:28.534 net/igc: not in enabled drivers build config 00:01:28.534 net/ionic: not in enabled drivers build config 00:01:28.534 net/ipn3ke: not in enabled drivers build config 00:01:28.534 net/ixgbe: not in enabled drivers build config 00:01:28.534 net/mana: not in enabled drivers build config 00:01:28.534 net/memif: not in enabled drivers build config 00:01:28.534 net/mlx4: not in enabled drivers build config 00:01:28.534 net/mlx5: not in enabled drivers build config 00:01:28.534 net/mvneta: not in enabled drivers build config 00:01:28.534 net/mvpp2: not in enabled drivers build config 00:01:28.534 net/netvsc: not in enabled drivers build config 00:01:28.534 net/nfb: not in enabled drivers build config 00:01:28.534 net/nfp: not in enabled drivers build config 00:01:28.534 net/ngbe: not in enabled drivers build config 00:01:28.534 net/null: not in enabled drivers build config 00:01:28.534 net/octeontx: not in enabled drivers build config 00:01:28.534 net/octeon_ep: not in enabled drivers build config 00:01:28.534 net/pcap: not in enabled drivers build config 00:01:28.534 net/pfe: not in enabled drivers build config 00:01:28.534 net/qede: not in enabled drivers build config 00:01:28.534 net/ring: not in enabled drivers build config 00:01:28.534 net/sfc: not in enabled drivers build config 00:01:28.534 net/softnic: not in enabled drivers build config 00:01:28.534 net/tap: not in enabled drivers build config 00:01:28.534 net/thunderx: not in enabled drivers build config 00:01:28.534 net/txgbe: not in enabled drivers build config 00:01:28.534 net/vdev_netvsc: not in enabled drivers build config 00:01:28.534 net/vhost: not in enabled drivers build config 00:01:28.534 net/virtio: not in enabled drivers build config 00:01:28.534 net/vmxnet3: not in enabled drivers build config 00:01:28.534 raw/cnxk_bphy: not in enabled drivers build config 00:01:28.534 raw/cnxk_gpio: not in enabled drivers build config 00:01:28.534 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:28.534 raw/ifpga: not in enabled drivers build config 00:01:28.534 raw/ntb: not in enabled drivers build config 00:01:28.534 raw/skeleton: not in enabled drivers build config 00:01:28.534 crypto/armv8: not in enabled drivers build config 00:01:28.534 crypto/bcmfs: not in enabled drivers build config 00:01:28.534 crypto/caam_jr: not in enabled drivers build config 00:01:28.534 crypto/ccp: not in enabled drivers build config 00:01:28.534 crypto/cnxk: not in enabled drivers build config 00:01:28.534 crypto/dpaa_sec: not in enabled drivers build config 00:01:28.534 crypto/dpaa2_sec: not in enabled drivers build config 00:01:28.534 crypto/ipsec_mb: not in enabled drivers build config 00:01:28.534 crypto/mlx5: not in enabled drivers build config 00:01:28.534 crypto/mvsam: not in enabled drivers build config 00:01:28.534 crypto/nitrox: not in enabled drivers build config 00:01:28.534 crypto/null: not in enabled drivers build config 00:01:28.534 crypto/octeontx: not in enabled drivers build config 00:01:28.534 crypto/openssl: not in enabled drivers build config 00:01:28.534 crypto/scheduler: not in enabled drivers build config 00:01:28.534 crypto/uadk: not in enabled drivers build config 00:01:28.534 crypto/virtio: not in enabled drivers build config 00:01:28.534 compress/isal: not in enabled drivers build config 00:01:28.534 compress/mlx5: not in enabled drivers build config 00:01:28.534 compress/octeontx: not in enabled drivers build config 00:01:28.534 compress/zlib: not in enabled drivers build config 00:01:28.534 regex/mlx5: not in enabled drivers build config 00:01:28.534 regex/cn9k: not in enabled drivers build config 00:01:28.534 ml/cnxk: not in enabled drivers build config 00:01:28.534 vdpa/ifc: not in enabled drivers build config 00:01:28.534 vdpa/mlx5: not in enabled drivers build config 00:01:28.534 vdpa/nfp: not in enabled drivers build config 00:01:28.534 vdpa/sfc: not in enabled drivers build config 00:01:28.534 event/cnxk: not in enabled drivers build config 00:01:28.534 event/dlb2: not in enabled drivers build config 00:01:28.534 event/dpaa: not in enabled drivers build config 00:01:28.534 event/dpaa2: not in enabled drivers build config 00:01:28.534 event/dsw: not in enabled drivers build config 00:01:28.534 event/opdl: not in enabled drivers build config 00:01:28.534 event/skeleton: not in enabled drivers build config 00:01:28.534 event/sw: not in enabled drivers build config 00:01:28.534 event/octeontx: not in enabled drivers build config 00:01:28.534 baseband/acc: not in enabled drivers build config 00:01:28.534 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:28.534 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:28.534 baseband/la12xx: not in enabled drivers build config 00:01:28.534 baseband/null: not in enabled drivers build config 00:01:28.534 baseband/turbo_sw: not in enabled drivers build config 00:01:28.534 gpu/cuda: not in enabled drivers build config 00:01:28.534 00:01:28.534 00:01:28.534 Build targets in project: 220 00:01:28.534 00:01:28.534 DPDK 23.11.0 00:01:28.534 00:01:28.534 User defined options 00:01:28.534 libdir : lib 00:01:28.534 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:28.534 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:28.534 c_link_args : 00:01:28.534 enable_docs : false 00:01:28.534 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:28.534 enable_kmods : false 00:01:28.534 machine : native 00:01:28.534 tests : false 00:01:28.534 00:01:28.534 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:28.534 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:28.534 13:35:08 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:28.534 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:28.534 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:28.534 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:28.534 [3/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:28.534 [4/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:28.534 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:28.534 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:28.534 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:28.534 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:28.534 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:28.534 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:28.534 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:28.534 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:28.534 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:28.534 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:28.534 [15/710] Linking static target lib/librte_kvargs.a 00:01:28.794 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:28.794 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:28.794 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:28.794 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:28.794 [20/710] Linking static target lib/librte_log.a 00:01:28.794 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:29.057 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.632 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.632 [24/710] Linking target lib/librte_log.so.24.0 00:01:29.632 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:29.632 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:29.632 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:29.632 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:29.632 [29/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:29.632 [30/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:29.632 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:29.632 [32/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:29.632 [33/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:29.632 [34/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:29.632 [35/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:29.632 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:29.632 [37/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:29.632 [38/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:29.632 [39/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:29.632 [40/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:29.632 [41/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:29.632 [42/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:29.632 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:29.632 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:29.632 [45/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:29.632 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:29.894 [47/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:29.894 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:29.894 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:29.894 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:29.894 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:29.894 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:29.894 [53/710] Linking target lib/librte_kvargs.so.24.0 00:01:29.894 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:29.894 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:29.894 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:29.894 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:29.894 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:29.894 [59/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:29.894 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:29.894 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:29.894 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:29.894 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:30.157 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:30.157 [65/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:30.157 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:30.157 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:30.422 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:30.422 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:30.422 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:30.422 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:30.422 [72/710] Linking static target lib/librte_pci.a 00:01:30.422 [73/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:30.422 [74/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:30.422 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:30.691 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:30.691 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:30.691 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:30.691 [79/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.691 [80/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:30.691 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:30.691 [82/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:30.691 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:30.691 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:30.691 [85/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:30.691 [86/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:30.691 [87/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:30.958 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:30.958 [89/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:30.959 [90/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:30.959 [91/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:30.959 [92/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:30.959 [93/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:30.959 [94/710] Linking static target lib/librte_ring.a 00:01:30.959 [95/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:30.959 [96/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:30.959 [97/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:30.959 [98/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:30.959 [99/710] Linking static target lib/librte_meter.a 00:01:30.959 [100/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:30.959 [101/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:31.221 [102/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:31.221 [103/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:31.221 [104/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:31.221 [105/710] Linking static target lib/librte_telemetry.a 00:01:31.221 [106/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:31.221 [107/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:31.221 [108/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:31.221 [109/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:31.221 [110/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:31.221 [111/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:31.221 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:31.221 [113/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.484 [114/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:31.484 [115/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:31.484 [116/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.484 [117/710] Linking static target lib/librte_eal.a 00:01:31.484 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:31.484 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:31.484 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:31.484 [121/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:31.484 [122/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:31.484 [123/710] Linking static target lib/librte_net.a 00:01:31.484 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:31.484 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:31.752 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:31.753 [127/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.753 [128/710] Linking static target lib/librte_cmdline.a 00:01:31.753 [129/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:31.753 [130/710] Linking static target lib/librte_mempool.a 00:01:31.753 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:31.753 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:32.013 [133/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:32.013 [134/710] Linking static target lib/librte_cfgfile.a 00:01:32.013 [135/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.013 [136/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:32.013 [137/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:32.013 [138/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:32.013 [139/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:32.013 [140/710] Linking static target lib/librte_metrics.a 00:01:32.013 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:32.013 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:32.013 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:32.279 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:32.279 [145/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:32.279 [146/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:32.279 [147/710] Linking static target lib/librte_bitratestats.a 00:01:32.279 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:32.279 [149/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:32.279 [150/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:32.279 [151/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:32.542 [152/710] Linking static target lib/librte_rcu.a 00:01:32.542 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.542 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:32.542 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:32.542 [156/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.542 [157/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:32.542 [158/710] Linking static target lib/librte_timer.a 00:01:32.542 [159/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:32.808 [160/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:32.808 [161/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.808 [162/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:32.808 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.808 [164/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:32.808 [165/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.808 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:33.066 [167/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.066 [168/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:33.066 [169/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:33.066 [170/710] Linking static target lib/librte_bbdev.a 00:01:33.066 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:33.066 [172/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:33.066 [173/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:33.066 [174/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.066 [175/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:33.066 [176/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:33.329 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:33.329 [178/710] Linking static target lib/librte_compressdev.a 00:01:33.329 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:33.329 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:33.329 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:33.596 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:33.596 [183/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:33.596 [184/710] Linking static target lib/librte_distributor.a 00:01:33.596 [185/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:33.857 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:33.857 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.857 [188/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:33.857 [189/710] Linking static target lib/librte_bpf.a 00:01:33.857 [190/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:33.857 [191/710] Linking static target lib/librte_dmadev.a 00:01:34.121 [192/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.121 [193/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:34.121 [194/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.121 [195/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:34.121 [196/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:34.121 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:34.121 [198/710] Linking static target lib/librte_dispatcher.a 00:01:34.121 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:34.386 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:34.386 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:34.386 [202/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:34.386 [203/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:34.386 [204/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:34.386 [205/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:34.386 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:34.386 [207/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.386 [208/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:34.386 [209/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:34.386 [210/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:34.386 [211/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:34.386 [212/710] Linking static target lib/librte_gpudev.a 00:01:34.386 [213/710] Linking static target lib/librte_gro.a 00:01:34.386 [214/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:34.650 [215/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:34.650 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.650 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:34.650 [218/710] Linking static target lib/librte_jobstats.a 00:01:34.650 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:34.650 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:34.916 [221/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.916 [222/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.916 [223/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:34.916 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:35.179 [225/710] Linking static target lib/librte_latencystats.a 00:01:35.179 [226/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.179 [227/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:35.179 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:35.179 [229/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:35.179 [230/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:35.179 [231/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:35.179 [232/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:35.179 [233/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:35.439 [234/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:35.439 [235/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:35.439 [236/710] Linking static target lib/librte_ip_frag.a 00:01:35.439 [237/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.439 [238/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:35.439 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:35.439 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:35.700 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:35.700 [242/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:35.700 [243/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:35.700 [244/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.701 [245/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:35.701 [246/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.966 [247/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:35.966 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:35.966 [249/710] Linking static target lib/librte_gso.a 00:01:35.966 [250/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:35.966 [251/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:35.966 [252/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:35.966 [253/710] Linking static target lib/librte_regexdev.a 00:01:36.229 [254/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:36.229 [255/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:36.229 [256/710] Linking static target lib/librte_rawdev.a 00:01:36.229 [257/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:36.229 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:36.229 [259/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.229 [260/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:36.229 [261/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:36.230 [262/710] Linking static target lib/librte_mldev.a 00:01:36.230 [263/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:36.491 [264/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:36.491 [265/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:36.491 [266/710] Linking static target lib/librte_efd.a 00:01:36.491 [267/710] Linking static target lib/librte_pcapng.a 00:01:36.491 [268/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:36.491 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:36.491 [270/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:36.491 [271/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:36.491 [272/710] Linking static target lib/acl/libavx2_tmp.a 00:01:36.491 [273/710] Linking static target lib/librte_stack.a 00:01:36.491 [274/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:36.753 [275/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:36.753 [276/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:36.753 [277/710] Linking static target lib/librte_lpm.a 00:01:36.753 [278/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:36.753 [279/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:36.753 [280/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.753 [281/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.753 [282/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:36.753 [283/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.753 [284/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:36.753 [285/710] Linking static target lib/librte_hash.a 00:01:37.019 [286/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:37.019 [287/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.019 [288/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:37.019 [289/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:37.019 [290/710] Linking static target lib/librte_reorder.a 00:01:37.019 [291/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:37.019 [292/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:37.019 [293/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.019 [294/710] Linking static target lib/librte_power.a 00:01:37.282 [295/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:37.282 [296/710] Linking static target lib/acl/libavx512_tmp.a 00:01:37.282 [297/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.282 [298/710] Linking static target lib/librte_acl.a 00:01:37.282 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:37.282 [300/710] Linking static target lib/librte_security.a 00:01:37.282 [301/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:37.546 [302/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:37.546 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:37.546 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:37.546 [305/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:37.546 [306/710] Linking static target lib/librte_mbuf.a 00:01:37.546 [307/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.546 [308/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:37.546 [309/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:37.546 [310/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.808 [311/710] Linking static target lib/librte_rib.a 00:01:37.808 [312/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:37.808 [313/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.808 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:37.808 [315/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:37.808 [316/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:37.808 [317/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:37.808 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.076 [319/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:38.076 [320/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:38.076 [321/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:38.076 [322/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:38.076 [323/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:38.076 [324/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.076 [325/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:38.076 [326/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:38.341 [327/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.341 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.341 [329/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.341 [330/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:38.607 [331/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:38.607 [332/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:38.607 [333/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:38.869 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:38.869 [335/710] Linking static target lib/librte_member.a 00:01:38.869 [336/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:38.869 [337/710] Linking static target lib/librte_eventdev.a 00:01:38.869 [338/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:38.869 [339/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:38.869 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:38.869 [341/710] Linking static target lib/librte_cryptodev.a 00:01:39.143 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:39.143 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:39.143 [344/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:39.143 [345/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:39.143 [346/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:39.143 [347/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:39.143 [348/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:39.143 [349/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:39.143 [350/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.408 [351/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:39.408 [352/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:39.408 [353/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:39.408 [354/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:39.408 [355/710] Linking static target lib/librte_fib.a 00:01:39.408 [356/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:39.408 [357/710] Linking static target lib/librte_ethdev.a 00:01:39.408 [358/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:39.408 [359/710] Linking static target lib/librte_sched.a 00:01:39.408 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:39.673 [361/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:39.673 [362/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:39.673 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:39.673 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:39.673 [365/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:39.673 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:39.673 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:39.942 [368/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:39.942 [369/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.942 [370/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:39.942 [371/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:39.942 [372/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:39.942 [373/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.207 [374/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:40.207 [375/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:40.207 [376/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:40.207 [377/710] Linking static target lib/librte_pdump.a 00:01:40.471 [378/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:40.471 [379/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:40.471 [380/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:40.471 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:40.471 [382/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:40.471 [383/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:40.471 [384/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:40.737 [385/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:40.737 [386/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:40.737 [387/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:40.737 [388/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:40.737 [389/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:40.737 [390/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:40.737 [391/710] Linking static target lib/librte_ipsec.a 00:01:40.737 [392/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.737 [393/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:40.737 [394/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:40.999 [395/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.999 [396/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:40.999 [397/710] Linking static target lib/librte_table.a 00:01:41.262 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:41.262 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:41.262 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:41.262 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.527 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:41.527 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:41.793 [404/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:41.793 [405/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:41.793 [406/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.793 [407/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:41.793 [408/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:41.793 [409/710] Linking target lib/librte_eal.so.24.0 00:01:41.793 [410/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:41.793 [411/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:42.053 [412/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:42.053 [413/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:42.053 [414/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:42.053 [415/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:42.053 [416/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:42.053 [417/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.053 [418/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.053 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:42.053 [420/710] Linking target lib/librte_ring.so.24.0 00:01:42.315 [421/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:42.315 [422/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:42.315 [423/710] Linking target lib/librte_meter.so.24.0 00:01:42.315 [424/710] Linking target lib/librte_pci.so.24.0 00:01:42.315 [425/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:42.315 [426/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:42.580 [427/710] Linking target lib/librte_rcu.so.24.0 00:01:42.580 [428/710] Linking target lib/librte_mempool.so.24.0 00:01:42.580 [429/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:42.580 [430/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:42.580 [431/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:42.580 [432/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:42.580 [433/710] Linking target lib/librte_timer.so.24.0 00:01:42.580 [434/710] Linking target lib/librte_cfgfile.so.24.0 00:01:42.581 [435/710] Linking target lib/librte_dmadev.so.24.0 00:01:42.581 [436/710] Linking target lib/librte_acl.so.24.0 00:01:42.581 [437/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:42.581 [438/710] Linking target lib/librte_jobstats.so.24.0 00:01:42.581 [439/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:42.840 [440/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:42.840 [441/710] Linking static target lib/librte_port.a 00:01:42.840 [442/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:42.840 [443/710] Linking target lib/librte_rawdev.so.24.0 00:01:42.840 [444/710] Linking target lib/librte_stack.so.24.0 00:01:42.840 [445/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:42.840 [446/710] Linking static target lib/librte_graph.a 00:01:42.840 [447/710] Linking target lib/librte_rib.so.24.0 00:01:42.840 [448/710] Linking target lib/librte_mbuf.so.24.0 00:01:42.840 [449/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:42.840 [450/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:42.840 [451/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:42.840 [452/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:42.840 [453/710] Linking static target drivers/librte_bus_vdev.a 00:01:42.840 [454/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:42.840 [455/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:43.102 [456/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:43.102 [457/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:43.102 [458/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:43.102 [459/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:43.102 [460/710] Linking target lib/librte_fib.so.24.0 00:01:43.102 [461/710] Linking target lib/librte_net.so.24.0 00:01:43.102 [462/710] Linking target lib/librte_bbdev.so.24.0 00:01:43.102 [463/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:43.102 [464/710] Linking target lib/librte_compressdev.so.24.0 00:01:43.102 [465/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:43.365 [466/710] Linking target lib/librte_cryptodev.so.24.0 00:01:43.365 [467/710] Linking target lib/librte_distributor.so.24.0 00:01:43.365 [468/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:43.365 [469/710] Linking target lib/librte_gpudev.so.24.0 00:01:43.365 [470/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.365 [471/710] Linking target lib/librte_regexdev.so.24.0 00:01:43.365 [472/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:43.365 [473/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:43.365 [474/710] Linking target lib/librte_mldev.so.24.0 00:01:43.365 [475/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:43.365 [476/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:43.365 [477/710] Linking static target drivers/librte_bus_pci.a 00:01:43.365 [478/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:43.365 [479/710] Linking target lib/librte_reorder.so.24.0 00:01:43.365 [480/710] Linking target lib/librte_sched.so.24.0 00:01:43.365 [481/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:43.365 [482/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:43.365 [483/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:43.633 [484/710] Linking target lib/librte_cmdline.so.24.0 00:01:43.633 [485/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:43.633 [486/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.633 [487/710] Linking target lib/librte_security.so.24.0 00:01:43.633 [488/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:43.633 [489/710] Linking target lib/librte_hash.so.24.0 00:01:43.633 [490/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:43.633 [491/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:43.633 [492/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:43.633 [493/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:43.633 [494/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:43.633 [495/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.633 [496/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:43.633 [497/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:43.633 [498/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:43.633 [499/710] Linking static target drivers/librte_mempool_ring.a 00:01:43.633 [500/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:43.899 [501/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:43.899 [502/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:43.899 [503/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:43.899 [504/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:43.900 [505/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:43.900 [506/710] Linking target lib/librte_efd.so.24.0 00:01:43.900 [507/710] Linking target lib/librte_lpm.so.24.0 00:01:43.900 [508/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:43.900 [509/710] Linking target lib/librte_member.so.24.0 00:01:43.900 [510/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:43.900 [511/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:43.900 [512/710] Linking target lib/librte_ipsec.so.24.0 00:01:44.161 [513/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:44.161 [514/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.161 [515/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:44.161 [516/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:44.161 [517/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:44.161 [518/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:44.161 [519/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:44.420 [520/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:44.420 [521/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:44.420 [522/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:44.420 [523/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:44.420 [524/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:44.698 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:44.698 [526/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:44.986 [527/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:44.986 [528/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:44.986 [529/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:44.986 [530/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:44.986 [531/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:45.277 [532/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:45.277 [533/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:45.546 [534/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:45.546 [535/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:45.546 [536/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:45.546 [537/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:45.546 [538/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:45.546 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:45.546 [540/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:45.546 [541/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:45.816 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:46.084 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:46.084 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:46.084 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:46.084 [546/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:46.084 [547/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:46.084 [548/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:46.084 [549/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:46.347 [550/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:46.347 [551/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:46.347 [552/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:46.347 [553/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:46.347 [554/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:46.347 [555/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:46.347 [556/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:46.609 [557/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:46.609 [558/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:46.609 [559/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:47.184 [560/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:47.184 [561/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.184 [562/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:47.184 [563/710] Linking target lib/librte_ethdev.so.24.0 00:01:47.445 [564/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:47.445 [565/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:47.445 [566/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:47.445 [567/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:47.445 [568/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:47.445 [569/710] Linking target lib/librte_metrics.so.24.0 00:01:47.445 [570/710] Linking target lib/librte_bpf.so.24.0 00:01:47.445 [571/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:47.445 [572/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:47.710 [573/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:47.710 [574/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:47.710 [575/710] Linking target lib/librte_gro.so.24.0 00:01:47.710 [576/710] Linking target lib/librte_eventdev.so.24.0 00:01:47.710 [577/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:47.710 [578/710] Linking target lib/librte_gso.so.24.0 00:01:47.710 [579/710] Linking target lib/librte_ip_frag.so.24.0 00:01:47.710 [580/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:47.710 [581/710] Linking target lib/librte_pcapng.so.24.0 00:01:47.710 [582/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:47.710 [583/710] Linking target lib/librte_power.so.24.0 00:01:47.710 [584/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:47.710 [585/710] Linking target lib/librte_latencystats.so.24.0 00:01:47.710 [586/710] Linking target lib/librte_bitratestats.so.24.0 00:01:47.710 [587/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:47.710 [588/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:47.710 [589/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:47.710 [590/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:47.972 [591/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:47.972 [592/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:47.972 [593/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:47.972 [594/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:47.972 [595/710] Linking target lib/librte_dispatcher.so.24.0 00:01:47.972 [596/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:47.972 [597/710] Linking target lib/librte_pdump.so.24.0 00:01:47.972 [598/710] Linking target lib/librte_port.so.24.0 00:01:47.972 [599/710] Linking target lib/librte_graph.so.24.0 00:01:47.972 [600/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:48.239 [601/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:48.239 [602/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:48.239 [603/710] Linking static target lib/librte_pdcp.a 00:01:48.239 [604/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:48.239 [605/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:48.239 [606/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:48.239 [607/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:48.239 [608/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:48.239 [609/710] Linking target lib/librte_table.so.24.0 00:01:48.500 [610/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:48.500 [611/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:48.500 [612/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:48.763 [613/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:48.763 [614/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:48.763 [615/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.763 [616/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:48.763 [617/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:48.763 [618/710] Linking target lib/librte_pdcp.so.24.0 00:01:49.025 [619/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:49.025 [620/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:49.025 [621/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:49.025 [622/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:49.025 [623/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:49.025 [624/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:49.287 [625/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:49.287 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:49.287 [627/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:49.287 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:49.287 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:49.548 [630/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:49.807 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:49.807 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:49.807 [633/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:49.807 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:49.807 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:50.066 [636/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:50.066 [637/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:50.066 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:50.066 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:50.066 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:50.066 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:50.066 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:50.324 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:50.582 [644/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:50.582 [645/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:50.582 [646/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:50.582 [647/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:50.582 [648/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:50.841 [649/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:50.841 [650/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:50.841 [651/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:50.841 [652/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:50.841 [653/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:50.841 [654/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:51.098 [655/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:51.099 [656/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:51.356 [657/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:51.356 [658/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:51.356 [659/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:51.356 [660/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:51.356 [661/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:51.356 [662/710] Linking static target drivers/librte_net_i40e.a 00:01:51.356 [663/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:51.921 [664/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:51.921 [665/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:51.921 [666/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:51.921 [667/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.921 [668/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:51.921 [669/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:52.179 [670/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:52.437 [671/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:52.696 [672/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:52.955 [673/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:52.955 [674/710] Linking static target lib/librte_node.a 00:01:53.214 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.214 [676/710] Linking target lib/librte_node.so.24.0 00:01:54.149 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:54.149 [678/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:54.716 [679/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:56.092 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:56.351 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:01.615 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:33.699 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:33.699 [684/710] Linking static target lib/librte_vhost.a 00:02:33.699 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:33.699 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:51.809 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:51.809 [688/710] Linking static target lib/librte_pipeline.a 00:02:51.809 [689/710] Linking target app/dpdk-pdump 00:02:51.809 [690/710] Linking target app/dpdk-dumpcap 00:02:51.809 [691/710] Linking target app/dpdk-graph 00:02:51.809 [692/710] Linking target app/dpdk-test-cmdline 00:02:51.809 [693/710] Linking target app/dpdk-proc-info 00:02:51.809 [694/710] Linking target app/dpdk-test-acl 00:02:51.809 [695/710] Linking target app/dpdk-test-flow-perf 00:02:51.809 [696/710] Linking target app/dpdk-test-regex 00:02:51.809 [697/710] Linking target app/dpdk-test-sad 00:02:51.809 [698/710] Linking target app/dpdk-test-gpudev 00:02:51.809 [699/710] Linking target app/dpdk-test-dma-perf 00:02:51.809 [700/710] Linking target app/dpdk-test-fib 00:02:51.809 [701/710] Linking target app/dpdk-test-pipeline 00:02:51.809 [702/710] Linking target app/dpdk-test-security-perf 00:02:51.809 [703/710] Linking target app/dpdk-test-crypto-perf 00:02:51.809 [704/710] Linking target app/dpdk-test-bbdev 00:02:51.809 [705/710] Linking target app/dpdk-test-mldev 00:02:51.809 [706/710] Linking target app/dpdk-test-eventdev 00:02:51.809 [707/710] Linking target app/dpdk-test-compress-perf 00:02:51.809 [708/710] Linking target app/dpdk-testpmd 00:02:51.809 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:52.069 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:52.069 13:36:32 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:52.069 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:52.069 [0/1] Installing files. 00:02:52.333 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.334 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.335 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:52.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:52.339 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.339 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.339 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.339 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.339 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.339 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.600 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.176 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.176 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.176 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.176 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.176 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.176 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.177 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.178 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.179 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.180 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.180 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:53.180 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:53.180 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:53.180 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:53.180 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:53.180 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:53.180 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:53.180 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:53.180 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:53.180 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:53.180 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:53.180 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:53.180 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:53.180 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:53.180 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:53.180 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:53.180 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:53.180 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:53.180 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:53.180 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:53.180 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:53.180 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:53.180 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:53.181 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:53.181 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:53.181 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:53.181 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:53.181 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:53.181 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:53.181 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:53.181 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:53.181 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:53.181 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:53.181 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:53.181 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:53.181 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:53.181 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:53.181 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:53.181 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:53.181 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:53.181 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:53.181 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:53.181 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:53.181 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:53.181 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:53.181 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:53.181 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:53.181 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:53.181 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:53.181 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:53.181 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:53.181 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:53.181 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:53.181 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:53.181 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:53.181 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:53.181 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:53.181 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:53.181 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:53.181 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:53.181 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:53.181 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:53.181 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:53.181 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:53.181 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:53.181 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:53.181 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:53.181 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:53.181 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:53.181 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:53.181 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:53.181 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:53.181 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:53.181 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:53.181 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:53.181 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:53.181 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:53.181 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:53.181 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:53.181 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:53.181 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:53.181 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:53.181 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:53.181 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:53.181 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:53.181 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:53.181 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:53.181 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:53.181 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:53.181 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:53.181 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:53.181 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:53.181 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:53.181 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:53.181 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:53.181 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:53.181 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:53.181 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:53.181 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:53.181 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:53.181 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:53.181 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:53.181 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:53.181 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:53.181 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:53.181 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:53.181 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:53.181 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:53.181 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:53.181 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:53.181 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:53.181 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:53.181 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:53.181 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:53.181 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:53.181 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:53.181 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:53.181 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:53.181 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:53.181 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:53.182 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:53.182 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:53.182 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:53.182 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:53.182 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:53.182 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:53.182 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:53.182 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:53.182 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:53.182 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:53.182 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:53.182 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:53.182 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:53.182 13:36:33 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:53.182 13:36:33 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:53.182 13:36:33 -- common/autobuild_common.sh@203 -- $ cat 00:02:53.182 13:36:33 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:53.182 00:02:53.182 real 1m30.779s 00:02:53.182 user 18m4.301s 00:02:53.182 sys 2m9.429s 00:02:53.182 13:36:33 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:53.182 13:36:33 -- common/autotest_common.sh@10 -- $ set +x 00:02:53.182 ************************************ 00:02:53.182 END TEST build_native_dpdk 00:02:53.182 ************************************ 00:02:53.182 13:36:33 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:53.182 13:36:33 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:53.182 13:36:33 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:53.442 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:53.442 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.442 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.442 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:53.702 Using 'verbs' RDMA provider 00:03:04.253 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:12.509 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:12.509 Creating mk/config.mk...done. 00:03:12.509 Creating mk/cc.flags.mk...done. 00:03:12.509 Type 'make' to build. 00:03:12.509 13:36:52 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:12.509 13:36:52 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:12.509 13:36:52 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:12.509 13:36:52 -- common/autotest_common.sh@10 -- $ set +x 00:03:12.509 ************************************ 00:03:12.509 START TEST make 00:03:12.510 ************************************ 00:03:12.510 13:36:52 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:12.768 make[1]: Nothing to be done for 'all'. 00:03:14.681 The Meson build system 00:03:14.681 Version: 1.5.0 00:03:14.681 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:14.681 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:14.681 Build type: native build 00:03:14.681 Project name: libvfio-user 00:03:14.681 Project version: 0.0.1 00:03:14.681 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:14.681 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:14.681 Host machine cpu family: x86_64 00:03:14.681 Host machine cpu: x86_64 00:03:14.681 Run-time dependency threads found: YES 00:03:14.681 Library dl found: YES 00:03:14.681 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:14.681 Run-time dependency json-c found: YES 0.17 00:03:14.681 Run-time dependency cmocka found: YES 1.1.7 00:03:14.681 Program pytest-3 found: NO 00:03:14.681 Program flake8 found: NO 00:03:14.682 Program misspell-fixer found: NO 00:03:14.682 Program restructuredtext-lint found: NO 00:03:14.682 Program valgrind found: YES (/usr/bin/valgrind) 00:03:14.682 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:14.682 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:14.682 Compiler for C supports arguments -Wwrite-strings: YES 00:03:14.682 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:14.682 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:14.682 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:14.682 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:14.682 Build targets in project: 8 00:03:14.682 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:14.682 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:14.682 00:03:14.682 libvfio-user 0.0.1 00:03:14.682 00:03:14.682 User defined options 00:03:14.682 buildtype : debug 00:03:14.682 default_library: shared 00:03:14.682 libdir : /usr/local/lib 00:03:14.682 00:03:14.682 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:15.252 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:15.514 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:15.514 [2/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:15.515 [3/37] Compiling C object samples/null.p/null.c.o 00:03:15.515 [4/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:15.515 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:15.515 [6/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:15.515 [7/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:15.515 [8/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:15.515 [9/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:15.515 [10/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:15.515 [11/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:15.515 [12/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:15.515 [13/37] Compiling C object samples/server.p/server.c.o 00:03:15.515 [14/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:15.515 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:15.515 [16/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:15.515 [17/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:15.515 [18/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:15.515 [19/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:15.515 [20/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:15.515 [21/37] Compiling C object samples/client.p/client.c.o 00:03:15.781 [22/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:15.781 [23/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:15.781 [24/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:15.781 [25/37] Linking target samples/client 00:03:15.781 [26/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:15.781 [27/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:15.781 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:15.781 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:15.781 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:16.043 [31/37] Linking target test/unit_tests 00:03:16.043 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:16.043 [33/37] Linking target samples/server 00:03:16.043 [34/37] Linking target samples/null 00:03:16.043 [35/37] Linking target samples/gpio-pci-idio-16 00:03:16.043 [36/37] Linking target samples/lspci 00:03:16.043 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:16.306 INFO: autodetecting backend as ninja 00:03:16.306 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:16.306 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:17.249 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:17.249 ninja: no work to do. 00:03:29.454 CC lib/log/log.o 00:03:29.454 CC lib/log/log_flags.o 00:03:29.454 CC lib/log/log_deprecated.o 00:03:29.454 CC lib/ut_mock/mock.o 00:03:29.454 CC lib/ut/ut.o 00:03:29.454 LIB libspdk_ut_mock.a 00:03:29.454 SO libspdk_ut_mock.so.5.0 00:03:29.454 LIB libspdk_log.a 00:03:29.454 LIB libspdk_ut.a 00:03:29.454 SO libspdk_log.so.6.1 00:03:29.454 SYMLINK libspdk_ut_mock.so 00:03:29.454 SO libspdk_ut.so.1.0 00:03:29.454 SYMLINK libspdk_log.so 00:03:29.454 SYMLINK libspdk_ut.so 00:03:29.454 CC lib/util/base64.o 00:03:29.454 CC lib/ioat/ioat.o 00:03:29.454 CC lib/util/bit_array.o 00:03:29.454 CC lib/util/cpuset.o 00:03:29.454 CXX lib/trace_parser/trace.o 00:03:29.454 CC lib/dma/dma.o 00:03:29.454 CC lib/util/crc16.o 00:03:29.454 CC lib/util/crc32.o 00:03:29.454 CC lib/util/crc32c.o 00:03:29.454 CC lib/util/crc32_ieee.o 00:03:29.454 CC lib/util/crc64.o 00:03:29.454 CC lib/util/dif.o 00:03:29.454 CC lib/util/fd.o 00:03:29.454 CC lib/util/file.o 00:03:29.454 CC lib/util/hexlify.o 00:03:29.454 CC lib/util/iov.o 00:03:29.454 CC lib/util/math.o 00:03:29.454 CC lib/util/pipe.o 00:03:29.454 CC lib/util/strerror_tls.o 00:03:29.454 CC lib/util/string.o 00:03:29.454 CC lib/util/uuid.o 00:03:29.454 CC lib/util/fd_group.o 00:03:29.454 CC lib/util/xor.o 00:03:29.454 CC lib/util/zipf.o 00:03:29.454 CC lib/vfio_user/host/vfio_user_pci.o 00:03:29.454 CC lib/vfio_user/host/vfio_user.o 00:03:29.454 LIB libspdk_dma.a 00:03:29.454 SO libspdk_dma.so.3.0 00:03:29.454 SYMLINK libspdk_dma.so 00:03:29.454 LIB libspdk_ioat.a 00:03:29.454 SO libspdk_ioat.so.6.0 00:03:29.454 SYMLINK libspdk_ioat.so 00:03:29.454 LIB libspdk_vfio_user.a 00:03:29.454 SO libspdk_vfio_user.so.4.0 00:03:29.454 SYMLINK libspdk_vfio_user.so 00:03:29.454 LIB libspdk_util.a 00:03:29.454 SO libspdk_util.so.8.0 00:03:29.454 SYMLINK libspdk_util.so 00:03:29.454 CC lib/conf/conf.o 00:03:29.454 CC lib/vmd/vmd.o 00:03:29.454 CC lib/rdma/common.o 00:03:29.454 CC lib/env_dpdk/env.o 00:03:29.454 CC lib/json/json_parse.o 00:03:29.454 CC lib/idxd/idxd.o 00:03:29.454 CC lib/vmd/led.o 00:03:29.454 CC lib/rdma/rdma_verbs.o 00:03:29.454 CC lib/env_dpdk/memory.o 00:03:29.454 CC lib/idxd/idxd_user.o 00:03:29.454 CC lib/env_dpdk/pci.o 00:03:29.454 CC lib/json/json_util.o 00:03:29.454 CC lib/idxd/idxd_kernel.o 00:03:29.454 CC lib/env_dpdk/init.o 00:03:29.454 CC lib/json/json_write.o 00:03:29.454 CC lib/env_dpdk/threads.o 00:03:29.454 CC lib/env_dpdk/pci_ioat.o 00:03:29.454 CC lib/env_dpdk/pci_virtio.o 00:03:29.454 CC lib/env_dpdk/pci_vmd.o 00:03:29.454 CC lib/env_dpdk/pci_idxd.o 00:03:29.454 CC lib/env_dpdk/pci_event.o 00:03:29.454 CC lib/env_dpdk/sigbus_handler.o 00:03:29.454 CC lib/env_dpdk/pci_dpdk.o 00:03:29.454 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:29.454 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:29.454 LIB libspdk_trace_parser.a 00:03:29.454 SO libspdk_trace_parser.so.4.0 00:03:29.454 LIB libspdk_conf.a 00:03:29.454 SYMLINK libspdk_trace_parser.so 00:03:29.454 SO libspdk_conf.so.5.0 00:03:29.454 SYMLINK libspdk_conf.so 00:03:29.454 LIB libspdk_json.a 00:03:29.454 SO libspdk_json.so.5.1 00:03:29.454 LIB libspdk_rdma.a 00:03:29.454 SYMLINK libspdk_json.so 00:03:29.454 SO libspdk_rdma.so.5.0 00:03:29.454 SYMLINK libspdk_rdma.so 00:03:29.454 CC lib/jsonrpc/jsonrpc_server.o 00:03:29.454 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:29.454 CC lib/jsonrpc/jsonrpc_client.o 00:03:29.454 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:29.454 LIB libspdk_idxd.a 00:03:29.454 SO libspdk_idxd.so.11.0 00:03:29.454 SYMLINK libspdk_idxd.so 00:03:29.454 LIB libspdk_vmd.a 00:03:29.454 SO libspdk_vmd.so.5.0 00:03:29.454 LIB libspdk_jsonrpc.a 00:03:29.454 SO libspdk_jsonrpc.so.5.1 00:03:29.454 SYMLINK libspdk_vmd.so 00:03:29.454 SYMLINK libspdk_jsonrpc.so 00:03:29.454 CC lib/rpc/rpc.o 00:03:29.712 LIB libspdk_rpc.a 00:03:29.712 SO libspdk_rpc.so.5.0 00:03:29.712 SYMLINK libspdk_rpc.so 00:03:29.970 CC lib/trace/trace.o 00:03:29.970 CC lib/trace/trace_flags.o 00:03:29.970 CC lib/notify/notify.o 00:03:29.970 CC lib/sock/sock.o 00:03:29.970 CC lib/trace/trace_rpc.o 00:03:29.970 CC lib/notify/notify_rpc.o 00:03:29.970 CC lib/sock/sock_rpc.o 00:03:29.970 LIB libspdk_notify.a 00:03:30.228 SO libspdk_notify.so.5.0 00:03:30.228 LIB libspdk_trace.a 00:03:30.228 SYMLINK libspdk_notify.so 00:03:30.228 SO libspdk_trace.so.9.0 00:03:30.228 SYMLINK libspdk_trace.so 00:03:30.228 LIB libspdk_sock.a 00:03:30.228 SO libspdk_sock.so.8.0 00:03:30.486 CC lib/thread/thread.o 00:03:30.486 CC lib/thread/iobuf.o 00:03:30.486 SYMLINK libspdk_sock.so 00:03:30.486 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:30.486 CC lib/nvme/nvme_ctrlr.o 00:03:30.486 CC lib/nvme/nvme_fabric.o 00:03:30.486 CC lib/nvme/nvme_ns_cmd.o 00:03:30.486 CC lib/nvme/nvme_ns.o 00:03:30.486 CC lib/nvme/nvme_pcie_common.o 00:03:30.486 CC lib/nvme/nvme_qpair.o 00:03:30.486 CC lib/nvme/nvme_pcie.o 00:03:30.486 CC lib/nvme/nvme.o 00:03:30.486 CC lib/nvme/nvme_quirks.o 00:03:30.486 CC lib/nvme/nvme_transport.o 00:03:30.486 CC lib/nvme/nvme_discovery.o 00:03:30.486 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:30.486 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:30.486 CC lib/nvme/nvme_tcp.o 00:03:30.486 CC lib/nvme/nvme_opal.o 00:03:30.486 CC lib/nvme/nvme_io_msg.o 00:03:30.486 CC lib/nvme/nvme_poll_group.o 00:03:30.486 CC lib/nvme/nvme_zns.o 00:03:30.486 CC lib/nvme/nvme_cuse.o 00:03:30.486 CC lib/nvme/nvme_vfio_user.o 00:03:30.486 CC lib/nvme/nvme_rdma.o 00:03:30.745 LIB libspdk_env_dpdk.a 00:03:30.745 SO libspdk_env_dpdk.so.13.0 00:03:30.745 SYMLINK libspdk_env_dpdk.so 00:03:32.120 LIB libspdk_thread.a 00:03:32.120 SO libspdk_thread.so.9.0 00:03:32.120 SYMLINK libspdk_thread.so 00:03:32.120 CC lib/accel/accel.o 00:03:32.120 CC lib/init/json_config.o 00:03:32.120 CC lib/virtio/virtio.o 00:03:32.120 CC lib/accel/accel_rpc.o 00:03:32.120 CC lib/init/subsystem.o 00:03:32.120 CC lib/virtio/virtio_vhost_user.o 00:03:32.120 CC lib/blob/blobstore.o 00:03:32.120 CC lib/init/subsystem_rpc.o 00:03:32.120 CC lib/accel/accel_sw.o 00:03:32.120 CC lib/virtio/virtio_vfio_user.o 00:03:32.120 CC lib/vfu_tgt/tgt_endpoint.o 00:03:32.120 CC lib/init/rpc.o 00:03:32.120 CC lib/blob/request.o 00:03:32.120 CC lib/virtio/virtio_pci.o 00:03:32.120 CC lib/blob/zeroes.o 00:03:32.120 CC lib/vfu_tgt/tgt_rpc.o 00:03:32.120 CC lib/blob/blob_bs_dev.o 00:03:32.378 LIB libspdk_init.a 00:03:32.378 SO libspdk_init.so.4.0 00:03:32.637 SYMLINK libspdk_init.so 00:03:32.637 LIB libspdk_vfu_tgt.a 00:03:32.637 LIB libspdk_virtio.a 00:03:32.637 SO libspdk_vfu_tgt.so.2.0 00:03:32.637 SO libspdk_virtio.so.6.0 00:03:32.637 SYMLINK libspdk_vfu_tgt.so 00:03:32.637 SYMLINK libspdk_virtio.so 00:03:32.637 CC lib/event/app.o 00:03:32.637 CC lib/event/reactor.o 00:03:32.637 CC lib/event/log_rpc.o 00:03:32.637 CC lib/event/app_rpc.o 00:03:32.637 CC lib/event/scheduler_static.o 00:03:32.895 LIB libspdk_nvme.a 00:03:32.895 SO libspdk_nvme.so.12.0 00:03:33.154 LIB libspdk_event.a 00:03:33.154 SO libspdk_event.so.12.0 00:03:33.154 SYMLINK libspdk_event.so 00:03:33.154 SYMLINK libspdk_nvme.so 00:03:33.154 LIB libspdk_accel.a 00:03:33.154 SO libspdk_accel.so.14.0 00:03:33.413 SYMLINK libspdk_accel.so 00:03:33.413 CC lib/bdev/bdev.o 00:03:33.413 CC lib/bdev/bdev_rpc.o 00:03:33.413 CC lib/bdev/bdev_zone.o 00:03:33.413 CC lib/bdev/part.o 00:03:33.413 CC lib/bdev/scsi_nvme.o 00:03:35.322 LIB libspdk_blob.a 00:03:35.322 SO libspdk_blob.so.10.1 00:03:35.322 SYMLINK libspdk_blob.so 00:03:35.322 CC lib/blobfs/blobfs.o 00:03:35.322 CC lib/lvol/lvol.o 00:03:35.322 CC lib/blobfs/tree.o 00:03:35.888 LIB libspdk_blobfs.a 00:03:35.888 LIB libspdk_bdev.a 00:03:35.888 SO libspdk_blobfs.so.9.0 00:03:35.888 SO libspdk_bdev.so.14.0 00:03:36.156 SYMLINK libspdk_blobfs.so 00:03:36.156 LIB libspdk_lvol.a 00:03:36.156 SO libspdk_lvol.so.9.1 00:03:36.156 SYMLINK libspdk_bdev.so 00:03:36.156 SYMLINK libspdk_lvol.so 00:03:36.156 CC lib/nbd/nbd.o 00:03:36.156 CC lib/scsi/dev.o 00:03:36.156 CC lib/nbd/nbd_rpc.o 00:03:36.156 CC lib/nvmf/ctrlr.o 00:03:36.156 CC lib/scsi/lun.o 00:03:36.156 CC lib/nvmf/ctrlr_discovery.o 00:03:36.156 CC lib/scsi/port.o 00:03:36.156 CC lib/nvmf/ctrlr_bdev.o 00:03:36.156 CC lib/scsi/scsi.o 00:03:36.156 CC lib/nvmf/subsystem.o 00:03:36.156 CC lib/scsi/scsi_bdev.o 00:03:36.156 CC lib/nvmf/nvmf.o 00:03:36.156 CC lib/ublk/ublk.o 00:03:36.156 CC lib/nvmf/nvmf_rpc.o 00:03:36.156 CC lib/scsi/scsi_pr.o 00:03:36.156 CC lib/ftl/ftl_core.o 00:03:36.156 CC lib/ublk/ublk_rpc.o 00:03:36.156 CC lib/nvmf/transport.o 00:03:36.156 CC lib/scsi/scsi_rpc.o 00:03:36.156 CC lib/ftl/ftl_init.o 00:03:36.156 CC lib/scsi/task.o 00:03:36.156 CC lib/nvmf/tcp.o 00:03:36.156 CC lib/ftl/ftl_layout.o 00:03:36.156 CC lib/nvmf/vfio_user.o 00:03:36.156 CC lib/ftl/ftl_debug.o 00:03:36.156 CC lib/nvmf/rdma.o 00:03:36.156 CC lib/ftl/ftl_sb.o 00:03:36.156 CC lib/ftl/ftl_io.o 00:03:36.156 CC lib/ftl/ftl_l2p_flat.o 00:03:36.156 CC lib/ftl/ftl_l2p.o 00:03:36.156 CC lib/ftl/ftl_nv_cache.o 00:03:36.156 CC lib/ftl/ftl_band.o 00:03:36.156 CC lib/ftl/ftl_band_ops.o 00:03:36.156 CC lib/ftl/ftl_writer.o 00:03:36.156 CC lib/ftl/ftl_rq.o 00:03:36.156 CC lib/ftl/ftl_reloc.o 00:03:36.156 CC lib/ftl/ftl_l2p_cache.o 00:03:36.157 CC lib/ftl/ftl_p2l.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:36.157 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:36.415 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:36.415 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:36.675 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:36.675 CC lib/ftl/utils/ftl_conf.o 00:03:36.675 CC lib/ftl/utils/ftl_md.o 00:03:36.675 CC lib/ftl/utils/ftl_mempool.o 00:03:36.675 CC lib/ftl/utils/ftl_bitmap.o 00:03:36.675 CC lib/ftl/utils/ftl_property.o 00:03:36.675 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:36.675 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:36.675 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:36.675 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:36.676 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:36.676 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:36.676 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:36.676 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:36.676 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:36.676 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:36.676 CC lib/ftl/base/ftl_base_dev.o 00:03:36.676 CC lib/ftl/base/ftl_base_bdev.o 00:03:36.676 CC lib/ftl/ftl_trace.o 00:03:36.935 LIB libspdk_nbd.a 00:03:36.935 LIB libspdk_scsi.a 00:03:36.935 SO libspdk_nbd.so.6.0 00:03:37.193 SO libspdk_scsi.so.8.0 00:03:37.193 SYMLINK libspdk_nbd.so 00:03:37.193 SYMLINK libspdk_scsi.so 00:03:37.193 LIB libspdk_ublk.a 00:03:37.193 SO libspdk_ublk.so.2.0 00:03:37.193 CC lib/iscsi/conn.o 00:03:37.193 CC lib/vhost/vhost.o 00:03:37.193 CC lib/iscsi/init_grp.o 00:03:37.193 CC lib/vhost/vhost_rpc.o 00:03:37.193 CC lib/iscsi/iscsi.o 00:03:37.193 CC lib/iscsi/md5.o 00:03:37.193 CC lib/vhost/vhost_scsi.o 00:03:37.193 CC lib/vhost/vhost_blk.o 00:03:37.193 CC lib/iscsi/param.o 00:03:37.193 CC lib/vhost/rte_vhost_user.o 00:03:37.193 CC lib/iscsi/portal_grp.o 00:03:37.193 CC lib/iscsi/tgt_node.o 00:03:37.193 CC lib/iscsi/iscsi_subsystem.o 00:03:37.193 CC lib/iscsi/iscsi_rpc.o 00:03:37.193 CC lib/iscsi/task.o 00:03:37.193 SYMLINK libspdk_ublk.so 00:03:37.759 LIB libspdk_ftl.a 00:03:37.759 SO libspdk_ftl.so.8.0 00:03:38.017 SYMLINK libspdk_ftl.so 00:03:38.583 LIB libspdk_vhost.a 00:03:38.583 SO libspdk_vhost.so.7.1 00:03:38.583 SYMLINK libspdk_vhost.so 00:03:38.841 LIB libspdk_iscsi.a 00:03:38.841 LIB libspdk_nvmf.a 00:03:38.841 SO libspdk_iscsi.so.7.0 00:03:38.841 SO libspdk_nvmf.so.17.0 00:03:38.841 SYMLINK libspdk_iscsi.so 00:03:39.099 SYMLINK libspdk_nvmf.so 00:03:39.100 CC module/env_dpdk/env_dpdk_rpc.o 00:03:39.100 CC module/vfu_device/vfu_virtio.o 00:03:39.100 CC module/vfu_device/vfu_virtio_blk.o 00:03:39.100 CC module/vfu_device/vfu_virtio_scsi.o 00:03:39.100 CC module/vfu_device/vfu_virtio_rpc.o 00:03:39.100 CC module/accel/error/accel_error.o 00:03:39.100 CC module/accel/error/accel_error_rpc.o 00:03:39.100 CC module/blob/bdev/blob_bdev.o 00:03:39.100 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:39.100 CC module/sock/posix/posix.o 00:03:39.100 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:39.100 CC module/accel/iaa/accel_iaa.o 00:03:39.100 CC module/accel/dsa/accel_dsa.o 00:03:39.100 CC module/scheduler/gscheduler/gscheduler.o 00:03:39.100 CC module/accel/dsa/accel_dsa_rpc.o 00:03:39.100 CC module/accel/iaa/accel_iaa_rpc.o 00:03:39.100 CC module/accel/ioat/accel_ioat.o 00:03:39.100 CC module/accel/ioat/accel_ioat_rpc.o 00:03:39.358 LIB libspdk_env_dpdk_rpc.a 00:03:39.358 SO libspdk_env_dpdk_rpc.so.5.0 00:03:39.358 SYMLINK libspdk_env_dpdk_rpc.so 00:03:39.358 LIB libspdk_scheduler_gscheduler.a 00:03:39.358 LIB libspdk_scheduler_dpdk_governor.a 00:03:39.358 SO libspdk_scheduler_gscheduler.so.3.0 00:03:39.358 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:39.358 LIB libspdk_accel_error.a 00:03:39.358 LIB libspdk_accel_ioat.a 00:03:39.358 LIB libspdk_scheduler_dynamic.a 00:03:39.358 SO libspdk_accel_error.so.1.0 00:03:39.358 LIB libspdk_accel_iaa.a 00:03:39.358 SYMLINK libspdk_scheduler_gscheduler.so 00:03:39.358 SO libspdk_scheduler_dynamic.so.3.0 00:03:39.358 SO libspdk_accel_ioat.so.5.0 00:03:39.358 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:39.358 SO libspdk_accel_iaa.so.2.0 00:03:39.358 LIB libspdk_accel_dsa.a 00:03:39.618 SYMLINK libspdk_accel_error.so 00:03:39.618 SYMLINK libspdk_scheduler_dynamic.so 00:03:39.618 SYMLINK libspdk_accel_ioat.so 00:03:39.618 SO libspdk_accel_dsa.so.4.0 00:03:39.618 LIB libspdk_blob_bdev.a 00:03:39.618 SYMLINK libspdk_accel_iaa.so 00:03:39.618 SO libspdk_blob_bdev.so.10.1 00:03:39.618 SYMLINK libspdk_accel_dsa.so 00:03:39.618 SYMLINK libspdk_blob_bdev.so 00:03:39.880 CC module/blobfs/bdev/blobfs_bdev.o 00:03:39.880 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:39.880 CC module/bdev/gpt/gpt.o 00:03:39.880 CC module/bdev/delay/vbdev_delay.o 00:03:39.880 CC module/bdev/gpt/vbdev_gpt.o 00:03:39.880 CC module/bdev/malloc/bdev_malloc.o 00:03:39.880 CC module/bdev/nvme/bdev_nvme.o 00:03:39.880 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:39.880 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:39.880 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:39.880 CC module/bdev/lvol/vbdev_lvol.o 00:03:39.880 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:39.880 CC module/bdev/split/vbdev_split.o 00:03:39.880 CC module/bdev/nvme/nvme_rpc.o 00:03:39.880 CC module/bdev/error/vbdev_error.o 00:03:39.880 CC module/bdev/raid/bdev_raid.o 00:03:39.880 CC module/bdev/ftl/bdev_ftl.o 00:03:39.880 CC module/bdev/error/vbdev_error_rpc.o 00:03:39.880 CC module/bdev/null/bdev_null_rpc.o 00:03:39.880 CC module/bdev/null/bdev_null.o 00:03:39.880 CC module/bdev/split/vbdev_split_rpc.o 00:03:39.880 CC module/bdev/nvme/bdev_mdns_client.o 00:03:39.880 CC module/bdev/raid/bdev_raid_rpc.o 00:03:39.880 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:39.880 CC module/bdev/nvme/vbdev_opal.o 00:03:39.880 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:39.880 CC module/bdev/passthru/vbdev_passthru.o 00:03:39.880 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:39.880 CC module/bdev/iscsi/bdev_iscsi.o 00:03:39.880 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:39.880 CC module/bdev/raid/bdev_raid_sb.o 00:03:39.880 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:39.880 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:39.880 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:39.880 CC module/bdev/raid/raid0.o 00:03:39.880 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:39.880 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:39.880 CC module/bdev/raid/raid1.o 00:03:39.880 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:39.880 CC module/bdev/raid/concat.o 00:03:39.880 CC module/bdev/aio/bdev_aio.o 00:03:39.880 CC module/bdev/aio/bdev_aio_rpc.o 00:03:39.880 LIB libspdk_vfu_device.a 00:03:39.880 SO libspdk_vfu_device.so.2.0 00:03:40.138 SYMLINK libspdk_vfu_device.so 00:03:40.138 LIB libspdk_sock_posix.a 00:03:40.138 SO libspdk_sock_posix.so.5.0 00:03:40.138 LIB libspdk_blobfs_bdev.a 00:03:40.138 SO libspdk_blobfs_bdev.so.5.0 00:03:40.138 LIB libspdk_bdev_split.a 00:03:40.139 SYMLINK libspdk_sock_posix.so 00:03:40.139 LIB libspdk_bdev_null.a 00:03:40.139 LIB libspdk_bdev_gpt.a 00:03:40.139 SYMLINK libspdk_blobfs_bdev.so 00:03:40.139 SO libspdk_bdev_split.so.5.0 00:03:40.139 LIB libspdk_bdev_error.a 00:03:40.139 SO libspdk_bdev_null.so.5.0 00:03:40.139 SO libspdk_bdev_gpt.so.5.0 00:03:40.139 SO libspdk_bdev_error.so.5.0 00:03:40.139 LIB libspdk_bdev_ftl.a 00:03:40.139 LIB libspdk_bdev_aio.a 00:03:40.139 SYMLINK libspdk_bdev_split.so 00:03:40.397 SO libspdk_bdev_ftl.so.5.0 00:03:40.397 SYMLINK libspdk_bdev_null.so 00:03:40.397 SYMLINK libspdk_bdev_gpt.so 00:03:40.397 SYMLINK libspdk_bdev_error.so 00:03:40.397 SO libspdk_bdev_aio.so.5.0 00:03:40.397 LIB libspdk_bdev_zone_block.a 00:03:40.397 LIB libspdk_bdev_delay.a 00:03:40.397 LIB libspdk_bdev_iscsi.a 00:03:40.397 LIB libspdk_bdev_passthru.a 00:03:40.397 SYMLINK libspdk_bdev_ftl.so 00:03:40.397 SO libspdk_bdev_zone_block.so.5.0 00:03:40.397 SO libspdk_bdev_delay.so.5.0 00:03:40.397 SO libspdk_bdev_iscsi.so.5.0 00:03:40.397 SYMLINK libspdk_bdev_aio.so 00:03:40.397 SO libspdk_bdev_passthru.so.5.0 00:03:40.397 LIB libspdk_bdev_malloc.a 00:03:40.397 SYMLINK libspdk_bdev_delay.so 00:03:40.397 SYMLINK libspdk_bdev_zone_block.so 00:03:40.397 SO libspdk_bdev_malloc.so.5.0 00:03:40.397 SYMLINK libspdk_bdev_iscsi.so 00:03:40.397 SYMLINK libspdk_bdev_passthru.so 00:03:40.397 SYMLINK libspdk_bdev_malloc.so 00:03:40.397 LIB libspdk_bdev_lvol.a 00:03:40.397 SO libspdk_bdev_lvol.so.5.0 00:03:40.397 LIB libspdk_bdev_virtio.a 00:03:40.655 SO libspdk_bdev_virtio.so.5.0 00:03:40.655 SYMLINK libspdk_bdev_lvol.so 00:03:40.655 SYMLINK libspdk_bdev_virtio.so 00:03:40.913 LIB libspdk_bdev_raid.a 00:03:40.913 SO libspdk_bdev_raid.so.5.0 00:03:40.913 SYMLINK libspdk_bdev_raid.so 00:03:42.375 LIB libspdk_bdev_nvme.a 00:03:42.375 SO libspdk_bdev_nvme.so.6.0 00:03:42.375 SYMLINK libspdk_bdev_nvme.so 00:03:42.375 CC module/event/subsystems/vmd/vmd.o 00:03:42.375 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:42.375 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:42.375 CC module/event/subsystems/iobuf/iobuf.o 00:03:42.375 CC module/event/subsystems/sock/sock.o 00:03:42.375 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:42.375 CC module/event/subsystems/scheduler/scheduler.o 00:03:42.375 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:42.635 LIB libspdk_event_sock.a 00:03:42.635 LIB libspdk_event_vhost_blk.a 00:03:42.635 LIB libspdk_event_scheduler.a 00:03:42.635 LIB libspdk_event_vfu_tgt.a 00:03:42.635 LIB libspdk_event_vmd.a 00:03:42.635 SO libspdk_event_sock.so.4.0 00:03:42.635 SO libspdk_event_vhost_blk.so.2.0 00:03:42.635 LIB libspdk_event_iobuf.a 00:03:42.635 SO libspdk_event_vfu_tgt.so.2.0 00:03:42.635 SO libspdk_event_scheduler.so.3.0 00:03:42.635 SO libspdk_event_vmd.so.5.0 00:03:42.635 SO libspdk_event_iobuf.so.2.0 00:03:42.635 SYMLINK libspdk_event_sock.so 00:03:42.635 SYMLINK libspdk_event_vhost_blk.so 00:03:42.635 SYMLINK libspdk_event_vfu_tgt.so 00:03:42.635 SYMLINK libspdk_event_scheduler.so 00:03:42.635 SYMLINK libspdk_event_vmd.so 00:03:42.635 SYMLINK libspdk_event_iobuf.so 00:03:42.895 CC module/event/subsystems/accel/accel.o 00:03:42.895 LIB libspdk_event_accel.a 00:03:42.895 SO libspdk_event_accel.so.5.0 00:03:43.156 SYMLINK libspdk_event_accel.so 00:03:43.156 CC module/event/subsystems/bdev/bdev.o 00:03:43.415 LIB libspdk_event_bdev.a 00:03:43.415 SO libspdk_event_bdev.so.5.0 00:03:43.415 SYMLINK libspdk_event_bdev.so 00:03:43.415 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:43.415 CC module/event/subsystems/scsi/scsi.o 00:03:43.415 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:43.415 CC module/event/subsystems/nbd/nbd.o 00:03:43.415 CC module/event/subsystems/ublk/ublk.o 00:03:43.674 LIB libspdk_event_nbd.a 00:03:43.674 LIB libspdk_event_ublk.a 00:03:43.674 LIB libspdk_event_scsi.a 00:03:43.674 SO libspdk_event_nbd.so.5.0 00:03:43.674 SO libspdk_event_ublk.so.2.0 00:03:43.674 SO libspdk_event_scsi.so.5.0 00:03:43.674 SYMLINK libspdk_event_ublk.so 00:03:43.674 SYMLINK libspdk_event_nbd.so 00:03:43.674 LIB libspdk_event_nvmf.a 00:03:43.674 SYMLINK libspdk_event_scsi.so 00:03:43.674 SO libspdk_event_nvmf.so.5.0 00:03:43.931 SYMLINK libspdk_event_nvmf.so 00:03:43.931 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:43.931 CC module/event/subsystems/iscsi/iscsi.o 00:03:43.931 LIB libspdk_event_vhost_scsi.a 00:03:43.931 SO libspdk_event_vhost_scsi.so.2.0 00:03:43.931 LIB libspdk_event_iscsi.a 00:03:44.190 SO libspdk_event_iscsi.so.5.0 00:03:44.190 SYMLINK libspdk_event_vhost_scsi.so 00:03:44.190 SYMLINK libspdk_event_iscsi.so 00:03:44.190 SO libspdk.so.5.0 00:03:44.190 SYMLINK libspdk.so 00:03:44.453 CC app/spdk_nvme_identify/identify.o 00:03:44.453 CC app/trace_record/trace_record.o 00:03:44.453 CXX app/trace/trace.o 00:03:44.453 CC app/spdk_nvme_perf/perf.o 00:03:44.453 CC app/spdk_top/spdk_top.o 00:03:44.453 CC test/rpc_client/rpc_client_test.o 00:03:44.453 CC app/spdk_nvme_discover/discovery_aer.o 00:03:44.453 CC app/spdk_lspci/spdk_lspci.o 00:03:44.453 TEST_HEADER include/spdk/accel.h 00:03:44.453 TEST_HEADER include/spdk/accel_module.h 00:03:44.453 TEST_HEADER include/spdk/assert.h 00:03:44.453 TEST_HEADER include/spdk/barrier.h 00:03:44.453 TEST_HEADER include/spdk/base64.h 00:03:44.453 TEST_HEADER include/spdk/bdev.h 00:03:44.453 TEST_HEADER include/spdk/bdev_module.h 00:03:44.453 TEST_HEADER include/spdk/bdev_zone.h 00:03:44.453 TEST_HEADER include/spdk/bit_array.h 00:03:44.453 TEST_HEADER include/spdk/bit_pool.h 00:03:44.453 TEST_HEADER include/spdk/blob_bdev.h 00:03:44.453 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:44.453 TEST_HEADER include/spdk/blobfs.h 00:03:44.453 TEST_HEADER include/spdk/blob.h 00:03:44.453 TEST_HEADER include/spdk/conf.h 00:03:44.453 TEST_HEADER include/spdk/config.h 00:03:44.453 TEST_HEADER include/spdk/cpuset.h 00:03:44.453 CC app/spdk_dd/spdk_dd.o 00:03:44.453 TEST_HEADER include/spdk/crc16.h 00:03:44.453 TEST_HEADER include/spdk/crc32.h 00:03:44.453 TEST_HEADER include/spdk/crc64.h 00:03:44.453 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:44.453 TEST_HEADER include/spdk/dif.h 00:03:44.453 CC app/nvmf_tgt/nvmf_main.o 00:03:44.453 CC app/iscsi_tgt/iscsi_tgt.o 00:03:44.453 TEST_HEADER include/spdk/dma.h 00:03:44.453 TEST_HEADER include/spdk/endian.h 00:03:44.453 TEST_HEADER include/spdk/env_dpdk.h 00:03:44.454 CC app/vhost/vhost.o 00:03:44.454 TEST_HEADER include/spdk/env.h 00:03:44.454 TEST_HEADER include/spdk/event.h 00:03:44.454 CC test/app/histogram_perf/histogram_perf.o 00:03:44.454 TEST_HEADER include/spdk/fd_group.h 00:03:44.454 TEST_HEADER include/spdk/fd.h 00:03:44.454 CC test/app/jsoncat/jsoncat.o 00:03:44.454 TEST_HEADER include/spdk/file.h 00:03:44.454 CC examples/accel/perf/accel_perf.o 00:03:44.454 CC examples/vmd/led/led.o 00:03:44.454 TEST_HEADER include/spdk/ftl.h 00:03:44.454 CC examples/util/zipf/zipf.o 00:03:44.454 CC examples/vmd/lsvmd/lsvmd.o 00:03:44.454 TEST_HEADER include/spdk/gpt_spec.h 00:03:44.454 CC test/nvme/aer/aer.o 00:03:44.454 CC test/app/stub/stub.o 00:03:44.454 CC test/thread/poller_perf/poller_perf.o 00:03:44.454 CC examples/ioat/verify/verify.o 00:03:44.454 CC test/nvme/sgl/sgl.o 00:03:44.454 TEST_HEADER include/spdk/hexlify.h 00:03:44.454 CC test/event/event_perf/event_perf.o 00:03:44.454 CC examples/nvme/hello_world/hello_world.o 00:03:44.454 CC test/nvme/reset/reset.o 00:03:44.454 CC examples/idxd/perf/perf.o 00:03:44.454 CC app/fio/nvme/fio_plugin.o 00:03:44.454 CC test/nvme/e2edp/nvme_dp.o 00:03:44.454 TEST_HEADER include/spdk/histogram_data.h 00:03:44.454 CC examples/sock/hello_world/hello_sock.o 00:03:44.454 TEST_HEADER include/spdk/idxd.h 00:03:44.454 CC examples/ioat/perf/perf.o 00:03:44.454 TEST_HEADER include/spdk/idxd_spec.h 00:03:44.454 TEST_HEADER include/spdk/init.h 00:03:44.454 CC app/spdk_tgt/spdk_tgt.o 00:03:44.454 TEST_HEADER include/spdk/ioat.h 00:03:44.454 TEST_HEADER include/spdk/ioat_spec.h 00:03:44.454 TEST_HEADER include/spdk/iscsi_spec.h 00:03:44.454 TEST_HEADER include/spdk/json.h 00:03:44.454 TEST_HEADER include/spdk/jsonrpc.h 00:03:44.454 TEST_HEADER include/spdk/likely.h 00:03:44.454 TEST_HEADER include/spdk/log.h 00:03:44.454 TEST_HEADER include/spdk/lvol.h 00:03:44.454 CC test/dma/test_dma/test_dma.o 00:03:44.454 TEST_HEADER include/spdk/memory.h 00:03:44.454 TEST_HEADER include/spdk/mmio.h 00:03:44.454 CC examples/blob/cli/blobcli.o 00:03:44.454 CC test/accel/dif/dif.o 00:03:44.454 CC test/bdev/bdevio/bdevio.o 00:03:44.454 CC test/app/bdev_svc/bdev_svc.o 00:03:44.454 TEST_HEADER include/spdk/nbd.h 00:03:44.454 CC examples/blob/hello_world/hello_blob.o 00:03:44.454 TEST_HEADER include/spdk/notify.h 00:03:44.454 CC examples/nvmf/nvmf/nvmf.o 00:03:44.454 CC examples/thread/thread/thread_ex.o 00:03:44.454 CC test/blobfs/mkfs/mkfs.o 00:03:44.454 TEST_HEADER include/spdk/nvme.h 00:03:44.454 CC examples/bdev/bdevperf/bdevperf.o 00:03:44.454 TEST_HEADER include/spdk/nvme_intel.h 00:03:44.454 CC examples/bdev/hello_world/hello_bdev.o 00:03:44.454 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:44.454 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:44.454 CC test/env/mem_callbacks/mem_callbacks.o 00:03:44.454 TEST_HEADER include/spdk/nvme_spec.h 00:03:44.454 TEST_HEADER include/spdk/nvme_zns.h 00:03:44.454 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:44.454 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:44.454 TEST_HEADER include/spdk/nvmf.h 00:03:44.454 CC test/lvol/esnap/esnap.o 00:03:44.454 TEST_HEADER include/spdk/nvmf_spec.h 00:03:44.454 TEST_HEADER include/spdk/nvmf_transport.h 00:03:44.454 TEST_HEADER include/spdk/opal.h 00:03:44.716 TEST_HEADER include/spdk/opal_spec.h 00:03:44.716 TEST_HEADER include/spdk/pci_ids.h 00:03:44.716 TEST_HEADER include/spdk/pipe.h 00:03:44.716 TEST_HEADER include/spdk/queue.h 00:03:44.716 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:44.716 TEST_HEADER include/spdk/reduce.h 00:03:44.716 TEST_HEADER include/spdk/rpc.h 00:03:44.716 TEST_HEADER include/spdk/scheduler.h 00:03:44.716 TEST_HEADER include/spdk/scsi.h 00:03:44.716 TEST_HEADER include/spdk/scsi_spec.h 00:03:44.716 TEST_HEADER include/spdk/sock.h 00:03:44.716 TEST_HEADER include/spdk/stdinc.h 00:03:44.716 TEST_HEADER include/spdk/string.h 00:03:44.716 TEST_HEADER include/spdk/thread.h 00:03:44.716 TEST_HEADER include/spdk/trace.h 00:03:44.716 TEST_HEADER include/spdk/trace_parser.h 00:03:44.716 TEST_HEADER include/spdk/tree.h 00:03:44.716 TEST_HEADER include/spdk/ublk.h 00:03:44.716 TEST_HEADER include/spdk/util.h 00:03:44.716 TEST_HEADER include/spdk/uuid.h 00:03:44.716 LINK spdk_lspci 00:03:44.716 TEST_HEADER include/spdk/version.h 00:03:44.716 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:44.716 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:44.716 TEST_HEADER include/spdk/vhost.h 00:03:44.716 TEST_HEADER include/spdk/vmd.h 00:03:44.716 TEST_HEADER include/spdk/xor.h 00:03:44.716 TEST_HEADER include/spdk/zipf.h 00:03:44.716 CXX test/cpp_headers/accel.o 00:03:44.716 LINK rpc_client_test 00:03:44.716 LINK jsoncat 00:03:44.716 LINK lsvmd 00:03:44.716 LINK histogram_perf 00:03:44.716 LINK led 00:03:44.716 LINK spdk_nvme_discover 00:03:44.716 LINK event_perf 00:03:44.716 LINK zipf 00:03:44.716 LINK poller_perf 00:03:44.716 LINK interrupt_tgt 00:03:44.716 LINK nvmf_tgt 00:03:44.716 LINK vhost 00:03:44.716 LINK stub 00:03:44.716 LINK spdk_trace_record 00:03:44.982 LINK iscsi_tgt 00:03:44.982 LINK bdev_svc 00:03:44.982 LINK spdk_tgt 00:03:44.982 LINK verify 00:03:44.982 LINK ioat_perf 00:03:44.982 LINK hello_world 00:03:44.982 LINK mkfs 00:03:44.982 LINK hello_sock 00:03:44.982 LINK reset 00:03:44.982 LINK sgl 00:03:44.982 LINK hello_blob 00:03:44.982 LINK aer 00:03:44.982 LINK nvme_dp 00:03:44.982 LINK hello_bdev 00:03:44.982 CXX test/cpp_headers/accel_module.o 00:03:44.982 CC test/env/vtophys/vtophys.o 00:03:44.982 LINK thread 00:03:44.982 CXX test/cpp_headers/assert.o 00:03:45.245 CXX test/cpp_headers/barrier.o 00:03:45.245 LINK nvmf 00:03:45.245 LINK spdk_dd 00:03:45.245 LINK idxd_perf 00:03:45.245 LINK spdk_trace 00:03:45.245 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:45.245 CC test/nvme/overhead/overhead.o 00:03:45.245 CC test/event/reactor/reactor.o 00:03:45.245 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:45.245 CC test/env/memory/memory_ut.o 00:03:45.245 CC test/event/reactor_perf/reactor_perf.o 00:03:45.245 CC app/fio/bdev/fio_plugin.o 00:03:45.245 CXX test/cpp_headers/base64.o 00:03:45.245 LINK dif 00:03:45.245 LINK bdevio 00:03:45.245 LINK test_dma 00:03:45.245 CC test/nvme/err_injection/err_injection.o 00:03:45.245 CC test/event/app_repeat/app_repeat.o 00:03:45.245 CC examples/nvme/reconnect/reconnect.o 00:03:45.245 CC test/nvme/startup/startup.o 00:03:45.245 CC test/event/scheduler/scheduler.o 00:03:45.245 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:45.245 CC test/env/pci/pci_ut.o 00:03:45.245 LINK accel_perf 00:03:45.245 LINK vtophys 00:03:45.245 CXX test/cpp_headers/bdev.o 00:03:45.245 CC test/nvme/reserve/reserve.o 00:03:45.505 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:45.505 CC test/nvme/connect_stress/connect_stress.o 00:03:45.505 CC test/nvme/simple_copy/simple_copy.o 00:03:45.505 CC examples/nvme/arbitration/arbitration.o 00:03:45.505 CXX test/cpp_headers/bdev_module.o 00:03:45.505 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:45.505 LINK nvme_fuzz 00:03:45.505 CXX test/cpp_headers/bdev_zone.o 00:03:45.505 CXX test/cpp_headers/bit_array.o 00:03:45.505 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:45.505 CC examples/nvme/hotplug/hotplug.o 00:03:45.505 CXX test/cpp_headers/bit_pool.o 00:03:45.505 LINK reactor_perf 00:03:45.505 CC examples/nvme/abort/abort.o 00:03:45.505 LINK env_dpdk_post_init 00:03:45.505 LINK reactor 00:03:45.505 CXX test/cpp_headers/blob_bdev.o 00:03:45.505 LINK blobcli 00:03:45.505 LINK spdk_nvme 00:03:45.505 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:45.505 CC test/nvme/boot_partition/boot_partition.o 00:03:45.505 LINK app_repeat 00:03:45.505 CXX test/cpp_headers/blobfs_bdev.o 00:03:45.767 CXX test/cpp_headers/blobfs.o 00:03:45.767 CXX test/cpp_headers/blob.o 00:03:45.767 CC test/nvme/compliance/nvme_compliance.o 00:03:45.767 CXX test/cpp_headers/conf.o 00:03:45.767 LINK err_injection 00:03:45.767 LINK startup 00:03:45.767 CC test/nvme/fused_ordering/fused_ordering.o 00:03:45.767 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:45.767 CXX test/cpp_headers/config.o 00:03:45.767 CXX test/cpp_headers/cpuset.o 00:03:45.767 CC test/nvme/fdp/fdp.o 00:03:45.767 CXX test/cpp_headers/crc16.o 00:03:45.767 LINK overhead 00:03:45.767 LINK mem_callbacks 00:03:45.767 CXX test/cpp_headers/crc32.o 00:03:45.768 LINK connect_stress 00:03:45.768 CXX test/cpp_headers/crc64.o 00:03:45.768 LINK scheduler 00:03:45.768 CC test/nvme/cuse/cuse.o 00:03:45.768 CXX test/cpp_headers/dif.o 00:03:45.768 LINK reserve 00:03:45.768 CXX test/cpp_headers/dma.o 00:03:45.768 CXX test/cpp_headers/endian.o 00:03:45.768 LINK cmb_copy 00:03:45.768 CXX test/cpp_headers/env_dpdk.o 00:03:45.768 CXX test/cpp_headers/env.o 00:03:45.768 CXX test/cpp_headers/event.o 00:03:45.768 LINK simple_copy 00:03:45.768 LINK spdk_nvme_perf 00:03:46.032 LINK pmr_persistence 00:03:46.032 CXX test/cpp_headers/fd_group.o 00:03:46.032 CXX test/cpp_headers/fd.o 00:03:46.032 LINK boot_partition 00:03:46.032 CXX test/cpp_headers/file.o 00:03:46.032 LINK hotplug 00:03:46.032 CXX test/cpp_headers/ftl.o 00:03:46.032 LINK spdk_nvme_identify 00:03:46.032 CXX test/cpp_headers/gpt_spec.o 00:03:46.032 LINK reconnect 00:03:46.032 LINK bdevperf 00:03:46.032 CXX test/cpp_headers/hexlify.o 00:03:46.032 CXX test/cpp_headers/histogram_data.o 00:03:46.032 CXX test/cpp_headers/idxd.o 00:03:46.032 CXX test/cpp_headers/idxd_spec.o 00:03:46.032 CXX test/cpp_headers/init.o 00:03:46.032 LINK arbitration 00:03:46.032 LINK spdk_top 00:03:46.032 CXX test/cpp_headers/ioat.o 00:03:46.032 CXX test/cpp_headers/ioat_spec.o 00:03:46.032 LINK doorbell_aers 00:03:46.032 CXX test/cpp_headers/iscsi_spec.o 00:03:46.032 LINK pci_ut 00:03:46.032 CXX test/cpp_headers/json.o 00:03:46.032 LINK fused_ordering 00:03:46.032 CXX test/cpp_headers/jsonrpc.o 00:03:46.032 CXX test/cpp_headers/likely.o 00:03:46.032 CXX test/cpp_headers/log.o 00:03:46.032 LINK vhost_fuzz 00:03:46.032 CXX test/cpp_headers/lvol.o 00:03:46.032 CXX test/cpp_headers/memory.o 00:03:46.292 CXX test/cpp_headers/mmio.o 00:03:46.292 CXX test/cpp_headers/nbd.o 00:03:46.292 CXX test/cpp_headers/notify.o 00:03:46.292 CXX test/cpp_headers/nvme.o 00:03:46.292 LINK spdk_bdev 00:03:46.292 CXX test/cpp_headers/nvme_intel.o 00:03:46.292 CXX test/cpp_headers/nvme_ocssd.o 00:03:46.292 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:46.292 CXX test/cpp_headers/nvme_spec.o 00:03:46.292 LINK abort 00:03:46.292 CXX test/cpp_headers/nvme_zns.o 00:03:46.292 CXX test/cpp_headers/nvmf_cmd.o 00:03:46.292 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:46.293 CXX test/cpp_headers/nvmf.o 00:03:46.293 CXX test/cpp_headers/nvmf_spec.o 00:03:46.293 CXX test/cpp_headers/nvmf_transport.o 00:03:46.293 CXX test/cpp_headers/opal.o 00:03:46.293 CXX test/cpp_headers/opal_spec.o 00:03:46.293 LINK nvme_compliance 00:03:46.293 CXX test/cpp_headers/pci_ids.o 00:03:46.293 CXX test/cpp_headers/pipe.o 00:03:46.293 CXX test/cpp_headers/queue.o 00:03:46.293 CXX test/cpp_headers/reduce.o 00:03:46.293 LINK nvme_manage 00:03:46.293 CXX test/cpp_headers/rpc.o 00:03:46.293 LINK fdp 00:03:46.293 CXX test/cpp_headers/scheduler.o 00:03:46.293 CXX test/cpp_headers/scsi.o 00:03:46.293 CXX test/cpp_headers/scsi_spec.o 00:03:46.293 CXX test/cpp_headers/sock.o 00:03:46.293 CXX test/cpp_headers/stdinc.o 00:03:46.293 CXX test/cpp_headers/string.o 00:03:46.293 CXX test/cpp_headers/thread.o 00:03:46.293 CXX test/cpp_headers/trace.o 00:03:46.551 CXX test/cpp_headers/trace_parser.o 00:03:46.551 CXX test/cpp_headers/tree.o 00:03:46.551 CXX test/cpp_headers/ublk.o 00:03:46.551 CXX test/cpp_headers/util.o 00:03:46.551 CXX test/cpp_headers/uuid.o 00:03:46.551 CXX test/cpp_headers/version.o 00:03:46.551 CXX test/cpp_headers/vfio_user_pci.o 00:03:46.551 CXX test/cpp_headers/vfio_user_spec.o 00:03:46.551 CXX test/cpp_headers/vhost.o 00:03:46.551 CXX test/cpp_headers/vmd.o 00:03:46.551 CXX test/cpp_headers/xor.o 00:03:46.551 CXX test/cpp_headers/zipf.o 00:03:46.810 LINK memory_ut 00:03:47.376 LINK cuse 00:03:47.634 LINK iscsi_fuzz 00:03:50.165 LINK esnap 00:03:50.424 00:03:50.424 real 0m37.944s 00:03:50.424 user 7m16.441s 00:03:50.424 sys 1m36.990s 00:03:50.424 13:37:30 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:50.424 13:37:30 -- common/autotest_common.sh@10 -- $ set +x 00:03:50.424 ************************************ 00:03:50.424 END TEST make 00:03:50.424 ************************************ 00:03:50.424 13:37:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:50.424 13:37:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:50.424 13:37:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:50.683 13:37:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:50.683 13:37:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:50.683 13:37:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:50.683 13:37:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:50.683 13:37:30 -- scripts/common.sh@335 -- # IFS=.-: 00:03:50.683 13:37:30 -- scripts/common.sh@335 -- # read -ra ver1 00:03:50.683 13:37:30 -- scripts/common.sh@336 -- # IFS=.-: 00:03:50.683 13:37:30 -- scripts/common.sh@336 -- # read -ra ver2 00:03:50.683 13:37:30 -- scripts/common.sh@337 -- # local 'op=<' 00:03:50.683 13:37:30 -- scripts/common.sh@339 -- # ver1_l=2 00:03:50.683 13:37:30 -- scripts/common.sh@340 -- # ver2_l=1 00:03:50.683 13:37:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:50.683 13:37:30 -- scripts/common.sh@343 -- # case "$op" in 00:03:50.683 13:37:30 -- scripts/common.sh@344 -- # : 1 00:03:50.683 13:37:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:50.683 13:37:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:50.683 13:37:30 -- scripts/common.sh@364 -- # decimal 1 00:03:50.683 13:37:30 -- scripts/common.sh@352 -- # local d=1 00:03:50.683 13:37:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:50.683 13:37:30 -- scripts/common.sh@354 -- # echo 1 00:03:50.683 13:37:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:50.683 13:37:30 -- scripts/common.sh@365 -- # decimal 2 00:03:50.683 13:37:30 -- scripts/common.sh@352 -- # local d=2 00:03:50.683 13:37:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:50.683 13:37:30 -- scripts/common.sh@354 -- # echo 2 00:03:50.683 13:37:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:50.683 13:37:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:50.683 13:37:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:50.683 13:37:30 -- scripts/common.sh@367 -- # return 0 00:03:50.683 13:37:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:50.683 13:37:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:50.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.683 --rc genhtml_branch_coverage=1 00:03:50.683 --rc genhtml_function_coverage=1 00:03:50.683 --rc genhtml_legend=1 00:03:50.683 --rc geninfo_all_blocks=1 00:03:50.683 --rc geninfo_unexecuted_blocks=1 00:03:50.683 00:03:50.683 ' 00:03:50.683 13:37:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:50.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.683 --rc genhtml_branch_coverage=1 00:03:50.683 --rc genhtml_function_coverage=1 00:03:50.683 --rc genhtml_legend=1 00:03:50.683 --rc geninfo_all_blocks=1 00:03:50.683 --rc geninfo_unexecuted_blocks=1 00:03:50.683 00:03:50.683 ' 00:03:50.683 13:37:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:50.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.683 --rc genhtml_branch_coverage=1 00:03:50.683 --rc genhtml_function_coverage=1 00:03:50.683 --rc genhtml_legend=1 00:03:50.683 --rc geninfo_all_blocks=1 00:03:50.683 --rc geninfo_unexecuted_blocks=1 00:03:50.683 00:03:50.683 ' 00:03:50.683 13:37:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:50.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.683 --rc genhtml_branch_coverage=1 00:03:50.683 --rc genhtml_function_coverage=1 00:03:50.683 --rc genhtml_legend=1 00:03:50.683 --rc geninfo_all_blocks=1 00:03:50.683 --rc geninfo_unexecuted_blocks=1 00:03:50.683 00:03:50.683 ' 00:03:50.683 13:37:30 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:50.683 13:37:30 -- nvmf/common.sh@7 -- # uname -s 00:03:50.683 13:37:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:50.683 13:37:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:50.683 13:37:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:50.683 13:37:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:50.683 13:37:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:50.683 13:37:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:50.683 13:37:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:50.683 13:37:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:50.683 13:37:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:50.683 13:37:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:50.683 13:37:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:50.683 13:37:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:50.683 13:37:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:50.683 13:37:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:50.683 13:37:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:50.683 13:37:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:50.683 13:37:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:50.683 13:37:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:50.683 13:37:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:50.683 13:37:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.684 13:37:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.684 13:37:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.684 13:37:30 -- paths/export.sh@5 -- # export PATH 00:03:50.684 13:37:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.684 13:37:30 -- nvmf/common.sh@46 -- # : 0 00:03:50.684 13:37:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:50.684 13:37:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:50.684 13:37:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:50.684 13:37:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:50.684 13:37:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:50.684 13:37:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:50.684 13:37:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:50.684 13:37:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:50.684 13:37:30 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:50.684 13:37:30 -- spdk/autotest.sh@32 -- # uname -s 00:03:50.684 13:37:30 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:50.684 13:37:30 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:50.684 13:37:30 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:50.684 13:37:30 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:50.684 13:37:30 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:50.684 13:37:30 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:50.684 13:37:30 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:50.684 13:37:30 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:50.684 13:37:30 -- spdk/autotest.sh@48 -- # udevadm_pid=2144123 00:03:50.684 13:37:30 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:50.684 13:37:30 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.684 13:37:30 -- spdk/autotest.sh@54 -- # echo 2144125 00:03:50.684 13:37:30 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.684 13:37:30 -- spdk/autotest.sh@56 -- # echo 2144126 00:03:50.684 13:37:30 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.684 13:37:30 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:50.684 13:37:30 -- spdk/autotest.sh@60 -- # echo 2144127 00:03:50.684 13:37:30 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:50.684 13:37:30 -- spdk/autotest.sh@62 -- # echo 2144128 00:03:50.684 13:37:30 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:50.684 13:37:30 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:50.684 13:37:30 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:50.684 13:37:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:50.684 13:37:30 -- common/autotest_common.sh@10 -- # set +x 00:03:50.684 13:37:30 -- spdk/autotest.sh@70 -- # create_test_list 00:03:50.684 13:37:30 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:50.684 13:37:30 -- common/autotest_common.sh@10 -- # set +x 00:03:50.684 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:50.684 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:50.684 13:37:30 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:50.684 13:37:30 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:50.684 13:37:30 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:50.684 13:37:30 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:50.684 13:37:30 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:50.684 13:37:30 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:50.684 13:37:30 -- common/autotest_common.sh@1450 -- # uname 00:03:50.684 13:37:30 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:50.684 13:37:30 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:50.684 13:37:30 -- common/autotest_common.sh@1470 -- # uname 00:03:50.684 13:37:30 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:50.684 13:37:30 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:50.684 13:37:30 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:50.684 lcov: LCOV version 1.15 00:03:50.684 13:37:30 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:53.972 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:53.972 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:53.972 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:53.972 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:54.232 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:54.232 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:26.316 13:38:03 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:26.316 13:38:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.316 13:38:03 -- common/autotest_common.sh@10 -- # set +x 00:04:26.316 13:38:03 -- spdk/autotest.sh@89 -- # rm -f 00:04:26.316 13:38:03 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.316 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:26.316 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.316 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.316 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.316 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.316 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.316 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.316 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.316 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.316 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.316 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.316 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.316 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.316 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.316 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.316 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.316 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.316 13:38:05 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:26.316 13:38:05 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:26.316 13:38:05 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:26.316 13:38:05 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:26.316 13:38:05 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:26.316 13:38:05 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:26.316 13:38:05 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:26.316 13:38:05 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:26.316 13:38:05 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:26.316 13:38:05 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:26.316 13:38:05 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:26.316 13:38:05 -- spdk/autotest.sh@108 -- # grep -v p 00:04:26.316 13:38:05 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:26.316 13:38:05 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:26.316 13:38:05 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:26.316 13:38:05 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:26.316 13:38:05 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:26.316 No valid GPT data, bailing 00:04:26.316 13:38:05 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:26.316 13:38:05 -- scripts/common.sh@393 -- # pt= 00:04:26.316 13:38:05 -- scripts/common.sh@394 -- # return 1 00:04:26.316 13:38:05 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:26.316 1+0 records in 00:04:26.316 1+0 records out 00:04:26.316 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0043074 s, 243 MB/s 00:04:26.316 13:38:05 -- spdk/autotest.sh@116 -- # sync 00:04:26.316 13:38:05 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:26.316 13:38:05 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:26.316 13:38:05 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:27.251 13:38:07 -- spdk/autotest.sh@122 -- # uname -s 00:04:27.251 13:38:07 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:27.251 13:38:07 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.251 13:38:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.251 13:38:07 -- common/autotest_common.sh@10 -- # set +x 00:04:27.251 ************************************ 00:04:27.251 START TEST setup.sh 00:04:27.251 ************************************ 00:04:27.251 13:38:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.251 * Looking for test storage... 00:04:27.251 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.251 13:38:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.251 13:38:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.251 13:38:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.251 13:38:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.251 13:38:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.251 13:38:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.251 13:38:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.251 13:38:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.251 13:38:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.251 13:38:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.251 13:38:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.251 13:38:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.251 13:38:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.251 13:38:07 -- scripts/common.sh@344 -- # : 1 00:04:27.251 13:38:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.251 13:38:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.251 13:38:07 -- scripts/common.sh@364 -- # decimal 1 00:04:27.251 13:38:07 -- scripts/common.sh@352 -- # local d=1 00:04:27.251 13:38:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.251 13:38:07 -- scripts/common.sh@354 -- # echo 1 00:04:27.251 13:38:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.251 13:38:07 -- scripts/common.sh@365 -- # decimal 2 00:04:27.251 13:38:07 -- scripts/common.sh@352 -- # local d=2 00:04:27.251 13:38:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.251 13:38:07 -- scripts/common.sh@354 -- # echo 2 00:04:27.251 13:38:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.251 13:38:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.251 13:38:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.251 13:38:07 -- scripts/common.sh@367 -- # return 0 00:04:27.251 13:38:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.251 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.251 --rc genhtml_branch_coverage=1 00:04:27.251 --rc genhtml_function_coverage=1 00:04:27.251 --rc genhtml_legend=1 00:04:27.251 --rc geninfo_all_blocks=1 00:04:27.251 --rc geninfo_unexecuted_blocks=1 00:04:27.251 00:04:27.251 ' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.251 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.251 --rc genhtml_branch_coverage=1 00:04:27.251 --rc genhtml_function_coverage=1 00:04:27.251 --rc genhtml_legend=1 00:04:27.251 --rc geninfo_all_blocks=1 00:04:27.251 --rc geninfo_unexecuted_blocks=1 00:04:27.251 00:04:27.251 ' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.251 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.251 --rc genhtml_branch_coverage=1 00:04:27.251 --rc genhtml_function_coverage=1 00:04:27.251 --rc genhtml_legend=1 00:04:27.251 --rc geninfo_all_blocks=1 00:04:27.251 --rc geninfo_unexecuted_blocks=1 00:04:27.251 00:04:27.251 ' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.251 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.251 --rc genhtml_branch_coverage=1 00:04:27.251 --rc genhtml_function_coverage=1 00:04:27.251 --rc genhtml_legend=1 00:04:27.251 --rc geninfo_all_blocks=1 00:04:27.251 --rc geninfo_unexecuted_blocks=1 00:04:27.251 00:04:27.251 ' 00:04:27.251 13:38:07 -- setup/test-setup.sh@10 -- # uname -s 00:04:27.251 13:38:07 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:27.251 13:38:07 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:27.251 13:38:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.251 13:38:07 -- common/autotest_common.sh@10 -- # set +x 00:04:27.251 ************************************ 00:04:27.251 START TEST acl 00:04:27.251 ************************************ 00:04:27.251 13:38:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:27.251 * Looking for test storage... 00:04:27.251 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.251 13:38:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.251 13:38:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.251 13:38:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.251 13:38:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.251 13:38:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.251 13:38:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.251 13:38:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.251 13:38:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.251 13:38:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.251 13:38:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.251 13:38:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.251 13:38:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.251 13:38:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.251 13:38:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.251 13:38:07 -- scripts/common.sh@344 -- # : 1 00:04:27.251 13:38:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.251 13:38:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.251 13:38:07 -- scripts/common.sh@364 -- # decimal 1 00:04:27.251 13:38:07 -- scripts/common.sh@352 -- # local d=1 00:04:27.251 13:38:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.251 13:38:07 -- scripts/common.sh@354 -- # echo 1 00:04:27.251 13:38:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.251 13:38:07 -- scripts/common.sh@365 -- # decimal 2 00:04:27.252 13:38:07 -- scripts/common.sh@352 -- # local d=2 00:04:27.252 13:38:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.252 13:38:07 -- scripts/common.sh@354 -- # echo 2 00:04:27.252 13:38:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.252 13:38:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.252 13:38:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.252 13:38:07 -- scripts/common.sh@367 -- # return 0 00:04:27.252 13:38:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.252 13:38:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.252 --rc genhtml_branch_coverage=1 00:04:27.252 --rc genhtml_function_coverage=1 00:04:27.252 --rc genhtml_legend=1 00:04:27.252 --rc geninfo_all_blocks=1 00:04:27.252 --rc geninfo_unexecuted_blocks=1 00:04:27.252 00:04:27.252 ' 00:04:27.252 13:38:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.252 --rc genhtml_branch_coverage=1 00:04:27.252 --rc genhtml_function_coverage=1 00:04:27.252 --rc genhtml_legend=1 00:04:27.252 --rc geninfo_all_blocks=1 00:04:27.252 --rc geninfo_unexecuted_blocks=1 00:04:27.252 00:04:27.252 ' 00:04:27.252 13:38:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.252 --rc genhtml_branch_coverage=1 00:04:27.252 --rc genhtml_function_coverage=1 00:04:27.252 --rc genhtml_legend=1 00:04:27.252 --rc geninfo_all_blocks=1 00:04:27.252 --rc geninfo_unexecuted_blocks=1 00:04:27.252 00:04:27.252 ' 00:04:27.252 13:38:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.252 --rc genhtml_branch_coverage=1 00:04:27.252 --rc genhtml_function_coverage=1 00:04:27.252 --rc genhtml_legend=1 00:04:27.252 --rc geninfo_all_blocks=1 00:04:27.252 --rc geninfo_unexecuted_blocks=1 00:04:27.252 00:04:27.252 ' 00:04:27.252 13:38:07 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:27.252 13:38:07 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:27.252 13:38:07 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:27.252 13:38:07 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:27.252 13:38:07 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:27.252 13:38:07 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:27.252 13:38:07 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:27.252 13:38:07 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:27.252 13:38:07 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:27.252 13:38:07 -- setup/acl.sh@12 -- # devs=() 00:04:27.252 13:38:07 -- setup/acl.sh@12 -- # declare -a devs 00:04:27.252 13:38:07 -- setup/acl.sh@13 -- # drivers=() 00:04:27.252 13:38:07 -- setup/acl.sh@13 -- # declare -A drivers 00:04:27.252 13:38:07 -- setup/acl.sh@51 -- # setup reset 00:04:27.252 13:38:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:27.252 13:38:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:29.152 13:38:09 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:29.152 13:38:09 -- setup/acl.sh@16 -- # local dev driver 00:04:29.152 13:38:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.152 13:38:09 -- setup/acl.sh@15 -- # setup output status 00:04:29.152 13:38:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:29.152 13:38:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:30.085 Hugepages 00:04:30.085 node hugesize free / total 00:04:30.085 13:38:10 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:30.085 13:38:10 -- setup/acl.sh@19 -- # continue 00:04:30.085 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.085 13:38:10 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:30.085 13:38:10 -- setup/acl.sh@19 -- # continue 00:04:30.085 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 00:04:30.086 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # continue 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:30.086 13:38:10 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:30.086 13:38:10 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:30.086 13:38:10 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:30.086 13:38:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.086 13:38:10 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:30.086 13:38:10 -- setup/acl.sh@54 -- # run_test denied denied 00:04:30.086 13:38:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.086 13:38:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.086 13:38:10 -- common/autotest_common.sh@10 -- # set +x 00:04:30.086 ************************************ 00:04:30.086 START TEST denied 00:04:30.086 ************************************ 00:04:30.086 13:38:10 -- common/autotest_common.sh@1114 -- # denied 00:04:30.086 13:38:10 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:30.086 13:38:10 -- setup/acl.sh@38 -- # setup output config 00:04:30.086 13:38:10 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:30.086 13:38:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.086 13:38:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:31.989 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:31.989 13:38:11 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:31.989 13:38:11 -- setup/acl.sh@28 -- # local dev driver 00:04:31.989 13:38:11 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:31.989 13:38:11 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:31.989 13:38:11 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:31.989 13:38:11 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:31.989 13:38:11 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:31.989 13:38:11 -- setup/acl.sh@41 -- # setup reset 00:04:31.989 13:38:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:31.989 13:38:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:33.891 00:04:33.891 real 0m3.871s 00:04:33.891 user 0m1.106s 00:04:33.891 sys 0m1.919s 00:04:33.891 13:38:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.891 13:38:14 -- common/autotest_common.sh@10 -- # set +x 00:04:33.891 ************************************ 00:04:33.891 END TEST denied 00:04:33.891 ************************************ 00:04:33.891 13:38:14 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:33.891 13:38:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.891 13:38:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.891 13:38:14 -- common/autotest_common.sh@10 -- # set +x 00:04:33.891 ************************************ 00:04:33.891 START TEST allowed 00:04:33.891 ************************************ 00:04:33.891 13:38:14 -- common/autotest_common.sh@1114 -- # allowed 00:04:33.891 13:38:14 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:33.891 13:38:14 -- setup/acl.sh@45 -- # setup output config 00:04:33.891 13:38:14 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:33.891 13:38:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.891 13:38:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:36.425 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:36.425 13:38:16 -- setup/acl.sh@47 -- # verify 00:04:36.425 13:38:16 -- setup/acl.sh@28 -- # local dev driver 00:04:36.425 13:38:16 -- setup/acl.sh@48 -- # setup reset 00:04:36.425 13:38:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:36.425 13:38:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:38.334 00:04:38.334 real 0m3.965s 00:04:38.334 user 0m1.109s 00:04:38.334 sys 0m1.767s 00:04:38.334 13:38:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.334 13:38:18 -- common/autotest_common.sh@10 -- # set +x 00:04:38.334 ************************************ 00:04:38.334 END TEST allowed 00:04:38.334 ************************************ 00:04:38.334 00:04:38.334 real 0m10.740s 00:04:38.334 user 0m3.375s 00:04:38.334 sys 0m5.520s 00:04:38.334 13:38:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.334 13:38:18 -- common/autotest_common.sh@10 -- # set +x 00:04:38.334 ************************************ 00:04:38.334 END TEST acl 00:04:38.334 ************************************ 00:04:38.334 13:38:18 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:38.334 13:38:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.334 13:38:18 -- common/autotest_common.sh@10 -- # set +x 00:04:38.334 ************************************ 00:04:38.334 START TEST hugepages 00:04:38.334 ************************************ 00:04:38.334 13:38:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:38.334 * Looking for test storage... 00:04:38.334 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:38.334 13:38:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.334 13:38:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.334 13:38:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.334 13:38:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.334 13:38:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.334 13:38:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.334 13:38:18 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.334 13:38:18 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.334 13:38:18 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.334 13:38:18 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.334 13:38:18 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.334 13:38:18 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.334 13:38:18 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.334 13:38:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.334 13:38:18 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.334 13:38:18 -- scripts/common.sh@344 -- # : 1 00:04:38.334 13:38:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.334 13:38:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.334 13:38:18 -- scripts/common.sh@364 -- # decimal 1 00:04:38.334 13:38:18 -- scripts/common.sh@352 -- # local d=1 00:04:38.334 13:38:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.334 13:38:18 -- scripts/common.sh@354 -- # echo 1 00:04:38.334 13:38:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.334 13:38:18 -- scripts/common.sh@365 -- # decimal 2 00:04:38.334 13:38:18 -- scripts/common.sh@352 -- # local d=2 00:04:38.334 13:38:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.334 13:38:18 -- scripts/common.sh@354 -- # echo 2 00:04:38.334 13:38:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.334 13:38:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.334 13:38:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.334 13:38:18 -- scripts/common.sh@367 -- # return 0 00:04:38.334 13:38:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.334 --rc genhtml_branch_coverage=1 00:04:38.334 --rc genhtml_function_coverage=1 00:04:38.334 --rc genhtml_legend=1 00:04:38.334 --rc geninfo_all_blocks=1 00:04:38.334 --rc geninfo_unexecuted_blocks=1 00:04:38.334 00:04:38.334 ' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.334 --rc genhtml_branch_coverage=1 00:04:38.334 --rc genhtml_function_coverage=1 00:04:38.334 --rc genhtml_legend=1 00:04:38.334 --rc geninfo_all_blocks=1 00:04:38.334 --rc geninfo_unexecuted_blocks=1 00:04:38.334 00:04:38.334 ' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.334 --rc genhtml_branch_coverage=1 00:04:38.334 --rc genhtml_function_coverage=1 00:04:38.334 --rc genhtml_legend=1 00:04:38.334 --rc geninfo_all_blocks=1 00:04:38.334 --rc geninfo_unexecuted_blocks=1 00:04:38.334 00:04:38.334 ' 00:04:38.334 13:38:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.334 --rc genhtml_branch_coverage=1 00:04:38.334 --rc genhtml_function_coverage=1 00:04:38.334 --rc genhtml_legend=1 00:04:38.334 --rc geninfo_all_blocks=1 00:04:38.334 --rc geninfo_unexecuted_blocks=1 00:04:38.334 00:04:38.334 ' 00:04:38.334 13:38:18 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:38.334 13:38:18 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:38.334 13:38:18 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:38.334 13:38:18 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:38.334 13:38:18 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:38.334 13:38:18 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:38.334 13:38:18 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:38.334 13:38:18 -- setup/common.sh@18 -- # local node= 00:04:38.334 13:38:18 -- setup/common.sh@19 -- # local var val 00:04:38.334 13:38:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.334 13:38:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.334 13:38:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.334 13:38:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.334 13:38:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.334 13:38:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.334 13:38:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 40525856 kB' 'MemAvailable: 44300920 kB' 'Buffers: 2708 kB' 'Cached: 13238584 kB' 'SwapCached: 0 kB' 'Active: 9950040 kB' 'Inactive: 3764480 kB' 'Active(anon): 9548752 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476672 kB' 'Mapped: 166644 kB' 'Shmem: 9075524 kB' 'KReclaimable: 205748 kB' 'Slab: 745836 kB' 'SReclaimable: 205748 kB' 'SUnreclaim: 540088 kB' 'KernelStack: 12864 kB' 'PageTables: 8048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 10639608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.334 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.334 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.335 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.335 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # continue 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.336 13:38:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.336 13:38:18 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.336 13:38:18 -- setup/common.sh@33 -- # echo 2048 00:04:38.336 13:38:18 -- setup/common.sh@33 -- # return 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:38.336 13:38:18 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:38.336 13:38:18 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:38.336 13:38:18 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:38.336 13:38:18 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:38.336 13:38:18 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:38.336 13:38:18 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:38.336 13:38:18 -- setup/hugepages.sh@207 -- # get_nodes 00:04:38.336 13:38:18 -- setup/hugepages.sh@27 -- # local node 00:04:38.336 13:38:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.336 13:38:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:38.336 13:38:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.336 13:38:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:38.336 13:38:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:38.336 13:38:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:38.336 13:38:18 -- setup/hugepages.sh@208 -- # clear_hp 00:04:38.336 13:38:18 -- setup/hugepages.sh@37 -- # local node hp 00:04:38.336 13:38:18 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:38.336 13:38:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.336 13:38:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.336 13:38:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:38.336 13:38:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.336 13:38:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.336 13:38:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:38.336 13:38:18 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:38.336 13:38:18 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:38.336 13:38:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.336 13:38:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.336 13:38:18 -- common/autotest_common.sh@10 -- # set +x 00:04:38.336 ************************************ 00:04:38.336 START TEST default_setup 00:04:38.336 ************************************ 00:04:38.336 13:38:18 -- common/autotest_common.sh@1114 -- # default_setup 00:04:38.336 13:38:18 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:38.336 13:38:18 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:38.336 13:38:18 -- setup/hugepages.sh@51 -- # shift 00:04:38.336 13:38:18 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:38.336 13:38:18 -- setup/hugepages.sh@52 -- # local node_ids 00:04:38.336 13:38:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.336 13:38:18 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:38.336 13:38:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:38.336 13:38:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.336 13:38:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:38.336 13:38:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.336 13:38:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.336 13:38:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.336 13:38:18 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:38.336 13:38:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:38.336 13:38:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:38.336 13:38:18 -- setup/hugepages.sh@73 -- # return 0 00:04:38.336 13:38:18 -- setup/hugepages.sh@137 -- # setup output 00:04:38.336 13:38:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.336 13:38:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:39.763 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:39.763 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:39.763 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:40.351 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:40.614 13:38:20 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:40.614 13:38:20 -- setup/hugepages.sh@89 -- # local node 00:04:40.614 13:38:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:40.614 13:38:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:40.614 13:38:20 -- setup/hugepages.sh@92 -- # local surp 00:04:40.614 13:38:20 -- setup/hugepages.sh@93 -- # local resv 00:04:40.614 13:38:20 -- setup/hugepages.sh@94 -- # local anon 00:04:40.614 13:38:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:40.614 13:38:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:40.614 13:38:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:40.614 13:38:20 -- setup/common.sh@18 -- # local node= 00:04:40.614 13:38:20 -- setup/common.sh@19 -- # local var val 00:04:40.614 13:38:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.614 13:38:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.614 13:38:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.614 13:38:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.614 13:38:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.614 13:38:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42666836 kB' 'MemAvailable: 46441960 kB' 'Buffers: 2708 kB' 'Cached: 13238684 kB' 'SwapCached: 0 kB' 'Active: 9952496 kB' 'Inactive: 3764480 kB' 'Active(anon): 9551208 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478844 kB' 'Mapped: 166176 kB' 'Shmem: 9075624 kB' 'KReclaimable: 205868 kB' 'Slab: 745756 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539888 kB' 'KernelStack: 12848 kB' 'PageTables: 8128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10646536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.615 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.615 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.616 13:38:20 -- setup/common.sh@33 -- # echo 0 00:04:40.616 13:38:20 -- setup/common.sh@33 -- # return 0 00:04:40.616 13:38:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:40.616 13:38:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:40.616 13:38:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.616 13:38:20 -- setup/common.sh@18 -- # local node= 00:04:40.616 13:38:20 -- setup/common.sh@19 -- # local var val 00:04:40.616 13:38:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.616 13:38:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.616 13:38:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.616 13:38:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.616 13:38:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.616 13:38:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42668740 kB' 'MemAvailable: 46443864 kB' 'Buffers: 2708 kB' 'Cached: 13238684 kB' 'SwapCached: 0 kB' 'Active: 9952304 kB' 'Inactive: 3764480 kB' 'Active(anon): 9551016 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478712 kB' 'Mapped: 166336 kB' 'Shmem: 9075624 kB' 'KReclaimable: 205868 kB' 'Slab: 745728 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539860 kB' 'KernelStack: 12816 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10646548 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.616 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.616 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.617 13:38:20 -- setup/common.sh@33 -- # echo 0 00:04:40.617 13:38:20 -- setup/common.sh@33 -- # return 0 00:04:40.617 13:38:20 -- setup/hugepages.sh@99 -- # surp=0 00:04:40.617 13:38:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:40.617 13:38:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:40.617 13:38:20 -- setup/common.sh@18 -- # local node= 00:04:40.617 13:38:20 -- setup/common.sh@19 -- # local var val 00:04:40.617 13:38:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.617 13:38:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.617 13:38:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.617 13:38:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.617 13:38:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.617 13:38:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42669056 kB' 'MemAvailable: 46444180 kB' 'Buffers: 2708 kB' 'Cached: 13238684 kB' 'SwapCached: 0 kB' 'Active: 9951752 kB' 'Inactive: 3764480 kB' 'Active(anon): 9550464 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477708 kB' 'Mapped: 166304 kB' 'Shmem: 9075624 kB' 'KReclaimable: 205868 kB' 'Slab: 745824 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539956 kB' 'KernelStack: 12848 kB' 'PageTables: 7920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10646560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.617 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.617 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.618 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.618 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.619 13:38:20 -- setup/common.sh@33 -- # echo 0 00:04:40.619 13:38:20 -- setup/common.sh@33 -- # return 0 00:04:40.619 13:38:20 -- setup/hugepages.sh@100 -- # resv=0 00:04:40.619 13:38:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:40.619 nr_hugepages=1024 00:04:40.619 13:38:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:40.619 resv_hugepages=0 00:04:40.619 13:38:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:40.619 surplus_hugepages=0 00:04:40.619 13:38:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:40.619 anon_hugepages=0 00:04:40.619 13:38:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.619 13:38:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:40.619 13:38:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:40.619 13:38:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:40.619 13:38:20 -- setup/common.sh@18 -- # local node= 00:04:40.619 13:38:20 -- setup/common.sh@19 -- # local var val 00:04:40.619 13:38:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.619 13:38:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.619 13:38:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.619 13:38:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.619 13:38:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.619 13:38:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42670288 kB' 'MemAvailable: 46445412 kB' 'Buffers: 2708 kB' 'Cached: 13238716 kB' 'SwapCached: 0 kB' 'Active: 9951600 kB' 'Inactive: 3764480 kB' 'Active(anon): 9550312 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477984 kB' 'Mapped: 166304 kB' 'Shmem: 9075656 kB' 'KReclaimable: 205868 kB' 'Slab: 745824 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539956 kB' 'KernelStack: 12864 kB' 'PageTables: 7968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10646576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.619 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.619 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.620 13:38:20 -- setup/common.sh@33 -- # echo 1024 00:04:40.620 13:38:20 -- setup/common.sh@33 -- # return 0 00:04:40.620 13:38:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.620 13:38:20 -- setup/hugepages.sh@112 -- # get_nodes 00:04:40.620 13:38:20 -- setup/hugepages.sh@27 -- # local node 00:04:40.620 13:38:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.620 13:38:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:40.620 13:38:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.620 13:38:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:40.620 13:38:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:40.620 13:38:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:40.620 13:38:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:40.620 13:38:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:40.620 13:38:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:40.620 13:38:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.620 13:38:20 -- setup/common.sh@18 -- # local node=0 00:04:40.620 13:38:20 -- setup/common.sh@19 -- # local var val 00:04:40.620 13:38:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.620 13:38:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.620 13:38:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:40.620 13:38:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:40.620 13:38:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.620 13:38:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26240804 kB' 'MemUsed: 6585052 kB' 'SwapCached: 0 kB' 'Active: 3240464 kB' 'Inactive: 159256 kB' 'Active(anon): 3097964 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252544 kB' 'Mapped: 66060 kB' 'AnonPages: 150436 kB' 'Shmem: 2950788 kB' 'KernelStack: 7032 kB' 'PageTables: 3632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377472 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307404 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.620 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.620 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # continue 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.621 13:38:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.621 13:38:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.621 13:38:20 -- setup/common.sh@33 -- # echo 0 00:04:40.621 13:38:20 -- setup/common.sh@33 -- # return 0 00:04:40.621 13:38:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:40.621 13:38:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:40.621 13:38:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:40.621 13:38:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:40.621 13:38:20 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:40.621 node0=1024 expecting 1024 00:04:40.621 13:38:20 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:40.621 00:04:40.621 real 0m2.489s 00:04:40.621 user 0m0.664s 00:04:40.621 sys 0m0.950s 00:04:40.621 13:38:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.621 13:38:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.621 ************************************ 00:04:40.621 END TEST default_setup 00:04:40.621 ************************************ 00:04:40.621 13:38:20 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:40.621 13:38:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.621 13:38:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.621 13:38:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.621 ************************************ 00:04:40.621 START TEST per_node_1G_alloc 00:04:40.621 ************************************ 00:04:40.621 13:38:20 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:40.621 13:38:20 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:40.621 13:38:20 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:40.621 13:38:20 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:40.621 13:38:20 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:40.621 13:38:20 -- setup/hugepages.sh@51 -- # shift 00:04:40.621 13:38:20 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:40.621 13:38:20 -- setup/hugepages.sh@52 -- # local node_ids 00:04:40.621 13:38:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:40.621 13:38:20 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:40.621 13:38:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:40.621 13:38:20 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:40.621 13:38:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:40.621 13:38:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:40.621 13:38:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:40.621 13:38:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:40.621 13:38:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:40.621 13:38:20 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:40.621 13:38:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:40.621 13:38:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:40.621 13:38:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:40.621 13:38:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:40.621 13:38:20 -- setup/hugepages.sh@73 -- # return 0 00:04:40.621 13:38:20 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:40.621 13:38:20 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:40.621 13:38:20 -- setup/hugepages.sh@146 -- # setup output 00:04:40.621 13:38:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.621 13:38:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:41.998 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:41.998 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:41.998 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:41.998 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:41.998 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:41.998 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:41.998 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:41.998 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:41.998 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:41.998 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:41.998 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:41.998 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:41.998 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:41.998 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:41.998 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:41.998 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:41.998 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:41.998 13:38:22 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:41.998 13:38:22 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:41.998 13:38:22 -- setup/hugepages.sh@89 -- # local node 00:04:41.998 13:38:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:41.998 13:38:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:41.998 13:38:22 -- setup/hugepages.sh@92 -- # local surp 00:04:41.998 13:38:22 -- setup/hugepages.sh@93 -- # local resv 00:04:41.998 13:38:22 -- setup/hugepages.sh@94 -- # local anon 00:04:41.998 13:38:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:41.998 13:38:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:41.998 13:38:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:41.998 13:38:22 -- setup/common.sh@18 -- # local node= 00:04:41.998 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:41.998 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.998 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.998 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.998 13:38:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.998 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.998 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42672856 kB' 'MemAvailable: 46447980 kB' 'Buffers: 2708 kB' 'Cached: 13238768 kB' 'SwapCached: 0 kB' 'Active: 9950996 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549708 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476776 kB' 'Mapped: 165244 kB' 'Shmem: 9075708 kB' 'KReclaimable: 205868 kB' 'Slab: 745828 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539960 kB' 'KernelStack: 12784 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.998 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.998 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.999 13:38:22 -- setup/common.sh@33 -- # echo 0 00:04:41.999 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:41.999 13:38:22 -- setup/hugepages.sh@97 -- # anon=0 00:04:41.999 13:38:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:41.999 13:38:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:41.999 13:38:22 -- setup/common.sh@18 -- # local node= 00:04:41.999 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:41.999 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.999 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.999 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.999 13:38:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.999 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.999 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42671440 kB' 'MemAvailable: 46446564 kB' 'Buffers: 2708 kB' 'Cached: 13238768 kB' 'SwapCached: 0 kB' 'Active: 9950956 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549668 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477172 kB' 'Mapped: 165244 kB' 'Shmem: 9075708 kB' 'KReclaimable: 205868 kB' 'Slab: 745844 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 539976 kB' 'KernelStack: 12736 kB' 'PageTables: 7656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.999 13:38:22 -- setup/common.sh@32 -- # continue 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.999 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.000 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.000 13:38:22 -- setup/common.sh@33 -- # echo 0 00:04:42.000 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:42.000 13:38:22 -- setup/hugepages.sh@99 -- # surp=0 00:04:42.000 13:38:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:42.000 13:38:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:42.000 13:38:22 -- setup/common.sh@18 -- # local node= 00:04:42.000 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:42.000 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.000 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.000 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.000 13:38:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.000 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.000 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.000 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42676244 kB' 'MemAvailable: 46451368 kB' 'Buffers: 2708 kB' 'Cached: 13238784 kB' 'SwapCached: 0 kB' 'Active: 9950744 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549456 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476976 kB' 'Mapped: 165228 kB' 'Shmem: 9075724 kB' 'KReclaimable: 205868 kB' 'Slab: 745940 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 540072 kB' 'KernelStack: 12832 kB' 'PageTables: 7980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10618752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.001 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.001 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.002 13:38:22 -- setup/common.sh@33 -- # echo 0 00:04:42.002 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:42.002 13:38:22 -- setup/hugepages.sh@100 -- # resv=0 00:04:42.002 13:38:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:42.002 nr_hugepages=1024 00:04:42.002 13:38:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:42.002 resv_hugepages=0 00:04:42.002 13:38:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:42.002 surplus_hugepages=0 00:04:42.002 13:38:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:42.002 anon_hugepages=0 00:04:42.002 13:38:22 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.002 13:38:22 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:42.002 13:38:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:42.002 13:38:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:42.002 13:38:22 -- setup/common.sh@18 -- # local node= 00:04:42.002 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:42.002 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.002 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.002 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.002 13:38:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.002 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.002 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42676436 kB' 'MemAvailable: 46451560 kB' 'Buffers: 2708 kB' 'Cached: 13238796 kB' 'SwapCached: 0 kB' 'Active: 9950420 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549132 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476656 kB' 'Mapped: 165228 kB' 'Shmem: 9075736 kB' 'KReclaimable: 205868 kB' 'Slab: 745928 kB' 'SReclaimable: 205868 kB' 'SUnreclaim: 540060 kB' 'KernelStack: 12752 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.002 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.002 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.003 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.003 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.264 13:38:22 -- setup/common.sh@33 -- # echo 1024 00:04:42.264 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:42.264 13:38:22 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.264 13:38:22 -- setup/hugepages.sh@112 -- # get_nodes 00:04:42.264 13:38:22 -- setup/hugepages.sh@27 -- # local node 00:04:42.264 13:38:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.264 13:38:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:42.264 13:38:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.264 13:38:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:42.264 13:38:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.264 13:38:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.264 13:38:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.264 13:38:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.264 13:38:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:42.264 13:38:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.264 13:38:22 -- setup/common.sh@18 -- # local node=0 00:04:42.264 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:42.264 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.264 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.264 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:42.264 13:38:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:42.264 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.264 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27298264 kB' 'MemUsed: 5527592 kB' 'SwapCached: 0 kB' 'Active: 3240568 kB' 'Inactive: 159256 kB' 'Active(anon): 3098068 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252612 kB' 'Mapped: 65200 kB' 'AnonPages: 150404 kB' 'Shmem: 2950856 kB' 'KernelStack: 7016 kB' 'PageTables: 3572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377644 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307576 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.264 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.264 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@33 -- # echo 0 00:04:42.265 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:42.265 13:38:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.265 13:38:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.265 13:38:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.265 13:38:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:42.265 13:38:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.265 13:38:22 -- setup/common.sh@18 -- # local node=1 00:04:42.265 13:38:22 -- setup/common.sh@19 -- # local var val 00:04:42.265 13:38:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.265 13:38:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.265 13:38:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:42.265 13:38:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:42.265 13:38:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.265 13:38:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 15378572 kB' 'MemUsed: 12331236 kB' 'SwapCached: 0 kB' 'Active: 6710064 kB' 'Inactive: 3605224 kB' 'Active(anon): 6451276 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3605224 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9988900 kB' 'Mapped: 100464 kB' 'AnonPages: 326444 kB' 'Shmem: 6124888 kB' 'KernelStack: 5752 kB' 'PageTables: 4200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 135800 kB' 'Slab: 368284 kB' 'SReclaimable: 135800 kB' 'SUnreclaim: 232484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.265 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.265 13:38:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # continue 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.266 13:38:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.266 13:38:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.266 13:38:22 -- setup/common.sh@33 -- # echo 0 00:04:42.266 13:38:22 -- setup/common.sh@33 -- # return 0 00:04:42.266 13:38:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.266 13:38:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.266 13:38:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.266 13:38:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:42.266 node0=512 expecting 512 00:04:42.266 13:38:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.266 13:38:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.266 13:38:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.266 13:38:22 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:42.266 node1=512 expecting 512 00:04:42.266 13:38:22 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:42.266 00:04:42.266 real 0m1.452s 00:04:42.266 user 0m0.613s 00:04:42.266 sys 0m0.803s 00:04:42.266 13:38:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.266 13:38:22 -- common/autotest_common.sh@10 -- # set +x 00:04:42.266 ************************************ 00:04:42.266 END TEST per_node_1G_alloc 00:04:42.266 ************************************ 00:04:42.266 13:38:22 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:42.266 13:38:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.266 13:38:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.266 13:38:22 -- common/autotest_common.sh@10 -- # set +x 00:04:42.266 ************************************ 00:04:42.266 START TEST even_2G_alloc 00:04:42.266 ************************************ 00:04:42.266 13:38:22 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:42.266 13:38:22 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:42.266 13:38:22 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:42.266 13:38:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:42.266 13:38:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:42.266 13:38:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:42.266 13:38:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.266 13:38:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:42.266 13:38:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.266 13:38:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.266 13:38:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.266 13:38:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:42.266 13:38:22 -- setup/hugepages.sh@83 -- # : 512 00:04:42.266 13:38:22 -- setup/hugepages.sh@84 -- # : 1 00:04:42.266 13:38:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:42.266 13:38:22 -- setup/hugepages.sh@83 -- # : 0 00:04:42.266 13:38:22 -- setup/hugepages.sh@84 -- # : 0 00:04:42.266 13:38:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.266 13:38:22 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:42.266 13:38:22 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:42.266 13:38:22 -- setup/hugepages.sh@153 -- # setup output 00:04:42.266 13:38:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.266 13:38:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.646 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.647 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:43.647 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.647 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.647 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.647 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.647 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.647 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.647 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.647 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.647 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.647 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.647 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.647 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.647 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.647 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.647 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.647 13:38:23 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:43.647 13:38:23 -- setup/hugepages.sh@89 -- # local node 00:04:43.647 13:38:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:43.647 13:38:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:43.647 13:38:23 -- setup/hugepages.sh@92 -- # local surp 00:04:43.647 13:38:23 -- setup/hugepages.sh@93 -- # local resv 00:04:43.647 13:38:23 -- setup/hugepages.sh@94 -- # local anon 00:04:43.647 13:38:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:43.647 13:38:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:43.647 13:38:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:43.647 13:38:23 -- setup/common.sh@18 -- # local node= 00:04:43.647 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.647 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.647 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.647 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.647 13:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.647 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.647 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42652260 kB' 'MemAvailable: 46427376 kB' 'Buffers: 2708 kB' 'Cached: 13238860 kB' 'SwapCached: 0 kB' 'Active: 9950632 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549344 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476804 kB' 'Mapped: 165272 kB' 'Shmem: 9075800 kB' 'KReclaimable: 205852 kB' 'Slab: 745380 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539528 kB' 'KernelStack: 12816 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.647 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.647 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.648 13:38:23 -- setup/common.sh@33 -- # echo 0 00:04:43.648 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.648 13:38:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:43.648 13:38:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:43.648 13:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.648 13:38:23 -- setup/common.sh@18 -- # local node= 00:04:43.648 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.648 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.648 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.648 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.648 13:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.648 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.648 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42666192 kB' 'MemAvailable: 46441308 kB' 'Buffers: 2708 kB' 'Cached: 13238860 kB' 'SwapCached: 0 kB' 'Active: 9950892 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549604 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477000 kB' 'Mapped: 165236 kB' 'Shmem: 9075800 kB' 'KReclaimable: 205852 kB' 'Slab: 745372 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539520 kB' 'KernelStack: 12816 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612604 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.648 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.648 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.649 13:38:23 -- setup/common.sh@33 -- # echo 0 00:04:43.649 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.649 13:38:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:43.649 13:38:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:43.649 13:38:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:43.649 13:38:23 -- setup/common.sh@18 -- # local node= 00:04:43.649 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.649 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.649 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.649 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.649 13:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.649 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.649 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.649 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42667448 kB' 'MemAvailable: 46442564 kB' 'Buffers: 2708 kB' 'Cached: 13238868 kB' 'SwapCached: 0 kB' 'Active: 9950936 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549648 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477044 kB' 'Mapped: 165236 kB' 'Shmem: 9075808 kB' 'KReclaimable: 205852 kB' 'Slab: 745340 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539488 kB' 'KernelStack: 12800 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.649 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.649 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.650 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.650 13:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.651 13:38:23 -- setup/common.sh@33 -- # echo 0 00:04:43.651 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.651 13:38:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:43.651 13:38:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:43.651 nr_hugepages=1024 00:04:43.651 13:38:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:43.651 resv_hugepages=0 00:04:43.651 13:38:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:43.651 surplus_hugepages=0 00:04:43.651 13:38:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:43.651 anon_hugepages=0 00:04:43.651 13:38:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.651 13:38:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:43.651 13:38:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:43.651 13:38:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:43.651 13:38:23 -- setup/common.sh@18 -- # local node= 00:04:43.651 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.651 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.651 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.651 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.651 13:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.651 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.651 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42668764 kB' 'MemAvailable: 46443880 kB' 'Buffers: 2708 kB' 'Cached: 13238900 kB' 'SwapCached: 0 kB' 'Active: 9950808 kB' 'Inactive: 3764480 kB' 'Active(anon): 9549520 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476892 kB' 'Mapped: 165236 kB' 'Shmem: 9075840 kB' 'KReclaimable: 205852 kB' 'Slab: 745376 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539524 kB' 'KernelStack: 12800 kB' 'PageTables: 7860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10612636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.651 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.651 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.652 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.652 13:38:23 -- setup/common.sh@33 -- # echo 1024 00:04:43.652 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.652 13:38:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.652 13:38:23 -- setup/hugepages.sh@112 -- # get_nodes 00:04:43.652 13:38:23 -- setup/hugepages.sh@27 -- # local node 00:04:43.652 13:38:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.652 13:38:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.652 13:38:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.652 13:38:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.652 13:38:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:43.652 13:38:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:43.652 13:38:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.652 13:38:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.652 13:38:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:43.652 13:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.652 13:38:23 -- setup/common.sh@18 -- # local node=0 00:04:43.652 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.652 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.652 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.652 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:43.652 13:38:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:43.652 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.652 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.652 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27298428 kB' 'MemUsed: 5527428 kB' 'SwapCached: 0 kB' 'Active: 3240960 kB' 'Inactive: 159256 kB' 'Active(anon): 3098460 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252712 kB' 'Mapped: 65208 kB' 'AnonPages: 150700 kB' 'Shmem: 2950956 kB' 'KernelStack: 7064 kB' 'PageTables: 3676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377552 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.653 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.653 13:38:23 -- setup/common.sh@33 -- # echo 0 00:04:43.653 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.653 13:38:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.653 13:38:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.653 13:38:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.653 13:38:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:43.653 13:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.653 13:38:23 -- setup/common.sh@18 -- # local node=1 00:04:43.653 13:38:23 -- setup/common.sh@19 -- # local var val 00:04:43.653 13:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.653 13:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.653 13:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:43.653 13:38:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:43.653 13:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.653 13:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.653 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 15369700 kB' 'MemUsed: 12340108 kB' 'SwapCached: 0 kB' 'Active: 6709848 kB' 'Inactive: 3605224 kB' 'Active(anon): 6451060 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3605224 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9988900 kB' 'Mapped: 100028 kB' 'AnonPages: 326184 kB' 'Shmem: 6124888 kB' 'KernelStack: 5736 kB' 'PageTables: 4184 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 135784 kB' 'Slab: 367824 kB' 'SReclaimable: 135784 kB' 'SUnreclaim: 232040 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # continue 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.654 13:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.654 13:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.654 13:38:23 -- setup/common.sh@33 -- # echo 0 00:04:43.654 13:38:23 -- setup/common.sh@33 -- # return 0 00:04:43.654 13:38:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.654 13:38:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.654 13:38:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.654 13:38:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.654 13:38:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:43.655 node0=512 expecting 512 00:04:43.655 13:38:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.655 13:38:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.655 13:38:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.655 13:38:23 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:43.655 node1=512 expecting 512 00:04:43.655 13:38:23 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:43.655 00:04:43.655 real 0m1.519s 00:04:43.655 user 0m0.619s 00:04:43.655 sys 0m0.866s 00:04:43.655 13:38:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.655 13:38:23 -- common/autotest_common.sh@10 -- # set +x 00:04:43.655 ************************************ 00:04:43.655 END TEST even_2G_alloc 00:04:43.655 ************************************ 00:04:43.655 13:38:23 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:43.655 13:38:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.655 13:38:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.655 13:38:23 -- common/autotest_common.sh@10 -- # set +x 00:04:43.655 ************************************ 00:04:43.655 START TEST odd_alloc 00:04:43.655 ************************************ 00:04:43.655 13:38:23 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:43.655 13:38:23 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:43.655 13:38:23 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:43.655 13:38:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:43.655 13:38:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:43.655 13:38:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:43.655 13:38:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:43.655 13:38:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:43.655 13:38:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:43.655 13:38:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:43.655 13:38:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:43.655 13:38:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:43.655 13:38:23 -- setup/hugepages.sh@83 -- # : 513 00:04:43.655 13:38:23 -- setup/hugepages.sh@84 -- # : 1 00:04:43.655 13:38:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:43.655 13:38:23 -- setup/hugepages.sh@83 -- # : 0 00:04:43.655 13:38:23 -- setup/hugepages.sh@84 -- # : 0 00:04:43.655 13:38:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.655 13:38:23 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:43.655 13:38:23 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:43.655 13:38:23 -- setup/hugepages.sh@160 -- # setup output 00:04:43.655 13:38:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.655 13:38:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:45.031 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.031 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:45.031 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.031 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.031 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.031 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.031 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.031 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.031 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.031 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.031 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.031 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.031 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.031 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.031 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.031 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.031 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.031 13:38:25 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:45.031 13:38:25 -- setup/hugepages.sh@89 -- # local node 00:04:45.031 13:38:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:45.031 13:38:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:45.031 13:38:25 -- setup/hugepages.sh@92 -- # local surp 00:04:45.031 13:38:25 -- setup/hugepages.sh@93 -- # local resv 00:04:45.031 13:38:25 -- setup/hugepages.sh@94 -- # local anon 00:04:45.031 13:38:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:45.031 13:38:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:45.031 13:38:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:45.031 13:38:25 -- setup/common.sh@18 -- # local node= 00:04:45.031 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.031 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.031 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.031 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.031 13:38:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.031 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.031 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.031 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42664736 kB' 'MemAvailable: 46439836 kB' 'Buffers: 2708 kB' 'Cached: 13238952 kB' 'SwapCached: 0 kB' 'Active: 9949024 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547736 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475136 kB' 'Mapped: 164240 kB' 'Shmem: 9075892 kB' 'KReclaimable: 205820 kB' 'Slab: 745120 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539300 kB' 'KernelStack: 12720 kB' 'PageTables: 7272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10597476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.032 13:38:25 -- setup/common.sh@33 -- # echo 0 00:04:45.032 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.032 13:38:25 -- setup/hugepages.sh@97 -- # anon=0 00:04:45.032 13:38:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:45.032 13:38:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.032 13:38:25 -- setup/common.sh@18 -- # local node= 00:04:45.032 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.032 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.032 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.032 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.032 13:38:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.032 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.032 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42671188 kB' 'MemAvailable: 46446288 kB' 'Buffers: 2708 kB' 'Cached: 13238952 kB' 'SwapCached: 0 kB' 'Active: 9948796 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547508 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474848 kB' 'Mapped: 164240 kB' 'Shmem: 9075892 kB' 'KReclaimable: 205820 kB' 'Slab: 745112 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539292 kB' 'KernelStack: 12672 kB' 'PageTables: 7100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10597484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.032 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.032 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.033 13:38:25 -- setup/common.sh@33 -- # echo 0 00:04:45.033 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.033 13:38:25 -- setup/hugepages.sh@99 -- # surp=0 00:04:45.033 13:38:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:45.033 13:38:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:45.033 13:38:25 -- setup/common.sh@18 -- # local node= 00:04:45.033 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.033 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.033 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.033 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.033 13:38:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.033 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.033 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42671784 kB' 'MemAvailable: 46446884 kB' 'Buffers: 2708 kB' 'Cached: 13238956 kB' 'SwapCached: 0 kB' 'Active: 9948604 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547316 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474652 kB' 'Mapped: 164240 kB' 'Shmem: 9075896 kB' 'KReclaimable: 205820 kB' 'Slab: 745112 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539292 kB' 'KernelStack: 12640 kB' 'PageTables: 7004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10597500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.033 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.033 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.034 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.034 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.034 13:38:25 -- setup/common.sh@33 -- # echo 0 00:04:45.034 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.034 13:38:25 -- setup/hugepages.sh@100 -- # resv=0 00:04:45.034 13:38:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:45.034 nr_hugepages=1025 00:04:45.034 13:38:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:45.034 resv_hugepages=0 00:04:45.034 13:38:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:45.034 surplus_hugepages=0 00:04:45.034 13:38:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:45.034 anon_hugepages=0 00:04:45.034 13:38:25 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:45.034 13:38:25 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:45.034 13:38:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:45.294 13:38:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:45.294 13:38:25 -- setup/common.sh@18 -- # local node= 00:04:45.294 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.294 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.294 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.294 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.294 13:38:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.294 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.295 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42671764 kB' 'MemAvailable: 46446864 kB' 'Buffers: 2708 kB' 'Cached: 13238984 kB' 'SwapCached: 0 kB' 'Active: 9948124 kB' 'Inactive: 3764480 kB' 'Active(anon): 9546836 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474100 kB' 'Mapped: 164224 kB' 'Shmem: 9075924 kB' 'KReclaimable: 205820 kB' 'Slab: 745232 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539412 kB' 'KernelStack: 12736 kB' 'PageTables: 7548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10597516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.295 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.295 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.296 13:38:25 -- setup/common.sh@33 -- # echo 1025 00:04:45.296 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.296 13:38:25 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:45.296 13:38:25 -- setup/hugepages.sh@112 -- # get_nodes 00:04:45.296 13:38:25 -- setup/hugepages.sh@27 -- # local node 00:04:45.296 13:38:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.296 13:38:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:45.296 13:38:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.296 13:38:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:45.296 13:38:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.296 13:38:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.296 13:38:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.296 13:38:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.296 13:38:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:45.296 13:38:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.296 13:38:25 -- setup/common.sh@18 -- # local node=0 00:04:45.296 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.296 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.296 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.296 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:45.296 13:38:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:45.296 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.296 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27308320 kB' 'MemUsed: 5517536 kB' 'SwapCached: 0 kB' 'Active: 3239792 kB' 'Inactive: 159256 kB' 'Active(anon): 3097292 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252804 kB' 'Mapped: 64816 kB' 'AnonPages: 149416 kB' 'Shmem: 2951048 kB' 'KernelStack: 7048 kB' 'PageTables: 3608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377464 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307396 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.296 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.296 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@33 -- # echo 0 00:04:45.297 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.297 13:38:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.297 13:38:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.297 13:38:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.297 13:38:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:45.297 13:38:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.297 13:38:25 -- setup/common.sh@18 -- # local node=1 00:04:45.297 13:38:25 -- setup/common.sh@19 -- # local var val 00:04:45.297 13:38:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.297 13:38:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.297 13:38:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:45.297 13:38:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:45.297 13:38:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.297 13:38:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 15367372 kB' 'MemUsed: 12342436 kB' 'SwapCached: 0 kB' 'Active: 6708364 kB' 'Inactive: 3605224 kB' 'Active(anon): 6449576 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3605224 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9988900 kB' 'Mapped: 99408 kB' 'AnonPages: 324688 kB' 'Shmem: 6124888 kB' 'KernelStack: 5688 kB' 'PageTables: 3940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 135752 kB' 'Slab: 367768 kB' 'SReclaimable: 135752 kB' 'SUnreclaim: 232016 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.297 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.297 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # continue 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.298 13:38:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.298 13:38:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.298 13:38:25 -- setup/common.sh@33 -- # echo 0 00:04:45.298 13:38:25 -- setup/common.sh@33 -- # return 0 00:04:45.298 13:38:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.298 13:38:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.298 13:38:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.298 13:38:25 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:45.298 node0=512 expecting 513 00:04:45.298 13:38:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.298 13:38:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.298 13:38:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.298 13:38:25 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:45.298 node1=513 expecting 512 00:04:45.298 13:38:25 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:45.298 00:04:45.298 real 0m1.499s 00:04:45.298 user 0m0.634s 00:04:45.298 sys 0m0.832s 00:04:45.298 13:38:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.298 13:38:25 -- common/autotest_common.sh@10 -- # set +x 00:04:45.298 ************************************ 00:04:45.298 END TEST odd_alloc 00:04:45.298 ************************************ 00:04:45.298 13:38:25 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:45.298 13:38:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.298 13:38:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.298 13:38:25 -- common/autotest_common.sh@10 -- # set +x 00:04:45.298 ************************************ 00:04:45.298 START TEST custom_alloc 00:04:45.298 ************************************ 00:04:45.298 13:38:25 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:45.298 13:38:25 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:45.298 13:38:25 -- setup/hugepages.sh@169 -- # local node 00:04:45.298 13:38:25 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:45.298 13:38:25 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:45.298 13:38:25 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:45.298 13:38:25 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:45.298 13:38:25 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:45.298 13:38:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.298 13:38:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:45.298 13:38:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.298 13:38:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.298 13:38:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:45.298 13:38:25 -- setup/hugepages.sh@83 -- # : 256 00:04:45.298 13:38:25 -- setup/hugepages.sh@84 -- # : 1 00:04:45.298 13:38:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:45.298 13:38:25 -- setup/hugepages.sh@83 -- # : 0 00:04:45.298 13:38:25 -- setup/hugepages.sh@84 -- # : 0 00:04:45.298 13:38:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:45.298 13:38:25 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:45.298 13:38:25 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:45.298 13:38:25 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:45.298 13:38:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.298 13:38:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.298 13:38:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.298 13:38:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.298 13:38:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.298 13:38:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:45.298 13:38:25 -- setup/hugepages.sh@78 -- # return 0 00:04:45.298 13:38:25 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:45.298 13:38:25 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:45.298 13:38:25 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:45.298 13:38:25 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:45.298 13:38:25 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:45.298 13:38:25 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:45.298 13:38:25 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.298 13:38:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.298 13:38:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.299 13:38:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.299 13:38:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.299 13:38:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.299 13:38:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.299 13:38:25 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:45.299 13:38:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.299 13:38:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:45.299 13:38:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.299 13:38:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:45.299 13:38:25 -- setup/hugepages.sh@78 -- # return 0 00:04:45.299 13:38:25 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:45.299 13:38:25 -- setup/hugepages.sh@187 -- # setup output 00:04:45.299 13:38:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.299 13:38:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.676 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.676 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:46.676 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.676 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.676 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.676 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.676 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.676 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.676 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.676 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.676 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.676 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.676 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.676 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.676 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.676 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.676 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.676 13:38:26 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:46.676 13:38:26 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:46.676 13:38:26 -- setup/hugepages.sh@89 -- # local node 00:04:46.676 13:38:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:46.676 13:38:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:46.676 13:38:26 -- setup/hugepages.sh@92 -- # local surp 00:04:46.676 13:38:26 -- setup/hugepages.sh@93 -- # local resv 00:04:46.676 13:38:26 -- setup/hugepages.sh@94 -- # local anon 00:04:46.676 13:38:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:46.676 13:38:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:46.676 13:38:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:46.676 13:38:26 -- setup/common.sh@18 -- # local node= 00:04:46.676 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.676 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.676 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.676 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.676 13:38:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.676 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.676 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41639352 kB' 'MemAvailable: 45414452 kB' 'Buffers: 2708 kB' 'Cached: 13239056 kB' 'SwapCached: 0 kB' 'Active: 9949148 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547860 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475064 kB' 'Mapped: 164256 kB' 'Shmem: 9075996 kB' 'KReclaimable: 205820 kB' 'Slab: 745284 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539464 kB' 'KernelStack: 12720 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10597708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.676 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.676 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.677 13:38:26 -- setup/common.sh@33 -- # echo 0 00:04:46.677 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.677 13:38:26 -- setup/hugepages.sh@97 -- # anon=0 00:04:46.677 13:38:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:46.677 13:38:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.677 13:38:26 -- setup/common.sh@18 -- # local node= 00:04:46.677 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.677 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.677 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.677 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.677 13:38:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.677 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.677 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41640844 kB' 'MemAvailable: 45415944 kB' 'Buffers: 2708 kB' 'Cached: 13239060 kB' 'SwapCached: 0 kB' 'Active: 9949448 kB' 'Inactive: 3764480 kB' 'Active(anon): 9548160 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475416 kB' 'Mapped: 164256 kB' 'Shmem: 9076000 kB' 'KReclaimable: 205820 kB' 'Slab: 745284 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539464 kB' 'KernelStack: 12720 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10597720 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.677 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.677 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.678 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.678 13:38:26 -- setup/common.sh@33 -- # echo 0 00:04:46.678 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.678 13:38:26 -- setup/hugepages.sh@99 -- # surp=0 00:04:46.678 13:38:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:46.678 13:38:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:46.678 13:38:26 -- setup/common.sh@18 -- # local node= 00:04:46.678 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.678 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.678 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.678 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.678 13:38:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.678 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.678 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.678 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41640252 kB' 'MemAvailable: 45415352 kB' 'Buffers: 2708 kB' 'Cached: 13239064 kB' 'SwapCached: 0 kB' 'Active: 9948008 kB' 'Inactive: 3764480 kB' 'Active(anon): 9546720 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473972 kB' 'Mapped: 164184 kB' 'Shmem: 9076004 kB' 'KReclaimable: 205820 kB' 'Slab: 745216 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539396 kB' 'KernelStack: 12720 kB' 'PageTables: 7540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10597736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.679 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.679 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.680 13:38:26 -- setup/common.sh@33 -- # echo 0 00:04:46.680 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.680 13:38:26 -- setup/hugepages.sh@100 -- # resv=0 00:04:46.680 13:38:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:46.680 nr_hugepages=1536 00:04:46.680 13:38:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:46.680 resv_hugepages=0 00:04:46.680 13:38:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:46.680 surplus_hugepages=0 00:04:46.680 13:38:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:46.680 anon_hugepages=0 00:04:46.680 13:38:26 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:46.680 13:38:26 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:46.680 13:38:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:46.680 13:38:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:46.680 13:38:26 -- setup/common.sh@18 -- # local node= 00:04:46.680 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.680 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.680 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.680 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.680 13:38:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.680 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.680 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41640688 kB' 'MemAvailable: 45415788 kB' 'Buffers: 2708 kB' 'Cached: 13239088 kB' 'SwapCached: 0 kB' 'Active: 9948388 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547100 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474280 kB' 'Mapped: 164184 kB' 'Shmem: 9076028 kB' 'KReclaimable: 205820 kB' 'Slab: 745216 kB' 'SReclaimable: 205820 kB' 'SUnreclaim: 539396 kB' 'KernelStack: 12720 kB' 'PageTables: 7540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10597752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.680 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.680 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.681 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.681 13:38:26 -- setup/common.sh@33 -- # echo 1536 00:04:46.681 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.681 13:38:26 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:46.681 13:38:26 -- setup/hugepages.sh@112 -- # get_nodes 00:04:46.681 13:38:26 -- setup/hugepages.sh@27 -- # local node 00:04:46.681 13:38:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.681 13:38:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:46.681 13:38:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.681 13:38:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:46.681 13:38:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:46.681 13:38:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:46.681 13:38:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.681 13:38:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.681 13:38:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:46.681 13:38:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.681 13:38:26 -- setup/common.sh@18 -- # local node=0 00:04:46.681 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.681 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.681 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.681 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:46.681 13:38:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:46.681 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.681 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.681 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27323756 kB' 'MemUsed: 5502100 kB' 'SwapCached: 0 kB' 'Active: 3240040 kB' 'Inactive: 159256 kB' 'Active(anon): 3097540 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252908 kB' 'Mapped: 64820 kB' 'AnonPages: 149596 kB' 'Shmem: 2951152 kB' 'KernelStack: 7016 kB' 'PageTables: 3600 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377468 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307400 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.682 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.682 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.682 13:38:26 -- setup/common.sh@33 -- # echo 0 00:04:46.682 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.682 13:38:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.682 13:38:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.682 13:38:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.682 13:38:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:46.683 13:38:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.683 13:38:26 -- setup/common.sh@18 -- # local node=1 00:04:46.683 13:38:26 -- setup/common.sh@19 -- # local var val 00:04:46.683 13:38:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.683 13:38:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.683 13:38:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:46.683 13:38:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:46.683 13:38:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.683 13:38:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 14316796 kB' 'MemUsed: 13393012 kB' 'SwapCached: 0 kB' 'Active: 6708352 kB' 'Inactive: 3605224 kB' 'Active(anon): 6449564 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3605224 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9988900 kB' 'Mapped: 99364 kB' 'AnonPages: 324676 kB' 'Shmem: 6124888 kB' 'KernelStack: 5704 kB' 'PageTables: 3940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 135752 kB' 'Slab: 367748 kB' 'SReclaimable: 135752 kB' 'SUnreclaim: 231996 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.683 13:38:26 -- setup/common.sh@32 -- # continue 00:04:46.683 13:38:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.684 13:38:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.684 13:38:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.684 13:38:26 -- setup/common.sh@33 -- # echo 0 00:04:46.684 13:38:26 -- setup/common.sh@33 -- # return 0 00:04:46.684 13:38:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.684 13:38:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.684 13:38:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.684 13:38:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.684 13:38:26 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:46.684 node0=512 expecting 512 00:04:46.684 13:38:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.684 13:38:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.684 13:38:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.684 13:38:26 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:46.684 node1=1024 expecting 1024 00:04:46.684 13:38:26 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:46.684 00:04:46.684 real 0m1.473s 00:04:46.684 user 0m0.619s 00:04:46.684 sys 0m0.818s 00:04:46.684 13:38:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.684 13:38:26 -- common/autotest_common.sh@10 -- # set +x 00:04:46.684 ************************************ 00:04:46.684 END TEST custom_alloc 00:04:46.684 ************************************ 00:04:46.684 13:38:26 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:46.684 13:38:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.684 13:38:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.684 13:38:26 -- common/autotest_common.sh@10 -- # set +x 00:04:46.684 ************************************ 00:04:46.684 START TEST no_shrink_alloc 00:04:46.684 ************************************ 00:04:46.684 13:38:26 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:46.684 13:38:26 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:46.684 13:38:26 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:46.684 13:38:26 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:46.684 13:38:26 -- setup/hugepages.sh@51 -- # shift 00:04:46.684 13:38:26 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:46.684 13:38:26 -- setup/hugepages.sh@52 -- # local node_ids 00:04:46.684 13:38:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:46.684 13:38:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:46.684 13:38:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:46.684 13:38:26 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:46.684 13:38:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.684 13:38:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:46.684 13:38:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.684 13:38:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.684 13:38:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.684 13:38:26 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:46.684 13:38:26 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:46.684 13:38:26 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:46.684 13:38:26 -- setup/hugepages.sh@73 -- # return 0 00:04:46.684 13:38:26 -- setup/hugepages.sh@198 -- # setup output 00:04:46.684 13:38:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.684 13:38:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:48.062 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.063 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.063 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.063 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.063 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.063 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.063 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.063 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.063 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.063 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.063 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.063 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.063 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.063 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.063 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.063 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.063 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.063 13:38:28 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:48.063 13:38:28 -- setup/hugepages.sh@89 -- # local node 00:04:48.063 13:38:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.063 13:38:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.063 13:38:28 -- setup/hugepages.sh@92 -- # local surp 00:04:48.063 13:38:28 -- setup/hugepages.sh@93 -- # local resv 00:04:48.063 13:38:28 -- setup/hugepages.sh@94 -- # local anon 00:04:48.063 13:38:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.063 13:38:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.063 13:38:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.063 13:38:28 -- setup/common.sh@18 -- # local node= 00:04:48.063 13:38:28 -- setup/common.sh@19 -- # local var val 00:04:48.063 13:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.063 13:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.063 13:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.063 13:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.063 13:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.063 13:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42696476 kB' 'MemAvailable: 46471592 kB' 'Buffers: 2708 kB' 'Cached: 13239292 kB' 'SwapCached: 0 kB' 'Active: 9948700 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547412 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474420 kB' 'Mapped: 164628 kB' 'Shmem: 9076232 kB' 'KReclaimable: 205852 kB' 'Slab: 745188 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539336 kB' 'KernelStack: 12704 kB' 'PageTables: 7488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10597948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.063 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.063 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.064 13:38:28 -- setup/common.sh@33 -- # echo 0 00:04:48.064 13:38:28 -- setup/common.sh@33 -- # return 0 00:04:48.064 13:38:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.064 13:38:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.064 13:38:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.064 13:38:28 -- setup/common.sh@18 -- # local node= 00:04:48.064 13:38:28 -- setup/common.sh@19 -- # local var val 00:04:48.064 13:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.064 13:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.064 13:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.064 13:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.064 13:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.064 13:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42701504 kB' 'MemAvailable: 46476620 kB' 'Buffers: 2708 kB' 'Cached: 13239296 kB' 'SwapCached: 0 kB' 'Active: 9949040 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547752 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474756 kB' 'Mapped: 164216 kB' 'Shmem: 9076236 kB' 'KReclaimable: 205852 kB' 'Slab: 745160 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539308 kB' 'KernelStack: 12672 kB' 'PageTables: 7352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10597956 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.064 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.064 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.065 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 13:38:28 -- setup/common.sh@33 -- # echo 0 00:04:48.066 13:38:28 -- setup/common.sh@33 -- # return 0 00:04:48.066 13:38:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.066 13:38:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.066 13:38:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.066 13:38:28 -- setup/common.sh@18 -- # local node= 00:04:48.066 13:38:28 -- setup/common.sh@19 -- # local var val 00:04:48.066 13:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.066 13:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.066 13:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.066 13:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.066 13:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.066 13:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42701312 kB' 'MemAvailable: 46476428 kB' 'Buffers: 2708 kB' 'Cached: 13239308 kB' 'SwapCached: 0 kB' 'Active: 9948652 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547364 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474376 kB' 'Mapped: 164196 kB' 'Shmem: 9076248 kB' 'KReclaimable: 205852 kB' 'Slab: 745228 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539376 kB' 'KernelStack: 12736 kB' 'PageTables: 7544 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10597972 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.066 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.067 13:38:28 -- setup/common.sh@33 -- # echo 0 00:04:48.067 13:38:28 -- setup/common.sh@33 -- # return 0 00:04:48.067 13:38:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.067 13:38:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:48.067 nr_hugepages=1024 00:04:48.067 13:38:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.067 resv_hugepages=0 00:04:48.067 13:38:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.067 surplus_hugepages=0 00:04:48.067 13:38:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.067 anon_hugepages=0 00:04:48.067 13:38:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.067 13:38:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:48.067 13:38:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.067 13:38:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.067 13:38:28 -- setup/common.sh@18 -- # local node= 00:04:48.067 13:38:28 -- setup/common.sh@19 -- # local var val 00:04:48.067 13:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.067 13:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.067 13:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.067 13:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.067 13:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.067 13:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42701312 kB' 'MemAvailable: 46476428 kB' 'Buffers: 2708 kB' 'Cached: 13239324 kB' 'SwapCached: 0 kB' 'Active: 9948652 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547364 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474380 kB' 'Mapped: 164196 kB' 'Shmem: 9076264 kB' 'KReclaimable: 205852 kB' 'Slab: 745228 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539376 kB' 'KernelStack: 12736 kB' 'PageTables: 7544 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10597988 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.067 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.067 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.068 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.068 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 13:38:28 -- setup/common.sh@33 -- # echo 1024 00:04:48.069 13:38:28 -- setup/common.sh@33 -- # return 0 00:04:48.069 13:38:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.069 13:38:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.069 13:38:28 -- setup/hugepages.sh@27 -- # local node 00:04:48.069 13:38:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.069 13:38:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:48.069 13:38:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.069 13:38:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:48.069 13:38:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.069 13:38:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.069 13:38:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.069 13:38:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.069 13:38:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.069 13:38:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.069 13:38:28 -- setup/common.sh@18 -- # local node=0 00:04:48.069 13:38:28 -- setup/common.sh@19 -- # local var val 00:04:48.069 13:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.069 13:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.069 13:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.069 13:38:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.069 13:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.069 13:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26286640 kB' 'MemUsed: 6539216 kB' 'SwapCached: 0 kB' 'Active: 3238900 kB' 'Inactive: 159256 kB' 'Active(anon): 3096400 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252940 kB' 'Mapped: 64828 kB' 'AnonPages: 148312 kB' 'Shmem: 2951184 kB' 'KernelStack: 6984 kB' 'PageTables: 3412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377428 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307360 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.069 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.070 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # continue 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.328 13:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.328 13:38:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.328 13:38:28 -- setup/common.sh@33 -- # echo 0 00:04:48.328 13:38:28 -- setup/common.sh@33 -- # return 0 00:04:48.328 13:38:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.328 13:38:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.328 13:38:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.328 13:38:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.328 13:38:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:48.328 node0=1024 expecting 1024 00:04:48.328 13:38:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:48.328 13:38:28 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:48.328 13:38:28 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:48.328 13:38:28 -- setup/hugepages.sh@202 -- # setup output 00:04:48.328 13:38:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.328 13:38:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:49.708 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.708 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:49.708 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.708 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.708 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.708 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.708 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.708 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.708 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.708 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.708 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.708 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.708 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.708 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.708 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.708 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.708 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.708 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:49.708 13:38:29 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:49.708 13:38:29 -- setup/hugepages.sh@89 -- # local node 00:04:49.708 13:38:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:49.708 13:38:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:49.708 13:38:29 -- setup/hugepages.sh@92 -- # local surp 00:04:49.708 13:38:29 -- setup/hugepages.sh@93 -- # local resv 00:04:49.708 13:38:29 -- setup/hugepages.sh@94 -- # local anon 00:04:49.708 13:38:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:49.708 13:38:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:49.708 13:38:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:49.708 13:38:29 -- setup/common.sh@18 -- # local node= 00:04:49.708 13:38:29 -- setup/common.sh@19 -- # local var val 00:04:49.708 13:38:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.708 13:38:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.708 13:38:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.708 13:38:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.708 13:38:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.708 13:38:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.708 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.708 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42676980 kB' 'MemAvailable: 46452096 kB' 'Buffers: 2708 kB' 'Cached: 13239372 kB' 'SwapCached: 0 kB' 'Active: 9948456 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547168 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474096 kB' 'Mapped: 164196 kB' 'Shmem: 9076312 kB' 'KReclaimable: 205852 kB' 'Slab: 745028 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539176 kB' 'KernelStack: 12704 kB' 'PageTables: 7468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10598160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.709 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.709 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.710 13:38:29 -- setup/common.sh@33 -- # echo 0 00:04:49.710 13:38:29 -- setup/common.sh@33 -- # return 0 00:04:49.710 13:38:29 -- setup/hugepages.sh@97 -- # anon=0 00:04:49.710 13:38:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:49.710 13:38:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.710 13:38:29 -- setup/common.sh@18 -- # local node= 00:04:49.710 13:38:29 -- setup/common.sh@19 -- # local var val 00:04:49.710 13:38:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.710 13:38:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.710 13:38:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.710 13:38:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.710 13:38:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.710 13:38:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42678720 kB' 'MemAvailable: 46453836 kB' 'Buffers: 2708 kB' 'Cached: 13239376 kB' 'SwapCached: 0 kB' 'Active: 9948776 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547488 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474440 kB' 'Mapped: 164196 kB' 'Shmem: 9076316 kB' 'KReclaimable: 205852 kB' 'Slab: 745020 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539168 kB' 'KernelStack: 12688 kB' 'PageTables: 7404 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10598172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.710 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.710 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.711 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.711 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.712 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.712 13:38:29 -- setup/common.sh@33 -- # echo 0 00:04:49.712 13:38:29 -- setup/common.sh@33 -- # return 0 00:04:49.712 13:38:29 -- setup/hugepages.sh@99 -- # surp=0 00:04:49.712 13:38:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:49.712 13:38:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:49.712 13:38:29 -- setup/common.sh@18 -- # local node= 00:04:49.712 13:38:29 -- setup/common.sh@19 -- # local var val 00:04:49.712 13:38:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.712 13:38:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.712 13:38:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.712 13:38:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.712 13:38:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.712 13:38:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.712 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42680400 kB' 'MemAvailable: 46455516 kB' 'Buffers: 2708 kB' 'Cached: 13239388 kB' 'SwapCached: 0 kB' 'Active: 9948744 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547456 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474404 kB' 'Mapped: 164196 kB' 'Shmem: 9076328 kB' 'KReclaimable: 205852 kB' 'Slab: 745068 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539216 kB' 'KernelStack: 12720 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10598184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.713 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.713 13:38:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.714 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.714 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.715 13:38:29 -- setup/common.sh@33 -- # echo 0 00:04:49.715 13:38:29 -- setup/common.sh@33 -- # return 0 00:04:49.715 13:38:29 -- setup/hugepages.sh@100 -- # resv=0 00:04:49.715 13:38:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:49.715 nr_hugepages=1024 00:04:49.715 13:38:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:49.715 resv_hugepages=0 00:04:49.715 13:38:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:49.715 surplus_hugepages=0 00:04:49.715 13:38:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:49.715 anon_hugepages=0 00:04:49.715 13:38:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.715 13:38:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:49.715 13:38:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:49.715 13:38:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:49.715 13:38:29 -- setup/common.sh@18 -- # local node= 00:04:49.715 13:38:29 -- setup/common.sh@19 -- # local var val 00:04:49.715 13:38:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.715 13:38:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.715 13:38:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.715 13:38:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.715 13:38:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.715 13:38:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42680072 kB' 'MemAvailable: 46455188 kB' 'Buffers: 2708 kB' 'Cached: 13239404 kB' 'SwapCached: 0 kB' 'Active: 9949092 kB' 'Inactive: 3764480 kB' 'Active(anon): 9547804 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474692 kB' 'Mapped: 164196 kB' 'Shmem: 9076344 kB' 'KReclaimable: 205852 kB' 'Slab: 745068 kB' 'SReclaimable: 205852 kB' 'SUnreclaim: 539216 kB' 'KernelStack: 12784 kB' 'PageTables: 7676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10597832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2008668 kB' 'DirectMap2M: 15736832 kB' 'DirectMap1G: 52428800 kB' 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.715 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.715 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.716 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.716 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.717 13:38:29 -- setup/common.sh@33 -- # echo 1024 00:04:49.717 13:38:29 -- setup/common.sh@33 -- # return 0 00:04:49.717 13:38:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.717 13:38:29 -- setup/hugepages.sh@112 -- # get_nodes 00:04:49.717 13:38:29 -- setup/hugepages.sh@27 -- # local node 00:04:49.717 13:38:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.717 13:38:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:49.717 13:38:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.717 13:38:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:49.717 13:38:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.717 13:38:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.717 13:38:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.717 13:38:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.717 13:38:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:49.717 13:38:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.717 13:38:29 -- setup/common.sh@18 -- # local node=0 00:04:49.717 13:38:29 -- setup/common.sh@19 -- # local var val 00:04:49.717 13:38:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.717 13:38:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.717 13:38:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:49.717 13:38:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:49.717 13:38:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.717 13:38:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.717 13:38:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26275928 kB' 'MemUsed: 6549928 kB' 'SwapCached: 0 kB' 'Active: 3239548 kB' 'Inactive: 159256 kB' 'Active(anon): 3097048 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 159256 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3252956 kB' 'Mapped: 64832 kB' 'AnonPages: 149012 kB' 'Shmem: 2951200 kB' 'KernelStack: 7016 kB' 'PageTables: 3508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70068 kB' 'Slab: 377452 kB' 'SReclaimable: 70068 kB' 'SUnreclaim: 307384 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.717 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.717 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.718 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.718 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # continue 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.719 13:38:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.719 13:38:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.719 13:38:29 -- setup/common.sh@33 -- # echo 0 00:04:49.719 13:38:29 -- setup/common.sh@33 -- # return 0 00:04:49.719 13:38:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.719 13:38:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.719 13:38:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.719 13:38:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.719 13:38:29 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:49.719 node0=1024 expecting 1024 00:04:49.719 13:38:29 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:49.719 00:04:49.719 real 0m2.979s 00:04:49.719 user 0m1.189s 00:04:49.719 sys 0m1.722s 00:04:49.719 13:38:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.719 13:38:29 -- common/autotest_common.sh@10 -- # set +x 00:04:49.719 ************************************ 00:04:49.719 END TEST no_shrink_alloc 00:04:49.719 ************************************ 00:04:49.719 13:38:29 -- setup/hugepages.sh@217 -- # clear_hp 00:04:49.719 13:38:29 -- setup/hugepages.sh@37 -- # local node hp 00:04:49.719 13:38:29 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.719 13:38:29 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.719 13:38:29 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.719 13:38:29 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.719 13:38:29 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.719 13:38:29 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.719 13:38:29 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.719 13:38:29 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.719 13:38:29 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.719 13:38:29 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.719 13:38:29 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:49.719 13:38:29 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:49.719 00:04:49.719 real 0m11.773s 00:04:49.719 user 0m4.541s 00:04:49.719 sys 0m6.185s 00:04:49.719 13:38:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.719 13:38:29 -- common/autotest_common.sh@10 -- # set +x 00:04:49.719 ************************************ 00:04:49.719 END TEST hugepages 00:04:49.719 ************************************ 00:04:49.719 13:38:29 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:49.719 13:38:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.719 13:38:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.719 13:38:29 -- common/autotest_common.sh@10 -- # set +x 00:04:49.719 ************************************ 00:04:49.719 START TEST driver 00:04:49.719 ************************************ 00:04:49.719 13:38:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:49.978 * Looking for test storage... 00:04:49.978 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:49.978 13:38:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:49.978 13:38:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:49.978 13:38:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:49.978 13:38:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:49.978 13:38:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:49.978 13:38:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:49.978 13:38:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:49.978 13:38:30 -- scripts/common.sh@335 -- # IFS=.-: 00:04:49.978 13:38:30 -- scripts/common.sh@335 -- # read -ra ver1 00:04:49.978 13:38:30 -- scripts/common.sh@336 -- # IFS=.-: 00:04:49.978 13:38:30 -- scripts/common.sh@336 -- # read -ra ver2 00:04:49.978 13:38:30 -- scripts/common.sh@337 -- # local 'op=<' 00:04:49.978 13:38:30 -- scripts/common.sh@339 -- # ver1_l=2 00:04:49.978 13:38:30 -- scripts/common.sh@340 -- # ver2_l=1 00:04:49.978 13:38:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:49.978 13:38:30 -- scripts/common.sh@343 -- # case "$op" in 00:04:49.978 13:38:30 -- scripts/common.sh@344 -- # : 1 00:04:49.978 13:38:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:49.978 13:38:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:49.978 13:38:30 -- scripts/common.sh@364 -- # decimal 1 00:04:49.978 13:38:30 -- scripts/common.sh@352 -- # local d=1 00:04:49.978 13:38:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:49.978 13:38:30 -- scripts/common.sh@354 -- # echo 1 00:04:49.979 13:38:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:49.979 13:38:30 -- scripts/common.sh@365 -- # decimal 2 00:04:49.979 13:38:30 -- scripts/common.sh@352 -- # local d=2 00:04:49.979 13:38:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:49.979 13:38:30 -- scripts/common.sh@354 -- # echo 2 00:04:49.979 13:38:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:49.979 13:38:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:49.979 13:38:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:49.979 13:38:30 -- scripts/common.sh@367 -- # return 0 00:04:49.979 13:38:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:49.979 13:38:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:49.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.979 --rc genhtml_branch_coverage=1 00:04:49.979 --rc genhtml_function_coverage=1 00:04:49.979 --rc genhtml_legend=1 00:04:49.979 --rc geninfo_all_blocks=1 00:04:49.979 --rc geninfo_unexecuted_blocks=1 00:04:49.979 00:04:49.979 ' 00:04:49.979 13:38:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:49.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.979 --rc genhtml_branch_coverage=1 00:04:49.979 --rc genhtml_function_coverage=1 00:04:49.979 --rc genhtml_legend=1 00:04:49.979 --rc geninfo_all_blocks=1 00:04:49.979 --rc geninfo_unexecuted_blocks=1 00:04:49.979 00:04:49.979 ' 00:04:49.979 13:38:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:49.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.979 --rc genhtml_branch_coverage=1 00:04:49.979 --rc genhtml_function_coverage=1 00:04:49.979 --rc genhtml_legend=1 00:04:49.979 --rc geninfo_all_blocks=1 00:04:49.979 --rc geninfo_unexecuted_blocks=1 00:04:49.979 00:04:49.979 ' 00:04:49.979 13:38:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:49.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.979 --rc genhtml_branch_coverage=1 00:04:49.979 --rc genhtml_function_coverage=1 00:04:49.979 --rc genhtml_legend=1 00:04:49.979 --rc geninfo_all_blocks=1 00:04:49.979 --rc geninfo_unexecuted_blocks=1 00:04:49.979 00:04:49.979 ' 00:04:49.979 13:38:30 -- setup/driver.sh@68 -- # setup reset 00:04:49.979 13:38:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:49.979 13:38:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:52.514 13:38:32 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:52.514 13:38:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.514 13:38:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.514 13:38:32 -- common/autotest_common.sh@10 -- # set +x 00:04:52.514 ************************************ 00:04:52.514 START TEST guess_driver 00:04:52.514 ************************************ 00:04:52.514 13:38:32 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:52.514 13:38:32 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:52.514 13:38:32 -- setup/driver.sh@47 -- # local fail=0 00:04:52.514 13:38:32 -- setup/driver.sh@49 -- # pick_driver 00:04:52.514 13:38:32 -- setup/driver.sh@36 -- # vfio 00:04:52.514 13:38:32 -- setup/driver.sh@21 -- # local iommu_grups 00:04:52.514 13:38:32 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:52.514 13:38:32 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:52.514 13:38:32 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:52.514 13:38:32 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:52.514 13:38:32 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:52.514 13:38:32 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:52.514 13:38:32 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:52.514 13:38:32 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:52.514 13:38:32 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:52.514 13:38:32 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:52.514 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:52.514 13:38:32 -- setup/driver.sh@30 -- # return 0 00:04:52.514 13:38:32 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:52.514 13:38:32 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:52.514 13:38:32 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:52.514 13:38:32 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:52.514 Looking for driver=vfio-pci 00:04:52.514 13:38:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:52.514 13:38:32 -- setup/driver.sh@45 -- # setup output config 00:04:52.514 13:38:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.514 13:38:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.890 13:38:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.890 13:38:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.890 13:38:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.823 13:38:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.823 13:38:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.823 13:38:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.823 13:38:34 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:54.823 13:38:34 -- setup/driver.sh@65 -- # setup reset 00:04:54.823 13:38:34 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:54.823 13:38:34 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:57.341 00:04:57.341 real 0m4.810s 00:04:57.341 user 0m1.125s 00:04:57.341 sys 0m1.898s 00:04:57.341 13:38:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.341 13:38:37 -- common/autotest_common.sh@10 -- # set +x 00:04:57.341 ************************************ 00:04:57.341 END TEST guess_driver 00:04:57.341 ************************************ 00:04:57.341 00:04:57.341 real 0m7.520s 00:04:57.341 user 0m1.801s 00:04:57.341 sys 0m3.023s 00:04:57.341 13:38:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.341 13:38:37 -- common/autotest_common.sh@10 -- # set +x 00:04:57.341 ************************************ 00:04:57.341 END TEST driver 00:04:57.341 ************************************ 00:04:57.341 13:38:37 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:57.341 13:38:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.341 13:38:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.341 13:38:37 -- common/autotest_common.sh@10 -- # set +x 00:04:57.341 ************************************ 00:04:57.341 START TEST devices 00:04:57.341 ************************************ 00:04:57.341 13:38:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:57.341 * Looking for test storage... 00:04:57.341 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:57.341 13:38:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:57.341 13:38:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:57.341 13:38:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:57.341 13:38:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:57.341 13:38:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:57.341 13:38:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:57.341 13:38:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:57.341 13:38:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:57.341 13:38:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:57.341 13:38:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:57.341 13:38:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:57.341 13:38:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:57.341 13:38:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:57.341 13:38:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:57.341 13:38:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:57.341 13:38:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:57.341 13:38:37 -- scripts/common.sh@344 -- # : 1 00:04:57.341 13:38:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:57.341 13:38:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:57.341 13:38:37 -- scripts/common.sh@364 -- # decimal 1 00:04:57.599 13:38:37 -- scripts/common.sh@352 -- # local d=1 00:04:57.599 13:38:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:57.599 13:38:37 -- scripts/common.sh@354 -- # echo 1 00:04:57.599 13:38:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:57.599 13:38:37 -- scripts/common.sh@365 -- # decimal 2 00:04:57.599 13:38:37 -- scripts/common.sh@352 -- # local d=2 00:04:57.599 13:38:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:57.599 13:38:37 -- scripts/common.sh@354 -- # echo 2 00:04:57.599 13:38:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:57.599 13:38:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:57.599 13:38:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:57.599 13:38:37 -- scripts/common.sh@367 -- # return 0 00:04:57.599 13:38:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:57.599 13:38:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:57.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.599 --rc genhtml_branch_coverage=1 00:04:57.599 --rc genhtml_function_coverage=1 00:04:57.599 --rc genhtml_legend=1 00:04:57.599 --rc geninfo_all_blocks=1 00:04:57.599 --rc geninfo_unexecuted_blocks=1 00:04:57.599 00:04:57.599 ' 00:04:57.599 13:38:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:57.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.599 --rc genhtml_branch_coverage=1 00:04:57.599 --rc genhtml_function_coverage=1 00:04:57.599 --rc genhtml_legend=1 00:04:57.599 --rc geninfo_all_blocks=1 00:04:57.599 --rc geninfo_unexecuted_blocks=1 00:04:57.599 00:04:57.599 ' 00:04:57.599 13:38:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:57.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.599 --rc genhtml_branch_coverage=1 00:04:57.599 --rc genhtml_function_coverage=1 00:04:57.599 --rc genhtml_legend=1 00:04:57.599 --rc geninfo_all_blocks=1 00:04:57.599 --rc geninfo_unexecuted_blocks=1 00:04:57.599 00:04:57.599 ' 00:04:57.599 13:38:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:57.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.599 --rc genhtml_branch_coverage=1 00:04:57.599 --rc genhtml_function_coverage=1 00:04:57.599 --rc genhtml_legend=1 00:04:57.599 --rc geninfo_all_blocks=1 00:04:57.599 --rc geninfo_unexecuted_blocks=1 00:04:57.599 00:04:57.599 ' 00:04:57.599 13:38:37 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:57.599 13:38:37 -- setup/devices.sh@192 -- # setup reset 00:04:57.599 13:38:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:57.599 13:38:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:58.975 13:38:39 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:58.975 13:38:39 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:58.975 13:38:39 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:58.975 13:38:39 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:58.975 13:38:39 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:58.975 13:38:39 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:58.975 13:38:39 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:58.975 13:38:39 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:58.975 13:38:39 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:58.975 13:38:39 -- setup/devices.sh@196 -- # blocks=() 00:04:58.975 13:38:39 -- setup/devices.sh@196 -- # declare -a blocks 00:04:58.975 13:38:39 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:58.975 13:38:39 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:58.975 13:38:39 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:58.975 13:38:39 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:58.975 13:38:39 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:58.975 13:38:39 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:58.975 13:38:39 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:58.975 13:38:39 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:58.975 13:38:39 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:58.975 13:38:39 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:58.975 13:38:39 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:58.975 No valid GPT data, bailing 00:04:58.975 13:38:39 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:58.975 13:38:39 -- scripts/common.sh@393 -- # pt= 00:04:58.975 13:38:39 -- scripts/common.sh@394 -- # return 1 00:04:58.975 13:38:39 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:58.975 13:38:39 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:58.975 13:38:39 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:58.975 13:38:39 -- setup/common.sh@80 -- # echo 1000204886016 00:04:58.975 13:38:39 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:58.975 13:38:39 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:58.975 13:38:39 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:58.975 13:38:39 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:58.975 13:38:39 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:58.975 13:38:39 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:58.975 13:38:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.975 13:38:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.975 13:38:39 -- common/autotest_common.sh@10 -- # set +x 00:04:58.975 ************************************ 00:04:58.975 START TEST nvme_mount 00:04:58.975 ************************************ 00:04:58.975 13:38:39 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:58.975 13:38:39 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:58.975 13:38:39 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:58.975 13:38:39 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.975 13:38:39 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:58.975 13:38:39 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:58.975 13:38:39 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:58.975 13:38:39 -- setup/common.sh@40 -- # local part_no=1 00:04:58.975 13:38:39 -- setup/common.sh@41 -- # local size=1073741824 00:04:58.975 13:38:39 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:58.975 13:38:39 -- setup/common.sh@44 -- # parts=() 00:04:58.975 13:38:39 -- setup/common.sh@44 -- # local parts 00:04:58.975 13:38:39 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:58.975 13:38:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:58.975 13:38:39 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:58.975 13:38:39 -- setup/common.sh@46 -- # (( part++ )) 00:04:58.975 13:38:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:58.975 13:38:39 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:58.975 13:38:39 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:58.975 13:38:39 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:00.348 Creating new GPT entries in memory. 00:05:00.348 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:00.348 other utilities. 00:05:00.349 13:38:40 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:00.349 13:38:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:00.349 13:38:40 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:00.349 13:38:40 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:00.349 13:38:40 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:01.282 Creating new GPT entries in memory. 00:05:01.282 The operation has completed successfully. 00:05:01.282 13:38:41 -- setup/common.sh@57 -- # (( part++ )) 00:05:01.282 13:38:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:01.282 13:38:41 -- setup/common.sh@62 -- # wait 2164197 00:05:01.282 13:38:41 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.282 13:38:41 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:01.282 13:38:41 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.282 13:38:41 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:01.282 13:38:41 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:01.282 13:38:41 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.282 13:38:41 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:01.282 13:38:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:01.282 13:38:41 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:01.282 13:38:41 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.282 13:38:41 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:01.282 13:38:41 -- setup/devices.sh@53 -- # local found=0 00:05:01.282 13:38:41 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:01.282 13:38:41 -- setup/devices.sh@56 -- # : 00:05:01.282 13:38:41 -- setup/devices.sh@59 -- # local pci status 00:05:01.282 13:38:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.282 13:38:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:01.282 13:38:41 -- setup/devices.sh@47 -- # setup output config 00:05:01.282 13:38:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.282 13:38:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:02.216 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.216 13:38:42 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:02.216 13:38:42 -- setup/devices.sh@63 -- # found=1 00:05:02.216 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.217 13:38:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.217 13:38:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.475 13:38:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:02.475 13:38:42 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:02.475 13:38:42 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.475 13:38:42 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.475 13:38:42 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.475 13:38:42 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:02.475 13:38:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.475 13:38:42 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.475 13:38:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:02.475 13:38:42 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:02.475 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:02.475 13:38:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:02.475 13:38:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:02.733 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:02.733 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:02.733 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:02.733 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:02.733 13:38:42 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:02.733 13:38:42 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:02.733 13:38:42 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.733 13:38:42 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:02.733 13:38:42 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:02.734 13:38:42 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.991 13:38:43 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.991 13:38:43 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:02.991 13:38:43 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:02.991 13:38:43 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.991 13:38:43 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.991 13:38:43 -- setup/devices.sh@53 -- # local found=0 00:05:02.991 13:38:43 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.991 13:38:43 -- setup/devices.sh@56 -- # : 00:05:02.991 13:38:43 -- setup/devices.sh@59 -- # local pci status 00:05:02.991 13:38:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.991 13:38:43 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:02.991 13:38:43 -- setup/devices.sh@47 -- # setup output config 00:05:02.991 13:38:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:02.991 13:38:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:03.924 13:38:44 -- setup/devices.sh@63 -- # found=1 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.924 13:38:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.924 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.182 13:38:44 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:04.182 13:38:44 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:04.182 13:38:44 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.182 13:38:44 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:04.182 13:38:44 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:04.182 13:38:44 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.182 13:38:44 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:04.182 13:38:44 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:04.182 13:38:44 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:04.182 13:38:44 -- setup/devices.sh@50 -- # local mount_point= 00:05:04.182 13:38:44 -- setup/devices.sh@51 -- # local test_file= 00:05:04.182 13:38:44 -- setup/devices.sh@53 -- # local found=0 00:05:04.182 13:38:44 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:04.182 13:38:44 -- setup/devices.sh@59 -- # local pci status 00:05:04.182 13:38:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.182 13:38:44 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:04.182 13:38:44 -- setup/devices.sh@47 -- # setup output config 00:05:04.182 13:38:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:04.182 13:38:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:05.115 13:38:45 -- setup/devices.sh@63 -- # found=1 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.115 13:38:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.115 13:38:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.374 13:38:45 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:05.374 13:38:45 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:05.374 13:38:45 -- setup/devices.sh@68 -- # return 0 00:05:05.374 13:38:45 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:05.374 13:38:45 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.374 13:38:45 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:05.374 13:38:45 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:05.374 13:38:45 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:05.374 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:05.374 00:05:05.374 real 0m6.281s 00:05:05.374 user 0m1.398s 00:05:05.374 sys 0m2.456s 00:05:05.374 13:38:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.374 13:38:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.374 ************************************ 00:05:05.374 END TEST nvme_mount 00:05:05.374 ************************************ 00:05:05.374 13:38:45 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:05.374 13:38:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.374 13:38:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.374 13:38:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.374 ************************************ 00:05:05.374 START TEST dm_mount 00:05:05.374 ************************************ 00:05:05.374 13:38:45 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:05.374 13:38:45 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:05.374 13:38:45 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:05.374 13:38:45 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:05.374 13:38:45 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:05.374 13:38:45 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:05.374 13:38:45 -- setup/common.sh@40 -- # local part_no=2 00:05:05.374 13:38:45 -- setup/common.sh@41 -- # local size=1073741824 00:05:05.374 13:38:45 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:05.374 13:38:45 -- setup/common.sh@44 -- # parts=() 00:05:05.374 13:38:45 -- setup/common.sh@44 -- # local parts 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.374 13:38:45 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.374 13:38:45 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.374 13:38:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.374 13:38:45 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:05.374 13:38:45 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:05.374 13:38:45 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:06.308 Creating new GPT entries in memory. 00:05:06.308 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:06.308 other utilities. 00:05:06.308 13:38:46 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:06.308 13:38:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.308 13:38:46 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.308 13:38:46 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.308 13:38:46 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:07.307 Creating new GPT entries in memory. 00:05:07.307 The operation has completed successfully. 00:05:07.307 13:38:47 -- setup/common.sh@57 -- # (( part++ )) 00:05:07.307 13:38:47 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:07.307 13:38:47 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:07.307 13:38:47 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:07.307 13:38:47 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:08.681 The operation has completed successfully. 00:05:08.681 13:38:48 -- setup/common.sh@57 -- # (( part++ )) 00:05:08.681 13:38:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:08.681 13:38:48 -- setup/common.sh@62 -- # wait 2166661 00:05:08.681 13:38:48 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:08.681 13:38:48 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.681 13:38:48 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.681 13:38:48 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:08.681 13:38:48 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:08.681 13:38:48 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.681 13:38:48 -- setup/devices.sh@161 -- # break 00:05:08.681 13:38:48 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.681 13:38:48 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:08.681 13:38:48 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:08.681 13:38:48 -- setup/devices.sh@166 -- # dm=dm-0 00:05:08.681 13:38:48 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:08.681 13:38:48 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:08.681 13:38:48 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.681 13:38:48 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:08.681 13:38:48 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.681 13:38:48 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.681 13:38:48 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:08.681 13:38:48 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.681 13:38:48 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.681 13:38:48 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:08.681 13:38:48 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:08.681 13:38:48 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.681 13:38:48 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.681 13:38:48 -- setup/devices.sh@53 -- # local found=0 00:05:08.681 13:38:48 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:08.681 13:38:48 -- setup/devices.sh@56 -- # : 00:05:08.681 13:38:48 -- setup/devices.sh@59 -- # local pci status 00:05:08.681 13:38:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.681 13:38:48 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:08.681 13:38:48 -- setup/devices.sh@47 -- # setup output config 00:05:08.681 13:38:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:08.681 13:38:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:09.616 13:38:49 -- setup/devices.sh@63 -- # found=1 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.616 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.616 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.617 13:38:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.617 13:38:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.876 13:38:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:09.876 13:38:50 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:09.876 13:38:50 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.876 13:38:50 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:09.876 13:38:50 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.876 13:38:50 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.876 13:38:50 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:09.876 13:38:50 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.876 13:38:50 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:09.876 13:38:50 -- setup/devices.sh@50 -- # local mount_point= 00:05:09.876 13:38:50 -- setup/devices.sh@51 -- # local test_file= 00:05:09.876 13:38:50 -- setup/devices.sh@53 -- # local found=0 00:05:09.876 13:38:50 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:09.876 13:38:50 -- setup/devices.sh@59 -- # local pci status 00:05:09.876 13:38:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.876 13:38:50 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.876 13:38:50 -- setup/devices.sh@47 -- # setup output config 00:05:09.876 13:38:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.876 13:38:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:11.252 13:38:51 -- setup/devices.sh@63 -- # found=1 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.252 13:38:51 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:11.252 13:38:51 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:11.252 13:38:51 -- setup/devices.sh@68 -- # return 0 00:05:11.252 13:38:51 -- setup/devices.sh@187 -- # cleanup_dm 00:05:11.252 13:38:51 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.252 13:38:51 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.252 13:38:51 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:11.252 13:38:51 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:11.252 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:11.252 13:38:51 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:11.252 00:05:11.252 real 0m5.857s 00:05:11.252 user 0m1.014s 00:05:11.252 sys 0m1.711s 00:05:11.252 13:38:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.252 13:38:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.252 ************************************ 00:05:11.252 END TEST dm_mount 00:05:11.252 ************************************ 00:05:11.252 13:38:51 -- setup/devices.sh@1 -- # cleanup 00:05:11.252 13:38:51 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:11.252 13:38:51 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.252 13:38:51 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:11.252 13:38:51 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.252 13:38:51 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:11.511 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:11.511 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:11.511 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:11.511 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:11.511 13:38:51 -- setup/devices.sh@12 -- # cleanup_dm 00:05:11.511 13:38:51 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.511 13:38:51 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.511 13:38:51 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.511 13:38:51 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.511 13:38:51 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.511 13:38:51 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:11.511 00:05:11.511 real 0m14.204s 00:05:11.511 user 0m3.124s 00:05:11.511 sys 0m5.294s 00:05:11.511 13:38:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.511 13:38:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.511 ************************************ 00:05:11.511 END TEST devices 00:05:11.511 ************************************ 00:05:11.511 00:05:11.511 real 0m44.480s 00:05:11.511 user 0m12.966s 00:05:11.511 sys 0m20.164s 00:05:11.511 13:38:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.511 13:38:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.511 ************************************ 00:05:11.511 END TEST setup.sh 00:05:11.511 ************************************ 00:05:11.511 13:38:51 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:12.887 Hugepages 00:05:12.887 node hugesize free / total 00:05:12.887 node0 1048576kB 0 / 0 00:05:12.887 node0 2048kB 2048 / 2048 00:05:12.887 node1 1048576kB 0 / 0 00:05:12.887 node1 2048kB 0 / 0 00:05:12.887 00:05:12.887 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:12.887 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:12.887 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:12.887 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:12.887 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:12.887 13:38:52 -- spdk/autotest.sh@128 -- # uname -s 00:05:12.887 13:38:52 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:12.887 13:38:52 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:12.887 13:38:52 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:13.821 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:13.821 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:13.821 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:14.079 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:15.013 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:15.013 13:38:55 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:15.947 13:38:56 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:15.947 13:38:56 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:15.947 13:38:56 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:15.947 13:38:56 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:15.947 13:38:56 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:15.947 13:38:56 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:15.947 13:38:56 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:15.947 13:38:56 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:15.947 13:38:56 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:15.947 13:38:56 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:15.947 13:38:56 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:15.947 13:38:56 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:17.322 Waiting for block devices as requested 00:05:17.322 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:17.322 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:17.322 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:17.322 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:17.580 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:17.580 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:17.580 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:17.580 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:17.838 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:17.838 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:17.838 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:17.838 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:18.096 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:18.096 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:18.096 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:18.354 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:18.354 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:18.354 13:38:58 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:18.354 13:38:58 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:18.354 13:38:58 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:18.354 13:38:58 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:18.354 13:38:58 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:18.354 13:38:58 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:18.354 13:38:58 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:18.354 13:38:58 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:18.354 13:38:58 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:18.354 13:38:58 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:18.354 13:38:58 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:18.354 13:38:58 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:18.354 13:38:58 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:18.354 13:38:58 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:18.354 13:38:58 -- common/autotest_common.sh@1552 -- # continue 00:05:18.354 13:38:58 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:18.354 13:38:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.354 13:38:58 -- common/autotest_common.sh@10 -- # set +x 00:05:18.354 13:38:58 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:18.354 13:38:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.354 13:38:58 -- common/autotest_common.sh@10 -- # set +x 00:05:18.354 13:38:58 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:19.731 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.731 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.731 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.665 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:20.665 13:39:00 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:20.665 13:39:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:20.665 13:39:00 -- common/autotest_common.sh@10 -- # set +x 00:05:20.923 13:39:00 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:20.923 13:39:00 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:20.923 13:39:00 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:20.923 13:39:00 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:20.923 13:39:00 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:20.923 13:39:00 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:20.923 13:39:00 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:20.923 13:39:00 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:20.923 13:39:00 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:20.923 13:39:00 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:20.923 13:39:00 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:20.923 13:39:01 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:20.923 13:39:01 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:20.923 13:39:01 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:20.924 13:39:01 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:20.924 13:39:01 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:20.924 13:39:01 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:20.924 13:39:01 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:20.924 13:39:01 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:20.924 13:39:01 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:20.924 13:39:01 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2172031 00:05:20.924 13:39:01 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:20.924 13:39:01 -- common/autotest_common.sh@1593 -- # waitforlisten 2172031 00:05:20.924 13:39:01 -- common/autotest_common.sh@829 -- # '[' -z 2172031 ']' 00:05:20.924 13:39:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.924 13:39:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.924 13:39:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.924 13:39:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.924 13:39:01 -- common/autotest_common.sh@10 -- # set +x 00:05:20.924 [2024-11-29 13:39:01.083938] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.924 [2024-11-29 13:39:01.084038] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2172031 ] 00:05:20.924 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.924 [2024-11-29 13:39:01.143019] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.181 [2024-11-29 13:39:01.229496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.181 [2024-11-29 13:39:01.229651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.116 13:39:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.116 13:39:02 -- common/autotest_common.sh@862 -- # return 0 00:05:22.116 13:39:02 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:22.116 13:39:02 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:22.116 13:39:02 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:25.399 nvme0n1 00:05:25.399 13:39:05 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:25.399 [2024-11-29 13:39:05.370091] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:25.399 [2024-11-29 13:39:05.370142] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:25.399 request: 00:05:25.399 { 00:05:25.399 "nvme_ctrlr_name": "nvme0", 00:05:25.399 "password": "test", 00:05:25.399 "method": "bdev_nvme_opal_revert", 00:05:25.399 "req_id": 1 00:05:25.399 } 00:05:25.399 Got JSON-RPC error response 00:05:25.399 response: 00:05:25.399 { 00:05:25.399 "code": -32603, 00:05:25.399 "message": "Internal error" 00:05:25.399 } 00:05:25.399 13:39:05 -- common/autotest_common.sh@1599 -- # true 00:05:25.399 13:39:05 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:25.399 13:39:05 -- common/autotest_common.sh@1603 -- # killprocess 2172031 00:05:25.399 13:39:05 -- common/autotest_common.sh@936 -- # '[' -z 2172031 ']' 00:05:25.399 13:39:05 -- common/autotest_common.sh@940 -- # kill -0 2172031 00:05:25.399 13:39:05 -- common/autotest_common.sh@941 -- # uname 00:05:25.399 13:39:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.399 13:39:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2172031 00:05:25.399 13:39:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.399 13:39:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.399 13:39:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2172031' 00:05:25.399 killing process with pid 2172031 00:05:25.399 13:39:05 -- common/autotest_common.sh@955 -- # kill 2172031 00:05:25.399 13:39:05 -- common/autotest_common.sh@960 -- # wait 2172031 00:05:27.307 13:39:07 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:27.307 13:39:07 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:27.307 13:39:07 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.307 13:39:07 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.307 13:39:07 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:27.307 13:39:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.307 13:39:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.307 13:39:07 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.307 13:39:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.307 13:39:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.307 ************************************ 00:05:27.307 START TEST env 00:05:27.307 ************************************ 00:05:27.307 13:39:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.307 * Looking for test storage... 00:05:27.307 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:27.307 13:39:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.307 13:39:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.307 13:39:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.307 13:39:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.307 13:39:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.307 13:39:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.307 13:39:07 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.307 13:39:07 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.307 13:39:07 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.307 13:39:07 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.307 13:39:07 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.307 13:39:07 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.307 13:39:07 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.307 13:39:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.307 13:39:07 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.307 13:39:07 -- scripts/common.sh@344 -- # : 1 00:05:27.307 13:39:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.307 13:39:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.307 13:39:07 -- scripts/common.sh@364 -- # decimal 1 00:05:27.307 13:39:07 -- scripts/common.sh@352 -- # local d=1 00:05:27.307 13:39:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.307 13:39:07 -- scripts/common.sh@354 -- # echo 1 00:05:27.307 13:39:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.307 13:39:07 -- scripts/common.sh@365 -- # decimal 2 00:05:27.307 13:39:07 -- scripts/common.sh@352 -- # local d=2 00:05:27.307 13:39:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.307 13:39:07 -- scripts/common.sh@354 -- # echo 2 00:05:27.307 13:39:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.307 13:39:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.307 13:39:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.307 13:39:07 -- scripts/common.sh@367 -- # return 0 00:05:27.307 13:39:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.307 --rc genhtml_branch_coverage=1 00:05:27.307 --rc genhtml_function_coverage=1 00:05:27.307 --rc genhtml_legend=1 00:05:27.307 --rc geninfo_all_blocks=1 00:05:27.307 --rc geninfo_unexecuted_blocks=1 00:05:27.307 00:05:27.307 ' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.307 --rc genhtml_branch_coverage=1 00:05:27.307 --rc genhtml_function_coverage=1 00:05:27.307 --rc genhtml_legend=1 00:05:27.307 --rc geninfo_all_blocks=1 00:05:27.307 --rc geninfo_unexecuted_blocks=1 00:05:27.307 00:05:27.307 ' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.307 --rc genhtml_branch_coverage=1 00:05:27.307 --rc genhtml_function_coverage=1 00:05:27.307 --rc genhtml_legend=1 00:05:27.307 --rc geninfo_all_blocks=1 00:05:27.307 --rc geninfo_unexecuted_blocks=1 00:05:27.307 00:05:27.307 ' 00:05:27.307 13:39:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.307 --rc genhtml_branch_coverage=1 00:05:27.307 --rc genhtml_function_coverage=1 00:05:27.307 --rc genhtml_legend=1 00:05:27.307 --rc geninfo_all_blocks=1 00:05:27.307 --rc geninfo_unexecuted_blocks=1 00:05:27.308 00:05:27.308 ' 00:05:27.308 13:39:07 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.308 13:39:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.308 13:39:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.308 13:39:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.308 ************************************ 00:05:27.308 START TEST env_memory 00:05:27.308 ************************************ 00:05:27.308 13:39:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.308 00:05:27.308 00:05:27.308 CUnit - A unit testing framework for C - Version 2.1-3 00:05:27.308 http://cunit.sourceforge.net/ 00:05:27.308 00:05:27.308 00:05:27.308 Suite: memory 00:05:27.308 Test: alloc and free memory map ...[2024-11-29 13:39:07.340975] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:27.308 passed 00:05:27.308 Test: mem map translation ...[2024-11-29 13:39:07.362157] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:27.308 [2024-11-29 13:39:07.362180] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:27.308 [2024-11-29 13:39:07.362239] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:27.308 [2024-11-29 13:39:07.362251] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:27.308 passed 00:05:27.308 Test: mem map registration ...[2024-11-29 13:39:07.405926] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:27.308 [2024-11-29 13:39:07.405946] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:27.308 passed 00:05:27.308 Test: mem map adjacent registrations ...passed 00:05:27.308 00:05:27.308 Run Summary: Type Total Ran Passed Failed Inactive 00:05:27.308 suites 1 1 n/a 0 0 00:05:27.308 tests 4 4 4 0 0 00:05:27.308 asserts 152 152 152 0 n/a 00:05:27.308 00:05:27.308 Elapsed time = 0.148 seconds 00:05:27.308 00:05:27.308 real 0m0.157s 00:05:27.308 user 0m0.148s 00:05:27.308 sys 0m0.008s 00:05:27.308 13:39:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.308 13:39:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.308 ************************************ 00:05:27.308 END TEST env_memory 00:05:27.308 ************************************ 00:05:27.308 13:39:07 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.308 13:39:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.308 13:39:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.308 13:39:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.308 ************************************ 00:05:27.308 START TEST env_vtophys 00:05:27.308 ************************************ 00:05:27.308 13:39:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.308 EAL: lib.eal log level changed from notice to debug 00:05:27.308 EAL: Detected lcore 0 as core 0 on socket 0 00:05:27.308 EAL: Detected lcore 1 as core 1 on socket 0 00:05:27.308 EAL: Detected lcore 2 as core 2 on socket 0 00:05:27.308 EAL: Detected lcore 3 as core 3 on socket 0 00:05:27.308 EAL: Detected lcore 4 as core 4 on socket 0 00:05:27.308 EAL: Detected lcore 5 as core 5 on socket 0 00:05:27.308 EAL: Detected lcore 6 as core 8 on socket 0 00:05:27.308 EAL: Detected lcore 7 as core 9 on socket 0 00:05:27.308 EAL: Detected lcore 8 as core 10 on socket 0 00:05:27.308 EAL: Detected lcore 9 as core 11 on socket 0 00:05:27.308 EAL: Detected lcore 10 as core 12 on socket 0 00:05:27.308 EAL: Detected lcore 11 as core 13 on socket 0 00:05:27.308 EAL: Detected lcore 12 as core 0 on socket 1 00:05:27.308 EAL: Detected lcore 13 as core 1 on socket 1 00:05:27.308 EAL: Detected lcore 14 as core 2 on socket 1 00:05:27.308 EAL: Detected lcore 15 as core 3 on socket 1 00:05:27.308 EAL: Detected lcore 16 as core 4 on socket 1 00:05:27.308 EAL: Detected lcore 17 as core 5 on socket 1 00:05:27.308 EAL: Detected lcore 18 as core 8 on socket 1 00:05:27.308 EAL: Detected lcore 19 as core 9 on socket 1 00:05:27.308 EAL: Detected lcore 20 as core 10 on socket 1 00:05:27.308 EAL: Detected lcore 21 as core 11 on socket 1 00:05:27.308 EAL: Detected lcore 22 as core 12 on socket 1 00:05:27.308 EAL: Detected lcore 23 as core 13 on socket 1 00:05:27.308 EAL: Detected lcore 24 as core 0 on socket 0 00:05:27.308 EAL: Detected lcore 25 as core 1 on socket 0 00:05:27.308 EAL: Detected lcore 26 as core 2 on socket 0 00:05:27.308 EAL: Detected lcore 27 as core 3 on socket 0 00:05:27.308 EAL: Detected lcore 28 as core 4 on socket 0 00:05:27.308 EAL: Detected lcore 29 as core 5 on socket 0 00:05:27.308 EAL: Detected lcore 30 as core 8 on socket 0 00:05:27.308 EAL: Detected lcore 31 as core 9 on socket 0 00:05:27.308 EAL: Detected lcore 32 as core 10 on socket 0 00:05:27.308 EAL: Detected lcore 33 as core 11 on socket 0 00:05:27.308 EAL: Detected lcore 34 as core 12 on socket 0 00:05:27.308 EAL: Detected lcore 35 as core 13 on socket 0 00:05:27.308 EAL: Detected lcore 36 as core 0 on socket 1 00:05:27.308 EAL: Detected lcore 37 as core 1 on socket 1 00:05:27.308 EAL: Detected lcore 38 as core 2 on socket 1 00:05:27.308 EAL: Detected lcore 39 as core 3 on socket 1 00:05:27.308 EAL: Detected lcore 40 as core 4 on socket 1 00:05:27.308 EAL: Detected lcore 41 as core 5 on socket 1 00:05:27.308 EAL: Detected lcore 42 as core 8 on socket 1 00:05:27.308 EAL: Detected lcore 43 as core 9 on socket 1 00:05:27.308 EAL: Detected lcore 44 as core 10 on socket 1 00:05:27.308 EAL: Detected lcore 45 as core 11 on socket 1 00:05:27.308 EAL: Detected lcore 46 as core 12 on socket 1 00:05:27.308 EAL: Detected lcore 47 as core 13 on socket 1 00:05:27.308 EAL: Maximum logical cores by configuration: 128 00:05:27.308 EAL: Detected CPU lcores: 48 00:05:27.308 EAL: Detected NUMA nodes: 2 00:05:27.308 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:27.308 EAL: Detected shared linkage of DPDK 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:27.308 EAL: Registered [vdev] bus. 00:05:27.308 EAL: bus.vdev log level changed from disabled to notice 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:27.308 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:27.308 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:27.308 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:27.308 EAL: No shared files mode enabled, IPC will be disabled 00:05:27.308 EAL: No shared files mode enabled, IPC is disabled 00:05:27.308 EAL: Bus pci wants IOVA as 'DC' 00:05:27.308 EAL: Bus vdev wants IOVA as 'DC' 00:05:27.308 EAL: Buses did not request a specific IOVA mode. 00:05:27.308 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:27.308 EAL: Selected IOVA mode 'VA' 00:05:27.308 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.308 EAL: Probing VFIO support... 00:05:27.308 EAL: IOMMU type 1 (Type 1) is supported 00:05:27.308 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:27.308 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:27.308 EAL: VFIO support initialized 00:05:27.308 EAL: Ask a virtual area of 0x2e000 bytes 00:05:27.308 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:27.308 EAL: Setting up physically contiguous memory... 00:05:27.308 EAL: Setting maximum number of open files to 524288 00:05:27.308 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:27.308 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:27.308 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:27.308 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.308 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.308 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:27.308 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:27.308 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.308 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.308 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:27.308 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:27.308 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.308 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.308 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:27.308 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:27.308 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.308 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.308 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:27.308 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:27.308 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:27.308 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.308 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.308 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:27.308 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:27.308 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.308 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:27.309 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.309 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.309 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:27.309 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:27.309 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.309 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:27.309 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.309 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.309 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:27.309 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:27.309 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.309 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:27.309 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.309 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.309 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:27.309 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:27.309 EAL: Hugepages will be freed exactly as allocated. 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: TSC frequency is ~2700000 KHz 00:05:27.309 EAL: Main lcore 0 is ready (tid=7f03eb5cfa00;cpuset=[0]) 00:05:27.309 EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 0 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 2MB 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:27.309 EAL: Mem event callback 'spdk:(nil)' registered 00:05:27.309 00:05:27.309 00:05:27.309 CUnit - A unit testing framework for C - Version 2.1-3 00:05:27.309 http://cunit.sourceforge.net/ 00:05:27.309 00:05:27.309 00:05:27.309 Suite: components_suite 00:05:27.309 Test: vtophys_malloc_test ...passed 00:05:27.309 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 4 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 4MB 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was shrunk by 4MB 00:05:27.309 EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 4 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 6MB 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was shrunk by 6MB 00:05:27.309 EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 4 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 10MB 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was shrunk by 10MB 00:05:27.309 EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 4 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 18MB 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was shrunk by 18MB 00:05:27.309 EAL: Trying to obtain current memory policy. 00:05:27.309 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.309 EAL: Restoring previous memory policy: 4 00:05:27.309 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.309 EAL: request: mp_malloc_sync 00:05:27.309 EAL: No shared files mode enabled, IPC is disabled 00:05:27.309 EAL: Heap on socket 0 was expanded by 34MB 00:05:27.567 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.567 EAL: request: mp_malloc_sync 00:05:27.567 EAL: No shared files mode enabled, IPC is disabled 00:05:27.567 EAL: Heap on socket 0 was shrunk by 34MB 00:05:27.567 EAL: Trying to obtain current memory policy. 00:05:27.567 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.567 EAL: Restoring previous memory policy: 4 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.568 EAL: request: mp_malloc_sync 00:05:27.568 EAL: No shared files mode enabled, IPC is disabled 00:05:27.568 EAL: Heap on socket 0 was expanded by 66MB 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.568 EAL: request: mp_malloc_sync 00:05:27.568 EAL: No shared files mode enabled, IPC is disabled 00:05:27.568 EAL: Heap on socket 0 was shrunk by 66MB 00:05:27.568 EAL: Trying to obtain current memory policy. 00:05:27.568 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.568 EAL: Restoring previous memory policy: 4 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.568 EAL: request: mp_malloc_sync 00:05:27.568 EAL: No shared files mode enabled, IPC is disabled 00:05:27.568 EAL: Heap on socket 0 was expanded by 130MB 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.568 EAL: request: mp_malloc_sync 00:05:27.568 EAL: No shared files mode enabled, IPC is disabled 00:05:27.568 EAL: Heap on socket 0 was shrunk by 130MB 00:05:27.568 EAL: Trying to obtain current memory policy. 00:05:27.568 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.568 EAL: Restoring previous memory policy: 4 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.568 EAL: request: mp_malloc_sync 00:05:27.568 EAL: No shared files mode enabled, IPC is disabled 00:05:27.568 EAL: Heap on socket 0 was expanded by 258MB 00:05:27.568 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.827 EAL: request: mp_malloc_sync 00:05:27.827 EAL: No shared files mode enabled, IPC is disabled 00:05:27.827 EAL: Heap on socket 0 was shrunk by 258MB 00:05:27.827 EAL: Trying to obtain current memory policy. 00:05:27.827 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.827 EAL: Restoring previous memory policy: 4 00:05:27.827 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.827 EAL: request: mp_malloc_sync 00:05:27.827 EAL: No shared files mode enabled, IPC is disabled 00:05:27.827 EAL: Heap on socket 0 was expanded by 514MB 00:05:28.088 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.088 EAL: request: mp_malloc_sync 00:05:28.088 EAL: No shared files mode enabled, IPC is disabled 00:05:28.088 EAL: Heap on socket 0 was shrunk by 514MB 00:05:28.088 EAL: Trying to obtain current memory policy. 00:05:28.088 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.347 EAL: Restoring previous memory policy: 4 00:05:28.347 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.347 EAL: request: mp_malloc_sync 00:05:28.347 EAL: No shared files mode enabled, IPC is disabled 00:05:28.347 EAL: Heap on socket 0 was expanded by 1026MB 00:05:28.606 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.865 EAL: request: mp_malloc_sync 00:05:28.865 EAL: No shared files mode enabled, IPC is disabled 00:05:28.865 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:28.865 passed 00:05:28.865 00:05:28.865 Run Summary: Type Total Ran Passed Failed Inactive 00:05:28.865 suites 1 1 n/a 0 0 00:05:28.865 tests 2 2 2 0 0 00:05:28.865 asserts 497 497 497 0 n/a 00:05:28.865 00:05:28.865 Elapsed time = 1.344 seconds 00:05:28.865 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.865 EAL: request: mp_malloc_sync 00:05:28.865 EAL: No shared files mode enabled, IPC is disabled 00:05:28.865 EAL: Heap on socket 0 was shrunk by 2MB 00:05:28.865 EAL: No shared files mode enabled, IPC is disabled 00:05:28.865 EAL: No shared files mode enabled, IPC is disabled 00:05:28.865 EAL: No shared files mode enabled, IPC is disabled 00:05:28.865 00:05:28.865 real 0m1.468s 00:05:28.865 user 0m0.824s 00:05:28.865 sys 0m0.604s 00:05:28.865 13:39:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.865 13:39:08 -- common/autotest_common.sh@10 -- # set +x 00:05:28.865 ************************************ 00:05:28.865 END TEST env_vtophys 00:05:28.865 ************************************ 00:05:28.865 13:39:08 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:28.865 13:39:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.865 13:39:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.865 13:39:08 -- common/autotest_common.sh@10 -- # set +x 00:05:28.865 ************************************ 00:05:28.865 START TEST env_pci 00:05:28.865 ************************************ 00:05:28.865 13:39:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:28.865 00:05:28.865 00:05:28.865 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.865 http://cunit.sourceforge.net/ 00:05:28.865 00:05:28.865 00:05:28.865 Suite: pci 00:05:28.865 Test: pci_hook ...[2024-11-29 13:39:08.992761] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2173569 has claimed it 00:05:28.865 EAL: Cannot find device (10000:00:01.0) 00:05:28.865 EAL: Failed to attach device on primary process 00:05:28.865 passed 00:05:28.865 00:05:28.865 Run Summary: Type Total Ran Passed Failed Inactive 00:05:28.865 suites 1 1 n/a 0 0 00:05:28.865 tests 1 1 1 0 0 00:05:28.865 asserts 25 25 25 0 n/a 00:05:28.865 00:05:28.865 Elapsed time = 0.021 seconds 00:05:28.865 00:05:28.865 real 0m0.034s 00:05:28.865 user 0m0.011s 00:05:28.865 sys 0m0.022s 00:05:28.865 13:39:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.865 13:39:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.865 ************************************ 00:05:28.865 END TEST env_pci 00:05:28.865 ************************************ 00:05:28.865 13:39:09 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:28.865 13:39:09 -- env/env.sh@15 -- # uname 00:05:28.865 13:39:09 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:28.865 13:39:09 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:28.865 13:39:09 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:28.865 13:39:09 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:28.865 13:39:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.865 13:39:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.865 ************************************ 00:05:28.865 START TEST env_dpdk_post_init 00:05:28.865 ************************************ 00:05:28.865 13:39:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:28.865 EAL: Detected CPU lcores: 48 00:05:28.865 EAL: Detected NUMA nodes: 2 00:05:28.865 EAL: Detected shared linkage of DPDK 00:05:28.865 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:28.865 EAL: Selected IOVA mode 'VA' 00:05:28.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.865 EAL: VFIO support initialized 00:05:28.865 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:29.125 EAL: Using IOMMU type 1 (Type 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:29.126 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:30.068 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:33.363 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:33.363 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:33.363 Starting DPDK initialization... 00:05:33.363 Starting SPDK post initialization... 00:05:33.363 SPDK NVMe probe 00:05:33.363 Attaching to 0000:88:00.0 00:05:33.363 Attached to 0000:88:00.0 00:05:33.363 Cleaning up... 00:05:33.363 00:05:33.363 real 0m4.391s 00:05:33.363 user 0m3.283s 00:05:33.363 sys 0m0.172s 00:05:33.363 13:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.363 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 END TEST env_dpdk_post_init 00:05:33.363 ************************************ 00:05:33.363 13:39:13 -- env/env.sh@26 -- # uname 00:05:33.363 13:39:13 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:33.363 13:39:13 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:33.363 13:39:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.363 13:39:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.363 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 START TEST env_mem_callbacks 00:05:33.363 ************************************ 00:05:33.363 13:39:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:33.363 EAL: Detected CPU lcores: 48 00:05:33.363 EAL: Detected NUMA nodes: 2 00:05:33.363 EAL: Detected shared linkage of DPDK 00:05:33.363 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:33.363 EAL: Selected IOVA mode 'VA' 00:05:33.363 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.363 EAL: VFIO support initialized 00:05:33.363 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:33.363 00:05:33.363 00:05:33.363 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.363 http://cunit.sourceforge.net/ 00:05:33.363 00:05:33.363 00:05:33.363 Suite: memory 00:05:33.363 Test: test ... 00:05:33.363 register 0x200000200000 2097152 00:05:33.363 malloc 3145728 00:05:33.363 register 0x200000400000 4194304 00:05:33.363 buf 0x200000500000 len 3145728 PASSED 00:05:33.363 malloc 64 00:05:33.363 buf 0x2000004fff40 len 64 PASSED 00:05:33.363 malloc 4194304 00:05:33.363 register 0x200000800000 6291456 00:05:33.363 buf 0x200000a00000 len 4194304 PASSED 00:05:33.363 free 0x200000500000 3145728 00:05:33.363 free 0x2000004fff40 64 00:05:33.363 unregister 0x200000400000 4194304 PASSED 00:05:33.363 free 0x200000a00000 4194304 00:05:33.363 unregister 0x200000800000 6291456 PASSED 00:05:33.363 malloc 8388608 00:05:33.363 register 0x200000400000 10485760 00:05:33.363 buf 0x200000600000 len 8388608 PASSED 00:05:33.363 free 0x200000600000 8388608 00:05:33.363 unregister 0x200000400000 10485760 PASSED 00:05:33.363 passed 00:05:33.363 00:05:33.363 Run Summary: Type Total Ran Passed Failed Inactive 00:05:33.363 suites 1 1 n/a 0 0 00:05:33.363 tests 1 1 1 0 0 00:05:33.363 asserts 15 15 15 0 n/a 00:05:33.363 00:05:33.363 Elapsed time = 0.005 seconds 00:05:33.363 00:05:33.363 real 0m0.047s 00:05:33.363 user 0m0.013s 00:05:33.363 sys 0m0.033s 00:05:33.363 13:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.363 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 END TEST env_mem_callbacks 00:05:33.363 ************************************ 00:05:33.363 00:05:33.363 real 0m6.370s 00:05:33.363 user 0m4.434s 00:05:33.363 sys 0m0.988s 00:05:33.363 13:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.363 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 END TEST env 00:05:33.363 ************************************ 00:05:33.363 13:39:13 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:33.363 13:39:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.363 13:39:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.363 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 START TEST rpc 00:05:33.363 ************************************ 00:05:33.363 13:39:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:33.363 * Looking for test storage... 00:05:33.363 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:33.363 13:39:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.363 13:39:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.363 13:39:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.623 13:39:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.623 13:39:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.623 13:39:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.624 13:39:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.624 13:39:13 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.624 13:39:13 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.624 13:39:13 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.624 13:39:13 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.624 13:39:13 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.624 13:39:13 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.624 13:39:13 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.624 13:39:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.624 13:39:13 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.624 13:39:13 -- scripts/common.sh@344 -- # : 1 00:05:33.624 13:39:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.624 13:39:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.624 13:39:13 -- scripts/common.sh@364 -- # decimal 1 00:05:33.624 13:39:13 -- scripts/common.sh@352 -- # local d=1 00:05:33.624 13:39:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.624 13:39:13 -- scripts/common.sh@354 -- # echo 1 00:05:33.624 13:39:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.624 13:39:13 -- scripts/common.sh@365 -- # decimal 2 00:05:33.624 13:39:13 -- scripts/common.sh@352 -- # local d=2 00:05:33.624 13:39:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.624 13:39:13 -- scripts/common.sh@354 -- # echo 2 00:05:33.624 13:39:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.624 13:39:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.624 13:39:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.624 13:39:13 -- scripts/common.sh@367 -- # return 0 00:05:33.624 13:39:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.624 13:39:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.624 --rc genhtml_branch_coverage=1 00:05:33.624 --rc genhtml_function_coverage=1 00:05:33.624 --rc genhtml_legend=1 00:05:33.624 --rc geninfo_all_blocks=1 00:05:33.624 --rc geninfo_unexecuted_blocks=1 00:05:33.624 00:05:33.624 ' 00:05:33.624 13:39:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.624 --rc genhtml_branch_coverage=1 00:05:33.624 --rc genhtml_function_coverage=1 00:05:33.624 --rc genhtml_legend=1 00:05:33.624 --rc geninfo_all_blocks=1 00:05:33.624 --rc geninfo_unexecuted_blocks=1 00:05:33.624 00:05:33.624 ' 00:05:33.624 13:39:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.624 --rc genhtml_branch_coverage=1 00:05:33.624 --rc genhtml_function_coverage=1 00:05:33.624 --rc genhtml_legend=1 00:05:33.624 --rc geninfo_all_blocks=1 00:05:33.624 --rc geninfo_unexecuted_blocks=1 00:05:33.624 00:05:33.624 ' 00:05:33.624 13:39:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.624 --rc genhtml_branch_coverage=1 00:05:33.624 --rc genhtml_function_coverage=1 00:05:33.624 --rc genhtml_legend=1 00:05:33.624 --rc geninfo_all_blocks=1 00:05:33.624 --rc geninfo_unexecuted_blocks=1 00:05:33.624 00:05:33.624 ' 00:05:33.624 13:39:13 -- rpc/rpc.sh@65 -- # spdk_pid=2174302 00:05:33.624 13:39:13 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:33.624 13:39:13 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:33.624 13:39:13 -- rpc/rpc.sh@67 -- # waitforlisten 2174302 00:05:33.624 13:39:13 -- common/autotest_common.sh@829 -- # '[' -z 2174302 ']' 00:05:33.624 13:39:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.624 13:39:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.624 13:39:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.624 13:39:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.624 13:39:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.624 [2024-11-29 13:39:13.742599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.624 [2024-11-29 13:39:13.742696] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2174302 ] 00:05:33.624 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.624 [2024-11-29 13:39:13.802582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.624 [2024-11-29 13:39:13.887244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.624 [2024-11-29 13:39:13.887431] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:33.624 [2024-11-29 13:39:13.887450] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2174302' to capture a snapshot of events at runtime. 00:05:33.624 [2024-11-29 13:39:13.887462] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2174302 for offline analysis/debug. 00:05:33.624 [2024-11-29 13:39:13.887496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.561 13:39:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.561 13:39:14 -- common/autotest_common.sh@862 -- # return 0 00:05:34.561 13:39:14 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.561 13:39:14 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.561 13:39:14 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:34.561 13:39:14 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:34.561 13:39:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.561 13:39:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.561 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.561 ************************************ 00:05:34.561 START TEST rpc_integrity 00:05:34.561 ************************************ 00:05:34.561 13:39:14 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:34.561 13:39:14 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:34.561 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.561 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.561 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.561 13:39:14 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:34.561 13:39:14 -- rpc/rpc.sh@13 -- # jq length 00:05:34.562 13:39:14 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:34.562 13:39:14 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:34.562 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.562 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.562 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.562 13:39:14 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:34.562 13:39:14 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:34.562 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.562 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.562 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.562 13:39:14 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:34.562 { 00:05:34.562 "name": "Malloc0", 00:05:34.562 "aliases": [ 00:05:34.562 "d3251990-9d75-4f79-9d85-bae4a0e52b0e" 00:05:34.562 ], 00:05:34.562 "product_name": "Malloc disk", 00:05:34.562 "block_size": 512, 00:05:34.562 "num_blocks": 16384, 00:05:34.562 "uuid": "d3251990-9d75-4f79-9d85-bae4a0e52b0e", 00:05:34.562 "assigned_rate_limits": { 00:05:34.562 "rw_ios_per_sec": 0, 00:05:34.562 "rw_mbytes_per_sec": 0, 00:05:34.562 "r_mbytes_per_sec": 0, 00:05:34.562 "w_mbytes_per_sec": 0 00:05:34.562 }, 00:05:34.562 "claimed": false, 00:05:34.562 "zoned": false, 00:05:34.562 "supported_io_types": { 00:05:34.562 "read": true, 00:05:34.562 "write": true, 00:05:34.562 "unmap": true, 00:05:34.562 "write_zeroes": true, 00:05:34.562 "flush": true, 00:05:34.562 "reset": true, 00:05:34.562 "compare": false, 00:05:34.562 "compare_and_write": false, 00:05:34.562 "abort": true, 00:05:34.562 "nvme_admin": false, 00:05:34.562 "nvme_io": false 00:05:34.562 }, 00:05:34.562 "memory_domains": [ 00:05:34.562 { 00:05:34.562 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.562 "dma_device_type": 2 00:05:34.562 } 00:05:34.562 ], 00:05:34.562 "driver_specific": {} 00:05:34.562 } 00:05:34.562 ]' 00:05:34.562 13:39:14 -- rpc/rpc.sh@17 -- # jq length 00:05:34.821 13:39:14 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:34.821 13:39:14 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:34.821 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.821 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.821 [2024-11-29 13:39:14.861525] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:34.821 [2024-11-29 13:39:14.861570] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:34.822 [2024-11-29 13:39:14.861594] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1158bf0 00:05:34.822 [2024-11-29 13:39:14.861608] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:34.822 [2024-11-29 13:39:14.863135] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:34.822 [2024-11-29 13:39:14.863163] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:34.822 Passthru0 00:05:34.822 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:14 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:34.822 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:14 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:34.822 { 00:05:34.822 "name": "Malloc0", 00:05:34.822 "aliases": [ 00:05:34.822 "d3251990-9d75-4f79-9d85-bae4a0e52b0e" 00:05:34.822 ], 00:05:34.822 "product_name": "Malloc disk", 00:05:34.822 "block_size": 512, 00:05:34.822 "num_blocks": 16384, 00:05:34.822 "uuid": "d3251990-9d75-4f79-9d85-bae4a0e52b0e", 00:05:34.822 "assigned_rate_limits": { 00:05:34.822 "rw_ios_per_sec": 0, 00:05:34.822 "rw_mbytes_per_sec": 0, 00:05:34.822 "r_mbytes_per_sec": 0, 00:05:34.822 "w_mbytes_per_sec": 0 00:05:34.822 }, 00:05:34.822 "claimed": true, 00:05:34.822 "claim_type": "exclusive_write", 00:05:34.822 "zoned": false, 00:05:34.822 "supported_io_types": { 00:05:34.822 "read": true, 00:05:34.822 "write": true, 00:05:34.822 "unmap": true, 00:05:34.822 "write_zeroes": true, 00:05:34.822 "flush": true, 00:05:34.822 "reset": true, 00:05:34.822 "compare": false, 00:05:34.822 "compare_and_write": false, 00:05:34.822 "abort": true, 00:05:34.822 "nvme_admin": false, 00:05:34.822 "nvme_io": false 00:05:34.822 }, 00:05:34.822 "memory_domains": [ 00:05:34.822 { 00:05:34.822 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.822 "dma_device_type": 2 00:05:34.822 } 00:05:34.822 ], 00:05:34.822 "driver_specific": {} 00:05:34.822 }, 00:05:34.822 { 00:05:34.822 "name": "Passthru0", 00:05:34.822 "aliases": [ 00:05:34.822 "16dd32d9-e096-5915-b47d-b4cc0c6cae85" 00:05:34.822 ], 00:05:34.822 "product_name": "passthru", 00:05:34.822 "block_size": 512, 00:05:34.822 "num_blocks": 16384, 00:05:34.822 "uuid": "16dd32d9-e096-5915-b47d-b4cc0c6cae85", 00:05:34.822 "assigned_rate_limits": { 00:05:34.822 "rw_ios_per_sec": 0, 00:05:34.822 "rw_mbytes_per_sec": 0, 00:05:34.822 "r_mbytes_per_sec": 0, 00:05:34.822 "w_mbytes_per_sec": 0 00:05:34.822 }, 00:05:34.822 "claimed": false, 00:05:34.822 "zoned": false, 00:05:34.822 "supported_io_types": { 00:05:34.822 "read": true, 00:05:34.822 "write": true, 00:05:34.822 "unmap": true, 00:05:34.822 "write_zeroes": true, 00:05:34.822 "flush": true, 00:05:34.822 "reset": true, 00:05:34.822 "compare": false, 00:05:34.822 "compare_and_write": false, 00:05:34.822 "abort": true, 00:05:34.822 "nvme_admin": false, 00:05:34.822 "nvme_io": false 00:05:34.822 }, 00:05:34.822 "memory_domains": [ 00:05:34.822 { 00:05:34.822 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.822 "dma_device_type": 2 00:05:34.822 } 00:05:34.822 ], 00:05:34.822 "driver_specific": { 00:05:34.822 "passthru": { 00:05:34.822 "name": "Passthru0", 00:05:34.822 "base_bdev_name": "Malloc0" 00:05:34.822 } 00:05:34.822 } 00:05:34.822 } 00:05:34.822 ]' 00:05:34.822 13:39:14 -- rpc/rpc.sh@21 -- # jq length 00:05:34.822 13:39:14 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:34.822 13:39:14 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:34.822 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:14 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:34.822 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:14 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:34.822 13:39:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:14 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:34.822 13:39:14 -- rpc/rpc.sh@26 -- # jq length 00:05:34.822 13:39:14 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:34.822 00:05:34.822 real 0m0.229s 00:05:34.822 user 0m0.146s 00:05:34.822 sys 0m0.021s 00:05:34.822 13:39:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.822 13:39:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 ************************************ 00:05:34.822 END TEST rpc_integrity 00:05:34.822 ************************************ 00:05:34.822 13:39:15 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:34.822 13:39:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.822 13:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.822 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 ************************************ 00:05:34.822 START TEST rpc_plugins 00:05:34.822 ************************************ 00:05:34.822 13:39:15 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:34.822 13:39:15 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:34.822 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:15 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:34.822 13:39:15 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:34.822 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:15 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:34.822 { 00:05:34.822 "name": "Malloc1", 00:05:34.822 "aliases": [ 00:05:34.822 "c6acee9f-65bb-45ac-a532-3634724e103d" 00:05:34.822 ], 00:05:34.822 "product_name": "Malloc disk", 00:05:34.822 "block_size": 4096, 00:05:34.822 "num_blocks": 256, 00:05:34.822 "uuid": "c6acee9f-65bb-45ac-a532-3634724e103d", 00:05:34.822 "assigned_rate_limits": { 00:05:34.822 "rw_ios_per_sec": 0, 00:05:34.822 "rw_mbytes_per_sec": 0, 00:05:34.822 "r_mbytes_per_sec": 0, 00:05:34.822 "w_mbytes_per_sec": 0 00:05:34.822 }, 00:05:34.822 "claimed": false, 00:05:34.822 "zoned": false, 00:05:34.822 "supported_io_types": { 00:05:34.822 "read": true, 00:05:34.822 "write": true, 00:05:34.822 "unmap": true, 00:05:34.822 "write_zeroes": true, 00:05:34.822 "flush": true, 00:05:34.822 "reset": true, 00:05:34.822 "compare": false, 00:05:34.822 "compare_and_write": false, 00:05:34.822 "abort": true, 00:05:34.822 "nvme_admin": false, 00:05:34.822 "nvme_io": false 00:05:34.822 }, 00:05:34.822 "memory_domains": [ 00:05:34.822 { 00:05:34.822 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.822 "dma_device_type": 2 00:05:34.822 } 00:05:34.822 ], 00:05:34.822 "driver_specific": {} 00:05:34.822 } 00:05:34.822 ]' 00:05:34.822 13:39:15 -- rpc/rpc.sh@32 -- # jq length 00:05:34.822 13:39:15 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:34.822 13:39:15 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:34.822 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:15 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:34.822 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.822 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.822 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.822 13:39:15 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:34.822 13:39:15 -- rpc/rpc.sh@36 -- # jq length 00:05:35.080 13:39:15 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:35.080 00:05:35.080 real 0m0.115s 00:05:35.080 user 0m0.076s 00:05:35.080 sys 0m0.008s 00:05:35.080 13:39:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.080 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.080 ************************************ 00:05:35.080 END TEST rpc_plugins 00:05:35.080 ************************************ 00:05:35.080 13:39:15 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:35.080 13:39:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.080 13:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.080 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.080 ************************************ 00:05:35.080 START TEST rpc_trace_cmd_test 00:05:35.080 ************************************ 00:05:35.080 13:39:15 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:35.080 13:39:15 -- rpc/rpc.sh@40 -- # local info 00:05:35.080 13:39:15 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:35.080 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.080 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.080 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.080 13:39:15 -- rpc/rpc.sh@42 -- # info='{ 00:05:35.080 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2174302", 00:05:35.080 "tpoint_group_mask": "0x8", 00:05:35.080 "iscsi_conn": { 00:05:35.080 "mask": "0x2", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "scsi": { 00:05:35.080 "mask": "0x4", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "bdev": { 00:05:35.080 "mask": "0x8", 00:05:35.080 "tpoint_mask": "0xffffffffffffffff" 00:05:35.080 }, 00:05:35.080 "nvmf_rdma": { 00:05:35.080 "mask": "0x10", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "nvmf_tcp": { 00:05:35.080 "mask": "0x20", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "ftl": { 00:05:35.080 "mask": "0x40", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "blobfs": { 00:05:35.080 "mask": "0x80", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "dsa": { 00:05:35.080 "mask": "0x200", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "thread": { 00:05:35.080 "mask": "0x400", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "nvme_pcie": { 00:05:35.080 "mask": "0x800", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "iaa": { 00:05:35.080 "mask": "0x1000", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "nvme_tcp": { 00:05:35.080 "mask": "0x2000", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 }, 00:05:35.080 "bdev_nvme": { 00:05:35.080 "mask": "0x4000", 00:05:35.080 "tpoint_mask": "0x0" 00:05:35.080 } 00:05:35.080 }' 00:05:35.080 13:39:15 -- rpc/rpc.sh@43 -- # jq length 00:05:35.080 13:39:15 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:35.080 13:39:15 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:35.080 13:39:15 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:35.080 13:39:15 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:35.080 13:39:15 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:35.080 13:39:15 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:35.080 13:39:15 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:35.080 13:39:15 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:35.080 13:39:15 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:35.080 00:05:35.080 real 0m0.196s 00:05:35.080 user 0m0.171s 00:05:35.080 sys 0m0.016s 00:05:35.080 13:39:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.080 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.080 ************************************ 00:05:35.080 END TEST rpc_trace_cmd_test 00:05:35.080 ************************************ 00:05:35.337 13:39:15 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:35.337 13:39:15 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:35.337 13:39:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.337 13:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 ************************************ 00:05:35.337 START TEST rpc_daemon_integrity 00:05:35.337 ************************************ 00:05:35.337 13:39:15 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:35.337 13:39:15 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:35.337 13:39:15 -- rpc/rpc.sh@13 -- # jq length 00:05:35.337 13:39:15 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:35.337 13:39:15 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:35.337 13:39:15 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:35.337 { 00:05:35.337 "name": "Malloc2", 00:05:35.337 "aliases": [ 00:05:35.337 "418d1078-a780-4af1-b2e6-50755534f62b" 00:05:35.337 ], 00:05:35.337 "product_name": "Malloc disk", 00:05:35.337 "block_size": 512, 00:05:35.337 "num_blocks": 16384, 00:05:35.337 "uuid": "418d1078-a780-4af1-b2e6-50755534f62b", 00:05:35.337 "assigned_rate_limits": { 00:05:35.337 "rw_ios_per_sec": 0, 00:05:35.337 "rw_mbytes_per_sec": 0, 00:05:35.337 "r_mbytes_per_sec": 0, 00:05:35.337 "w_mbytes_per_sec": 0 00:05:35.337 }, 00:05:35.337 "claimed": false, 00:05:35.337 "zoned": false, 00:05:35.337 "supported_io_types": { 00:05:35.337 "read": true, 00:05:35.337 "write": true, 00:05:35.337 "unmap": true, 00:05:35.337 "write_zeroes": true, 00:05:35.337 "flush": true, 00:05:35.337 "reset": true, 00:05:35.337 "compare": false, 00:05:35.337 "compare_and_write": false, 00:05:35.337 "abort": true, 00:05:35.337 "nvme_admin": false, 00:05:35.337 "nvme_io": false 00:05:35.337 }, 00:05:35.337 "memory_domains": [ 00:05:35.337 { 00:05:35.337 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.337 "dma_device_type": 2 00:05:35.337 } 00:05:35.337 ], 00:05:35.337 "driver_specific": {} 00:05:35.337 } 00:05:35.337 ]' 00:05:35.337 13:39:15 -- rpc/rpc.sh@17 -- # jq length 00:05:35.337 13:39:15 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:35.337 13:39:15 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 [2024-11-29 13:39:15.479302] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:35.337 [2024-11-29 13:39:15.479349] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:35.337 [2024-11-29 13:39:15.479373] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x12f8940 00:05:35.337 [2024-11-29 13:39:15.479389] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:35.337 [2024-11-29 13:39:15.480781] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:35.337 [2024-11-29 13:39:15.480808] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:35.337 Passthru0 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:35.337 { 00:05:35.337 "name": "Malloc2", 00:05:35.337 "aliases": [ 00:05:35.337 "418d1078-a780-4af1-b2e6-50755534f62b" 00:05:35.337 ], 00:05:35.337 "product_name": "Malloc disk", 00:05:35.337 "block_size": 512, 00:05:35.337 "num_blocks": 16384, 00:05:35.337 "uuid": "418d1078-a780-4af1-b2e6-50755534f62b", 00:05:35.337 "assigned_rate_limits": { 00:05:35.337 "rw_ios_per_sec": 0, 00:05:35.337 "rw_mbytes_per_sec": 0, 00:05:35.337 "r_mbytes_per_sec": 0, 00:05:35.337 "w_mbytes_per_sec": 0 00:05:35.337 }, 00:05:35.337 "claimed": true, 00:05:35.337 "claim_type": "exclusive_write", 00:05:35.337 "zoned": false, 00:05:35.337 "supported_io_types": { 00:05:35.337 "read": true, 00:05:35.337 "write": true, 00:05:35.337 "unmap": true, 00:05:35.337 "write_zeroes": true, 00:05:35.337 "flush": true, 00:05:35.337 "reset": true, 00:05:35.337 "compare": false, 00:05:35.337 "compare_and_write": false, 00:05:35.337 "abort": true, 00:05:35.337 "nvme_admin": false, 00:05:35.337 "nvme_io": false 00:05:35.337 }, 00:05:35.337 "memory_domains": [ 00:05:35.337 { 00:05:35.337 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.337 "dma_device_type": 2 00:05:35.337 } 00:05:35.337 ], 00:05:35.337 "driver_specific": {} 00:05:35.337 }, 00:05:35.337 { 00:05:35.337 "name": "Passthru0", 00:05:35.337 "aliases": [ 00:05:35.337 "a7cf2631-647d-540b-aa92-e23f6784c936" 00:05:35.337 ], 00:05:35.337 "product_name": "passthru", 00:05:35.337 "block_size": 512, 00:05:35.337 "num_blocks": 16384, 00:05:35.337 "uuid": "a7cf2631-647d-540b-aa92-e23f6784c936", 00:05:35.337 "assigned_rate_limits": { 00:05:35.337 "rw_ios_per_sec": 0, 00:05:35.337 "rw_mbytes_per_sec": 0, 00:05:35.337 "r_mbytes_per_sec": 0, 00:05:35.337 "w_mbytes_per_sec": 0 00:05:35.337 }, 00:05:35.337 "claimed": false, 00:05:35.337 "zoned": false, 00:05:35.337 "supported_io_types": { 00:05:35.337 "read": true, 00:05:35.337 "write": true, 00:05:35.337 "unmap": true, 00:05:35.337 "write_zeroes": true, 00:05:35.337 "flush": true, 00:05:35.337 "reset": true, 00:05:35.337 "compare": false, 00:05:35.337 "compare_and_write": false, 00:05:35.337 "abort": true, 00:05:35.337 "nvme_admin": false, 00:05:35.337 "nvme_io": false 00:05:35.337 }, 00:05:35.337 "memory_domains": [ 00:05:35.337 { 00:05:35.337 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.337 "dma_device_type": 2 00:05:35.337 } 00:05:35.337 ], 00:05:35.337 "driver_specific": { 00:05:35.337 "passthru": { 00:05:35.337 "name": "Passthru0", 00:05:35.337 "base_bdev_name": "Malloc2" 00:05:35.337 } 00:05:35.337 } 00:05:35.337 } 00:05:35.337 ]' 00:05:35.337 13:39:15 -- rpc/rpc.sh@21 -- # jq length 00:05:35.337 13:39:15 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:35.337 13:39:15 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:35.337 13:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.337 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.337 13:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.337 13:39:15 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:35.338 13:39:15 -- rpc/rpc.sh@26 -- # jq length 00:05:35.338 13:39:15 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:35.338 00:05:35.338 real 0m0.222s 00:05:35.338 user 0m0.149s 00:05:35.338 sys 0m0.016s 00:05:35.338 13:39:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.338 13:39:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.338 ************************************ 00:05:35.338 END TEST rpc_daemon_integrity 00:05:35.338 ************************************ 00:05:35.338 13:39:15 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:35.338 13:39:15 -- rpc/rpc.sh@84 -- # killprocess 2174302 00:05:35.338 13:39:15 -- common/autotest_common.sh@936 -- # '[' -z 2174302 ']' 00:05:35.338 13:39:15 -- common/autotest_common.sh@940 -- # kill -0 2174302 00:05:35.338 13:39:15 -- common/autotest_common.sh@941 -- # uname 00:05:35.598 13:39:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.598 13:39:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2174302 00:05:35.598 13:39:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.598 13:39:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.598 13:39:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2174302' 00:05:35.598 killing process with pid 2174302 00:05:35.598 13:39:15 -- common/autotest_common.sh@955 -- # kill 2174302 00:05:35.598 13:39:15 -- common/autotest_common.sh@960 -- # wait 2174302 00:05:35.857 00:05:35.857 real 0m2.500s 00:05:35.857 user 0m3.195s 00:05:35.857 sys 0m0.598s 00:05:35.857 13:39:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.857 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:35.857 ************************************ 00:05:35.857 END TEST rpc 00:05:35.857 ************************************ 00:05:35.857 13:39:16 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:35.857 13:39:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.857 13:39:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.857 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:35.857 ************************************ 00:05:35.857 START TEST rpc_client 00:05:35.857 ************************************ 00:05:35.857 13:39:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:35.857 * Looking for test storage... 00:05:36.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:36.116 13:39:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.116 13:39:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.116 13:39:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.116 13:39:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.116 13:39:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.116 13:39:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.116 13:39:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.116 13:39:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.116 13:39:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.116 13:39:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.116 13:39:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.116 13:39:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.116 13:39:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.116 13:39:16 -- scripts/common.sh@344 -- # : 1 00:05:36.116 13:39:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.116 13:39:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.116 13:39:16 -- scripts/common.sh@364 -- # decimal 1 00:05:36.116 13:39:16 -- scripts/common.sh@352 -- # local d=1 00:05:36.116 13:39:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.116 13:39:16 -- scripts/common.sh@354 -- # echo 1 00:05:36.116 13:39:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.116 13:39:16 -- scripts/common.sh@365 -- # decimal 2 00:05:36.116 13:39:16 -- scripts/common.sh@352 -- # local d=2 00:05:36.116 13:39:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.116 13:39:16 -- scripts/common.sh@354 -- # echo 2 00:05:36.116 13:39:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.116 13:39:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.116 13:39:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.116 13:39:16 -- scripts/common.sh@367 -- # return 0 00:05:36.116 13:39:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.116 --rc genhtml_branch_coverage=1 00:05:36.116 --rc genhtml_function_coverage=1 00:05:36.116 --rc genhtml_legend=1 00:05:36.116 --rc geninfo_all_blocks=1 00:05:36.116 --rc geninfo_unexecuted_blocks=1 00:05:36.116 00:05:36.116 ' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.116 --rc genhtml_branch_coverage=1 00:05:36.116 --rc genhtml_function_coverage=1 00:05:36.116 --rc genhtml_legend=1 00:05:36.116 --rc geninfo_all_blocks=1 00:05:36.116 --rc geninfo_unexecuted_blocks=1 00:05:36.116 00:05:36.116 ' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.116 --rc genhtml_branch_coverage=1 00:05:36.116 --rc genhtml_function_coverage=1 00:05:36.116 --rc genhtml_legend=1 00:05:36.116 --rc geninfo_all_blocks=1 00:05:36.116 --rc geninfo_unexecuted_blocks=1 00:05:36.116 00:05:36.116 ' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.116 --rc genhtml_branch_coverage=1 00:05:36.116 --rc genhtml_function_coverage=1 00:05:36.116 --rc genhtml_legend=1 00:05:36.116 --rc geninfo_all_blocks=1 00:05:36.116 --rc geninfo_unexecuted_blocks=1 00:05:36.116 00:05:36.116 ' 00:05:36.116 13:39:16 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:36.116 OK 00:05:36.116 13:39:16 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:36.116 00:05:36.116 real 0m0.155s 00:05:36.116 user 0m0.107s 00:05:36.116 sys 0m0.056s 00:05:36.116 13:39:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.116 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:36.116 ************************************ 00:05:36.116 END TEST rpc_client 00:05:36.116 ************************************ 00:05:36.116 13:39:16 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.116 13:39:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.116 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:36.116 ************************************ 00:05:36.116 START TEST json_config 00:05:36.116 ************************************ 00:05:36.116 13:39:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.116 13:39:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.116 13:39:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.116 13:39:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.116 13:39:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.116 13:39:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.116 13:39:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.116 13:39:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.116 13:39:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.116 13:39:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.116 13:39:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.117 13:39:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.117 13:39:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.117 13:39:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.117 13:39:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.117 13:39:16 -- scripts/common.sh@344 -- # : 1 00:05:36.117 13:39:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.117 13:39:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.117 13:39:16 -- scripts/common.sh@364 -- # decimal 1 00:05:36.117 13:39:16 -- scripts/common.sh@352 -- # local d=1 00:05:36.117 13:39:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.117 13:39:16 -- scripts/common.sh@354 -- # echo 1 00:05:36.117 13:39:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.117 13:39:16 -- scripts/common.sh@365 -- # decimal 2 00:05:36.117 13:39:16 -- scripts/common.sh@352 -- # local d=2 00:05:36.117 13:39:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.117 13:39:16 -- scripts/common.sh@354 -- # echo 2 00:05:36.117 13:39:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.117 13:39:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.117 13:39:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.117 13:39:16 -- scripts/common.sh@367 -- # return 0 00:05:36.117 13:39:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.117 13:39:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.117 --rc genhtml_branch_coverage=1 00:05:36.117 --rc genhtml_function_coverage=1 00:05:36.117 --rc genhtml_legend=1 00:05:36.117 --rc geninfo_all_blocks=1 00:05:36.117 --rc geninfo_unexecuted_blocks=1 00:05:36.117 00:05:36.117 ' 00:05:36.117 13:39:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.117 --rc genhtml_branch_coverage=1 00:05:36.117 --rc genhtml_function_coverage=1 00:05:36.117 --rc genhtml_legend=1 00:05:36.117 --rc geninfo_all_blocks=1 00:05:36.117 --rc geninfo_unexecuted_blocks=1 00:05:36.117 00:05:36.117 ' 00:05:36.117 13:39:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.117 --rc genhtml_branch_coverage=1 00:05:36.117 --rc genhtml_function_coverage=1 00:05:36.117 --rc genhtml_legend=1 00:05:36.117 --rc geninfo_all_blocks=1 00:05:36.117 --rc geninfo_unexecuted_blocks=1 00:05:36.117 00:05:36.117 ' 00:05:36.117 13:39:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.117 --rc genhtml_branch_coverage=1 00:05:36.117 --rc genhtml_function_coverage=1 00:05:36.117 --rc genhtml_legend=1 00:05:36.117 --rc geninfo_all_blocks=1 00:05:36.117 --rc geninfo_unexecuted_blocks=1 00:05:36.117 00:05:36.117 ' 00:05:36.117 13:39:16 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:36.117 13:39:16 -- nvmf/common.sh@7 -- # uname -s 00:05:36.117 13:39:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:36.117 13:39:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:36.117 13:39:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:36.117 13:39:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:36.117 13:39:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:36.117 13:39:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:36.117 13:39:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:36.117 13:39:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:36.117 13:39:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:36.376 13:39:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:36.376 13:39:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.376 13:39:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.376 13:39:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:36.376 13:39:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:36.376 13:39:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:36.376 13:39:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:36.376 13:39:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:36.376 13:39:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:36.376 13:39:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:36.376 13:39:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.376 13:39:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.376 13:39:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.376 13:39:16 -- paths/export.sh@5 -- # export PATH 00:05:36.376 13:39:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.376 13:39:16 -- nvmf/common.sh@46 -- # : 0 00:05:36.376 13:39:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:36.376 13:39:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:36.376 13:39:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:36.376 13:39:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:36.376 13:39:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:36.376 13:39:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:36.376 13:39:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:36.376 13:39:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:36.376 13:39:16 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:36.376 13:39:16 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:36.376 13:39:16 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:36.376 13:39:16 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:36.376 13:39:16 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:36.376 13:39:16 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:36.376 13:39:16 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:36.376 13:39:16 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:36.376 13:39:16 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:36.376 13:39:16 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:36.376 13:39:16 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:36.376 13:39:16 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:36.376 INFO: JSON configuration test init 00:05:36.376 13:39:16 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:36.376 13:39:16 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:36.376 13:39:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.376 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:36.376 13:39:16 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:36.376 13:39:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.376 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:36.376 13:39:16 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:36.376 13:39:16 -- json_config/json_config.sh@98 -- # local app=target 00:05:36.376 13:39:16 -- json_config/json_config.sh@99 -- # shift 00:05:36.376 13:39:16 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:36.376 13:39:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.376 13:39:16 -- json_config/json_config.sh@111 -- # app_pid[$app]=2174798 00:05:36.376 13:39:16 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:36.376 13:39:16 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:36.376 Waiting for target to run... 00:05:36.376 13:39:16 -- json_config/json_config.sh@114 -- # waitforlisten 2174798 /var/tmp/spdk_tgt.sock 00:05:36.376 13:39:16 -- common/autotest_common.sh@829 -- # '[' -z 2174798 ']' 00:05:36.376 13:39:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:36.376 13:39:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.376 13:39:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:36.376 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:36.376 13:39:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.376 13:39:16 -- common/autotest_common.sh@10 -- # set +x 00:05:36.376 [2024-11-29 13:39:16.473159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.376 [2024-11-29 13:39:16.473246] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2174798 ] 00:05:36.376 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.946 [2024-11-29 13:39:16.964327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.946 [2024-11-29 13:39:17.044064] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:36.946 [2024-11-29 13:39:17.044269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.238 13:39:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:37.238 13:39:17 -- common/autotest_common.sh@862 -- # return 0 00:05:37.238 13:39:17 -- json_config/json_config.sh@115 -- # echo '' 00:05:37.238 00:05:37.238 13:39:17 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:37.238 13:39:17 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:37.238 13:39:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:37.238 13:39:17 -- common/autotest_common.sh@10 -- # set +x 00:05:37.238 13:39:17 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:37.238 13:39:17 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:37.238 13:39:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:37.238 13:39:17 -- common/autotest_common.sh@10 -- # set +x 00:05:37.238 13:39:17 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:37.238 13:39:17 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:37.238 13:39:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:40.561 13:39:20 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:40.561 13:39:20 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:40.561 13:39:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.561 13:39:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.561 13:39:20 -- json_config/json_config.sh@48 -- # local ret=0 00:05:40.561 13:39:20 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:40.561 13:39:20 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:40.561 13:39:20 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:40.561 13:39:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:40.561 13:39:20 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:40.819 13:39:20 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:40.819 13:39:20 -- json_config/json_config.sh@51 -- # local get_types 00:05:40.819 13:39:20 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:40.819 13:39:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.819 13:39:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.819 13:39:20 -- json_config/json_config.sh@58 -- # return 0 00:05:40.819 13:39:20 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:40.819 13:39:20 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:40.819 13:39:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.819 13:39:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.819 13:39:20 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:40.819 13:39:20 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:40.819 13:39:20 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:40.819 13:39:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:41.077 MallocForNvmf0 00:05:41.077 13:39:21 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.077 13:39:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.336 MallocForNvmf1 00:05:41.336 13:39:21 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.336 13:39:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.596 [2024-11-29 13:39:21.642098] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:41.596 13:39:21 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:41.596 13:39:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:41.887 13:39:21 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:41.887 13:39:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:41.887 13:39:22 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:41.887 13:39:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:42.144 13:39:22 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:42.144 13:39:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:42.401 [2024-11-29 13:39:22.645417] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:42.401 13:39:22 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:42.401 13:39:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.401 13:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:42.401 13:39:22 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:42.401 13:39:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.401 13:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:42.659 13:39:22 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:42.659 13:39:22 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:42.659 13:39:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:42.916 MallocBdevForConfigChangeCheck 00:05:42.916 13:39:22 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:42.916 13:39:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.916 13:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:42.916 13:39:22 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:42.916 13:39:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:43.174 13:39:23 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:43.174 INFO: shutting down applications... 00:05:43.174 13:39:23 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:43.174 13:39:23 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:43.174 13:39:23 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:43.174 13:39:23 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:45.081 Calling clear_iscsi_subsystem 00:05:45.081 Calling clear_nvmf_subsystem 00:05:45.081 Calling clear_nbd_subsystem 00:05:45.081 Calling clear_ublk_subsystem 00:05:45.081 Calling clear_vhost_blk_subsystem 00:05:45.081 Calling clear_vhost_scsi_subsystem 00:05:45.081 Calling clear_scheduler_subsystem 00:05:45.081 Calling clear_bdev_subsystem 00:05:45.081 Calling clear_accel_subsystem 00:05:45.081 Calling clear_vmd_subsystem 00:05:45.081 Calling clear_sock_subsystem 00:05:45.081 Calling clear_iobuf_subsystem 00:05:45.081 13:39:24 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:45.081 13:39:24 -- json_config/json_config.sh@396 -- # count=100 00:05:45.081 13:39:24 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:45.081 13:39:24 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:45.081 13:39:24 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:45.081 13:39:24 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:45.081 13:39:25 -- json_config/json_config.sh@398 -- # break 00:05:45.081 13:39:25 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:45.081 13:39:25 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:45.081 13:39:25 -- json_config/json_config.sh@120 -- # local app=target 00:05:45.081 13:39:25 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:45.081 13:39:25 -- json_config/json_config.sh@124 -- # [[ -n 2174798 ]] 00:05:45.081 13:39:25 -- json_config/json_config.sh@127 -- # kill -SIGINT 2174798 00:05:45.081 13:39:25 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:45.081 13:39:25 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.081 13:39:25 -- json_config/json_config.sh@130 -- # kill -0 2174798 00:05:45.081 13:39:25 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:45.648 13:39:25 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:45.648 13:39:25 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.648 13:39:25 -- json_config/json_config.sh@130 -- # kill -0 2174798 00:05:45.648 13:39:25 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:45.648 13:39:25 -- json_config/json_config.sh@132 -- # break 00:05:45.648 13:39:25 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:45.648 13:39:25 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:45.648 SPDK target shutdown done 00:05:45.648 13:39:25 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:45.648 INFO: relaunching applications... 00:05:45.648 13:39:25 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:45.648 13:39:25 -- json_config/json_config.sh@98 -- # local app=target 00:05:45.648 13:39:25 -- json_config/json_config.sh@99 -- # shift 00:05:45.648 13:39:25 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:45.648 13:39:25 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:45.648 13:39:25 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:45.648 13:39:25 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:45.648 13:39:25 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:45.648 13:39:25 -- json_config/json_config.sh@111 -- # app_pid[$app]=2176151 00:05:45.648 13:39:25 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:45.648 13:39:25 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:45.648 Waiting for target to run... 00:05:45.648 13:39:25 -- json_config/json_config.sh@114 -- # waitforlisten 2176151 /var/tmp/spdk_tgt.sock 00:05:45.648 13:39:25 -- common/autotest_common.sh@829 -- # '[' -z 2176151 ']' 00:05:45.648 13:39:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:45.648 13:39:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:45.648 13:39:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:45.648 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:45.648 13:39:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:45.648 13:39:25 -- common/autotest_common.sh@10 -- # set +x 00:05:45.648 [2024-11-29 13:39:25.916780] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.648 [2024-11-29 13:39:25.916875] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2176151 ] 00:05:45.908 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.477 [2024-11-29 13:39:26.453912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.477 [2024-11-29 13:39:26.533540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:46.477 [2024-11-29 13:39:26.533755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.776 [2024-11-29 13:39:29.559498] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:49.776 [2024-11-29 13:39:29.591993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:49.776 13:39:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:49.776 13:39:29 -- common/autotest_common.sh@862 -- # return 0 00:05:49.776 13:39:29 -- json_config/json_config.sh@115 -- # echo '' 00:05:49.776 00:05:49.776 13:39:29 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:49.776 13:39:29 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:49.776 INFO: Checking if target configuration is the same... 00:05:49.776 13:39:29 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:49.776 13:39:29 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:49.776 13:39:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:49.776 + '[' 2 -ne 2 ']' 00:05:49.776 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:49.776 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:49.776 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:49.776 +++ basename /dev/fd/62 00:05:49.776 ++ mktemp /tmp/62.XXX 00:05:49.776 + tmp_file_1=/tmp/62.aen 00:05:49.776 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:49.776 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:49.776 + tmp_file_2=/tmp/spdk_tgt_config.json.LsN 00:05:49.776 + ret=0 00:05:49.776 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.034 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.292 + diff -u /tmp/62.aen /tmp/spdk_tgt_config.json.LsN 00:05:50.292 + echo 'INFO: JSON config files are the same' 00:05:50.292 INFO: JSON config files are the same 00:05:50.292 + rm /tmp/62.aen /tmp/spdk_tgt_config.json.LsN 00:05:50.292 + exit 0 00:05:50.292 13:39:30 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:50.292 13:39:30 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:50.292 INFO: changing configuration and checking if this can be detected... 00:05:50.292 13:39:30 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.292 13:39:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.551 13:39:30 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.551 13:39:30 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:50.551 13:39:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.551 + '[' 2 -ne 2 ']' 00:05:50.551 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:50.551 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:50.551 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:50.551 +++ basename /dev/fd/62 00:05:50.551 ++ mktemp /tmp/62.XXX 00:05:50.551 + tmp_file_1=/tmp/62.5Dy 00:05:50.551 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.551 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:50.551 + tmp_file_2=/tmp/spdk_tgt_config.json.Owb 00:05:50.551 + ret=0 00:05:50.552 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.810 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.810 + diff -u /tmp/62.5Dy /tmp/spdk_tgt_config.json.Owb 00:05:50.810 + ret=1 00:05:50.810 + echo '=== Start of file: /tmp/62.5Dy ===' 00:05:50.810 + cat /tmp/62.5Dy 00:05:50.810 + echo '=== End of file: /tmp/62.5Dy ===' 00:05:50.810 + echo '' 00:05:50.810 + echo '=== Start of file: /tmp/spdk_tgt_config.json.Owb ===' 00:05:50.810 + cat /tmp/spdk_tgt_config.json.Owb 00:05:50.810 + echo '=== End of file: /tmp/spdk_tgt_config.json.Owb ===' 00:05:50.810 + echo '' 00:05:50.810 + rm /tmp/62.5Dy /tmp/spdk_tgt_config.json.Owb 00:05:50.810 + exit 1 00:05:50.810 13:39:31 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:50.810 INFO: configuration change detected. 00:05:50.810 13:39:31 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:50.810 13:39:31 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:50.810 13:39:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.810 13:39:31 -- common/autotest_common.sh@10 -- # set +x 00:05:50.810 13:39:31 -- json_config/json_config.sh@360 -- # local ret=0 00:05:50.810 13:39:31 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:50.810 13:39:31 -- json_config/json_config.sh@370 -- # [[ -n 2176151 ]] 00:05:50.810 13:39:31 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:50.810 13:39:31 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:50.810 13:39:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.810 13:39:31 -- common/autotest_common.sh@10 -- # set +x 00:05:50.810 13:39:31 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:50.810 13:39:31 -- json_config/json_config.sh@246 -- # uname -s 00:05:50.810 13:39:31 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:50.810 13:39:31 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:50.810 13:39:31 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:50.810 13:39:31 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:50.810 13:39:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:50.810 13:39:31 -- common/autotest_common.sh@10 -- # set +x 00:05:50.810 13:39:31 -- json_config/json_config.sh@376 -- # killprocess 2176151 00:05:50.810 13:39:31 -- common/autotest_common.sh@936 -- # '[' -z 2176151 ']' 00:05:50.810 13:39:31 -- common/autotest_common.sh@940 -- # kill -0 2176151 00:05:50.810 13:39:31 -- common/autotest_common.sh@941 -- # uname 00:05:50.810 13:39:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:50.810 13:39:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2176151 00:05:51.068 13:39:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:51.069 13:39:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:51.069 13:39:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2176151' 00:05:51.069 killing process with pid 2176151 00:05:51.069 13:39:31 -- common/autotest_common.sh@955 -- # kill 2176151 00:05:51.069 13:39:31 -- common/autotest_common.sh@960 -- # wait 2176151 00:05:52.449 13:39:32 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.449 13:39:32 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:52.449 13:39:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:52.449 13:39:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.708 13:39:32 -- json_config/json_config.sh@381 -- # return 0 00:05:52.708 13:39:32 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:52.708 INFO: Success 00:05:52.708 00:05:52.708 real 0m16.472s 00:05:52.708 user 0m18.873s 00:05:52.708 sys 0m2.295s 00:05:52.708 13:39:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.708 13:39:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.708 ************************************ 00:05:52.708 END TEST json_config 00:05:52.708 ************************************ 00:05:52.708 13:39:32 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:52.708 13:39:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.708 13:39:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.708 ************************************ 00:05:52.708 START TEST json_config_extra_key 00:05:52.708 ************************************ 00:05:52.708 13:39:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:52.708 13:39:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:52.708 13:39:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:52.708 13:39:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:52.708 13:39:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:52.708 13:39:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:52.708 13:39:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:52.708 13:39:32 -- scripts/common.sh@335 -- # IFS=.-: 00:05:52.708 13:39:32 -- scripts/common.sh@335 -- # read -ra ver1 00:05:52.708 13:39:32 -- scripts/common.sh@336 -- # IFS=.-: 00:05:52.708 13:39:32 -- scripts/common.sh@336 -- # read -ra ver2 00:05:52.708 13:39:32 -- scripts/common.sh@337 -- # local 'op=<' 00:05:52.708 13:39:32 -- scripts/common.sh@339 -- # ver1_l=2 00:05:52.708 13:39:32 -- scripts/common.sh@340 -- # ver2_l=1 00:05:52.708 13:39:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:52.708 13:39:32 -- scripts/common.sh@343 -- # case "$op" in 00:05:52.708 13:39:32 -- scripts/common.sh@344 -- # : 1 00:05:52.708 13:39:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:52.708 13:39:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:52.708 13:39:32 -- scripts/common.sh@364 -- # decimal 1 00:05:52.708 13:39:32 -- scripts/common.sh@352 -- # local d=1 00:05:52.708 13:39:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:52.708 13:39:32 -- scripts/common.sh@354 -- # echo 1 00:05:52.708 13:39:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:52.708 13:39:32 -- scripts/common.sh@365 -- # decimal 2 00:05:52.708 13:39:32 -- scripts/common.sh@352 -- # local d=2 00:05:52.708 13:39:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:52.708 13:39:32 -- scripts/common.sh@354 -- # echo 2 00:05:52.708 13:39:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:52.708 13:39:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:52.708 13:39:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:52.708 13:39:32 -- scripts/common.sh@367 -- # return 0 00:05:52.708 13:39:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:52.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.708 --rc genhtml_branch_coverage=1 00:05:52.708 --rc genhtml_function_coverage=1 00:05:52.708 --rc genhtml_legend=1 00:05:52.708 --rc geninfo_all_blocks=1 00:05:52.708 --rc geninfo_unexecuted_blocks=1 00:05:52.708 00:05:52.708 ' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:52.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.708 --rc genhtml_branch_coverage=1 00:05:52.708 --rc genhtml_function_coverage=1 00:05:52.708 --rc genhtml_legend=1 00:05:52.708 --rc geninfo_all_blocks=1 00:05:52.708 --rc geninfo_unexecuted_blocks=1 00:05:52.708 00:05:52.708 ' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:52.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.708 --rc genhtml_branch_coverage=1 00:05:52.708 --rc genhtml_function_coverage=1 00:05:52.708 --rc genhtml_legend=1 00:05:52.708 --rc geninfo_all_blocks=1 00:05:52.708 --rc geninfo_unexecuted_blocks=1 00:05:52.708 00:05:52.708 ' 00:05:52.708 13:39:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:52.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.708 --rc genhtml_branch_coverage=1 00:05:52.708 --rc genhtml_function_coverage=1 00:05:52.708 --rc genhtml_legend=1 00:05:52.708 --rc geninfo_all_blocks=1 00:05:52.708 --rc geninfo_unexecuted_blocks=1 00:05:52.708 00:05:52.708 ' 00:05:52.708 13:39:32 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:52.708 13:39:32 -- nvmf/common.sh@7 -- # uname -s 00:05:52.708 13:39:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:52.708 13:39:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:52.708 13:39:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:52.708 13:39:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:52.708 13:39:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:52.708 13:39:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:52.708 13:39:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:52.708 13:39:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:52.708 13:39:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:52.708 13:39:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:52.709 13:39:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:52.709 13:39:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:52.709 13:39:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:52.709 13:39:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:52.709 13:39:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:52.709 13:39:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:52.709 13:39:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:52.709 13:39:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:52.709 13:39:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:52.709 13:39:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.709 13:39:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.709 13:39:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.709 13:39:32 -- paths/export.sh@5 -- # export PATH 00:05:52.709 13:39:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.709 13:39:32 -- nvmf/common.sh@46 -- # : 0 00:05:52.709 13:39:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:52.709 13:39:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:52.709 13:39:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:52.709 13:39:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:52.709 13:39:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:52.709 13:39:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:52.709 13:39:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:52.709 13:39:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:52.709 INFO: launching applications... 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2177099 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:52.709 Waiting for target to run... 00:05:52.709 13:39:32 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2177099 /var/tmp/spdk_tgt.sock 00:05:52.709 13:39:32 -- common/autotest_common.sh@829 -- # '[' -z 2177099 ']' 00:05:52.709 13:39:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:52.709 13:39:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.709 13:39:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:52.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:52.709 13:39:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.709 13:39:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.709 [2024-11-29 13:39:32.967493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.709 [2024-11-29 13:39:32.967591] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2177099 ] 00:05:52.968 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.226 [2024-11-29 13:39:33.321614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.226 [2024-11-29 13:39:33.382903] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.226 [2024-11-29 13:39:33.383091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.819 13:39:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:53.819 13:39:33 -- common/autotest_common.sh@862 -- # return 0 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:53.819 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:53.819 INFO: shutting down applications... 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2177099 ]] 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2177099 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:53.819 13:39:33 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:53.820 13:39:33 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2177099 00:05:53.820 13:39:33 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2177099 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:54.389 SPDK target shutdown done 00:05:54.389 13:39:34 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:54.389 Success 00:05:54.389 00:05:54.389 real 0m1.662s 00:05:54.389 user 0m1.635s 00:05:54.389 sys 0m0.463s 00:05:54.389 13:39:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.389 13:39:34 -- common/autotest_common.sh@10 -- # set +x 00:05:54.389 ************************************ 00:05:54.389 END TEST json_config_extra_key 00:05:54.389 ************************************ 00:05:54.389 13:39:34 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.389 13:39:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.389 13:39:34 -- common/autotest_common.sh@10 -- # set +x 00:05:54.389 ************************************ 00:05:54.389 START TEST alias_rpc 00:05:54.389 ************************************ 00:05:54.389 13:39:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.389 * Looking for test storage... 00:05:54.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:54.389 13:39:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:54.389 13:39:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:54.389 13:39:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:54.389 13:39:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:54.389 13:39:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:54.389 13:39:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:54.389 13:39:34 -- scripts/common.sh@335 -- # IFS=.-: 00:05:54.389 13:39:34 -- scripts/common.sh@335 -- # read -ra ver1 00:05:54.389 13:39:34 -- scripts/common.sh@336 -- # IFS=.-: 00:05:54.389 13:39:34 -- scripts/common.sh@336 -- # read -ra ver2 00:05:54.389 13:39:34 -- scripts/common.sh@337 -- # local 'op=<' 00:05:54.389 13:39:34 -- scripts/common.sh@339 -- # ver1_l=2 00:05:54.389 13:39:34 -- scripts/common.sh@340 -- # ver2_l=1 00:05:54.389 13:39:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:54.389 13:39:34 -- scripts/common.sh@343 -- # case "$op" in 00:05:54.389 13:39:34 -- scripts/common.sh@344 -- # : 1 00:05:54.389 13:39:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:54.389 13:39:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:54.389 13:39:34 -- scripts/common.sh@364 -- # decimal 1 00:05:54.389 13:39:34 -- scripts/common.sh@352 -- # local d=1 00:05:54.389 13:39:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:54.389 13:39:34 -- scripts/common.sh@354 -- # echo 1 00:05:54.389 13:39:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:54.389 13:39:34 -- scripts/common.sh@365 -- # decimal 2 00:05:54.389 13:39:34 -- scripts/common.sh@352 -- # local d=2 00:05:54.389 13:39:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:54.389 13:39:34 -- scripts/common.sh@354 -- # echo 2 00:05:54.389 13:39:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:54.389 13:39:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:54.389 13:39:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:54.389 13:39:34 -- scripts/common.sh@367 -- # return 0 00:05:54.389 13:39:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:54.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.389 --rc genhtml_branch_coverage=1 00:05:54.389 --rc genhtml_function_coverage=1 00:05:54.389 --rc genhtml_legend=1 00:05:54.389 --rc geninfo_all_blocks=1 00:05:54.389 --rc geninfo_unexecuted_blocks=1 00:05:54.389 00:05:54.389 ' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:54.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.389 --rc genhtml_branch_coverage=1 00:05:54.389 --rc genhtml_function_coverage=1 00:05:54.389 --rc genhtml_legend=1 00:05:54.389 --rc geninfo_all_blocks=1 00:05:54.389 --rc geninfo_unexecuted_blocks=1 00:05:54.389 00:05:54.389 ' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:54.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.389 --rc genhtml_branch_coverage=1 00:05:54.389 --rc genhtml_function_coverage=1 00:05:54.389 --rc genhtml_legend=1 00:05:54.389 --rc geninfo_all_blocks=1 00:05:54.389 --rc geninfo_unexecuted_blocks=1 00:05:54.389 00:05:54.389 ' 00:05:54.389 13:39:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:54.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.389 --rc genhtml_branch_coverage=1 00:05:54.389 --rc genhtml_function_coverage=1 00:05:54.389 --rc genhtml_legend=1 00:05:54.389 --rc geninfo_all_blocks=1 00:05:54.389 --rc geninfo_unexecuted_blocks=1 00:05:54.389 00:05:54.389 ' 00:05:54.389 13:39:34 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:54.389 13:39:34 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2177370 00:05:54.389 13:39:34 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.389 13:39:34 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2177370 00:05:54.389 13:39:34 -- common/autotest_common.sh@829 -- # '[' -z 2177370 ']' 00:05:54.389 13:39:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.389 13:39:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:54.389 13:39:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.389 13:39:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:54.390 13:39:34 -- common/autotest_common.sh@10 -- # set +x 00:05:54.390 [2024-11-29 13:39:34.669223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.390 [2024-11-29 13:39:34.669320] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2177370 ] 00:05:54.648 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.648 [2024-11-29 13:39:34.730182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.648 [2024-11-29 13:39:34.815993] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:54.648 [2024-11-29 13:39:34.816173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.592 13:39:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:55.592 13:39:35 -- common/autotest_common.sh@862 -- # return 0 00:05:55.592 13:39:35 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:55.853 13:39:35 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2177370 00:05:55.853 13:39:35 -- common/autotest_common.sh@936 -- # '[' -z 2177370 ']' 00:05:55.853 13:39:35 -- common/autotest_common.sh@940 -- # kill -0 2177370 00:05:55.853 13:39:35 -- common/autotest_common.sh@941 -- # uname 00:05:55.853 13:39:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.853 13:39:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2177370 00:05:55.853 13:39:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.853 13:39:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.853 13:39:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2177370' 00:05:55.853 killing process with pid 2177370 00:05:55.853 13:39:35 -- common/autotest_common.sh@955 -- # kill 2177370 00:05:55.853 13:39:35 -- common/autotest_common.sh@960 -- # wait 2177370 00:05:56.112 00:05:56.112 real 0m1.904s 00:05:56.112 user 0m2.213s 00:05:56.112 sys 0m0.470s 00:05:56.112 13:39:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.112 13:39:36 -- common/autotest_common.sh@10 -- # set +x 00:05:56.112 ************************************ 00:05:56.112 END TEST alias_rpc 00:05:56.112 ************************************ 00:05:56.112 13:39:36 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:56.112 13:39:36 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.112 13:39:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.112 13:39:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.112 13:39:36 -- common/autotest_common.sh@10 -- # set +x 00:05:56.112 ************************************ 00:05:56.112 START TEST spdkcli_tcp 00:05:56.112 ************************************ 00:05:56.112 13:39:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.371 * Looking for test storage... 00:05:56.371 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:56.371 13:39:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.371 13:39:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.371 13:39:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.371 13:39:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.371 13:39:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.371 13:39:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.371 13:39:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.371 13:39:36 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.371 13:39:36 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.371 13:39:36 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.371 13:39:36 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.371 13:39:36 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.371 13:39:36 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.371 13:39:36 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.371 13:39:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.371 13:39:36 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.371 13:39:36 -- scripts/common.sh@344 -- # : 1 00:05:56.371 13:39:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.371 13:39:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.371 13:39:36 -- scripts/common.sh@364 -- # decimal 1 00:05:56.371 13:39:36 -- scripts/common.sh@352 -- # local d=1 00:05:56.371 13:39:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.371 13:39:36 -- scripts/common.sh@354 -- # echo 1 00:05:56.371 13:39:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.371 13:39:36 -- scripts/common.sh@365 -- # decimal 2 00:05:56.371 13:39:36 -- scripts/common.sh@352 -- # local d=2 00:05:56.371 13:39:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.371 13:39:36 -- scripts/common.sh@354 -- # echo 2 00:05:56.371 13:39:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.371 13:39:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.371 13:39:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.371 13:39:36 -- scripts/common.sh@367 -- # return 0 00:05:56.371 13:39:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.371 13:39:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.371 --rc genhtml_branch_coverage=1 00:05:56.371 --rc genhtml_function_coverage=1 00:05:56.371 --rc genhtml_legend=1 00:05:56.371 --rc geninfo_all_blocks=1 00:05:56.371 --rc geninfo_unexecuted_blocks=1 00:05:56.371 00:05:56.371 ' 00:05:56.371 13:39:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.371 --rc genhtml_branch_coverage=1 00:05:56.371 --rc genhtml_function_coverage=1 00:05:56.371 --rc genhtml_legend=1 00:05:56.371 --rc geninfo_all_blocks=1 00:05:56.371 --rc geninfo_unexecuted_blocks=1 00:05:56.371 00:05:56.371 ' 00:05:56.371 13:39:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.371 --rc genhtml_branch_coverage=1 00:05:56.371 --rc genhtml_function_coverage=1 00:05:56.371 --rc genhtml_legend=1 00:05:56.371 --rc geninfo_all_blocks=1 00:05:56.371 --rc geninfo_unexecuted_blocks=1 00:05:56.371 00:05:56.371 ' 00:05:56.371 13:39:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.371 --rc genhtml_branch_coverage=1 00:05:56.371 --rc genhtml_function_coverage=1 00:05:56.371 --rc genhtml_legend=1 00:05:56.371 --rc geninfo_all_blocks=1 00:05:56.371 --rc geninfo_unexecuted_blocks=1 00:05:56.371 00:05:56.371 ' 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:56.371 13:39:36 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:56.371 13:39:36 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:56.371 13:39:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.371 13:39:36 -- common/autotest_common.sh@10 -- # set +x 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2177628 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:56.371 13:39:36 -- spdkcli/tcp.sh@27 -- # waitforlisten 2177628 00:05:56.371 13:39:36 -- common/autotest_common.sh@829 -- # '[' -z 2177628 ']' 00:05:56.371 13:39:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.371 13:39:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.371 13:39:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.371 13:39:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.371 13:39:36 -- common/autotest_common.sh@10 -- # set +x 00:05:56.371 [2024-11-29 13:39:36.583896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.371 [2024-11-29 13:39:36.584002] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2177628 ] 00:05:56.371 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.371 [2024-11-29 13:39:36.642205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.630 [2024-11-29 13:39:36.728235] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:56.630 [2024-11-29 13:39:36.728459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.630 [2024-11-29 13:39:36.728465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.568 13:39:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.568 13:39:37 -- common/autotest_common.sh@862 -- # return 0 00:05:57.568 13:39:37 -- spdkcli/tcp.sh@31 -- # socat_pid=2177769 00:05:57.568 13:39:37 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:57.568 13:39:37 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:57.568 [ 00:05:57.568 "bdev_malloc_delete", 00:05:57.568 "bdev_malloc_create", 00:05:57.568 "bdev_null_resize", 00:05:57.568 "bdev_null_delete", 00:05:57.568 "bdev_null_create", 00:05:57.568 "bdev_nvme_cuse_unregister", 00:05:57.568 "bdev_nvme_cuse_register", 00:05:57.568 "bdev_opal_new_user", 00:05:57.568 "bdev_opal_set_lock_state", 00:05:57.568 "bdev_opal_delete", 00:05:57.568 "bdev_opal_get_info", 00:05:57.568 "bdev_opal_create", 00:05:57.568 "bdev_nvme_opal_revert", 00:05:57.568 "bdev_nvme_opal_init", 00:05:57.568 "bdev_nvme_send_cmd", 00:05:57.568 "bdev_nvme_get_path_iostat", 00:05:57.568 "bdev_nvme_get_mdns_discovery_info", 00:05:57.568 "bdev_nvme_stop_mdns_discovery", 00:05:57.568 "bdev_nvme_start_mdns_discovery", 00:05:57.568 "bdev_nvme_set_multipath_policy", 00:05:57.568 "bdev_nvme_set_preferred_path", 00:05:57.568 "bdev_nvme_get_io_paths", 00:05:57.568 "bdev_nvme_remove_error_injection", 00:05:57.568 "bdev_nvme_add_error_injection", 00:05:57.568 "bdev_nvme_get_discovery_info", 00:05:57.568 "bdev_nvme_stop_discovery", 00:05:57.568 "bdev_nvme_start_discovery", 00:05:57.568 "bdev_nvme_get_controller_health_info", 00:05:57.568 "bdev_nvme_disable_controller", 00:05:57.568 "bdev_nvme_enable_controller", 00:05:57.568 "bdev_nvme_reset_controller", 00:05:57.568 "bdev_nvme_get_transport_statistics", 00:05:57.568 "bdev_nvme_apply_firmware", 00:05:57.568 "bdev_nvme_detach_controller", 00:05:57.568 "bdev_nvme_get_controllers", 00:05:57.568 "bdev_nvme_attach_controller", 00:05:57.568 "bdev_nvme_set_hotplug", 00:05:57.568 "bdev_nvme_set_options", 00:05:57.568 "bdev_passthru_delete", 00:05:57.568 "bdev_passthru_create", 00:05:57.568 "bdev_lvol_grow_lvstore", 00:05:57.568 "bdev_lvol_get_lvols", 00:05:57.568 "bdev_lvol_get_lvstores", 00:05:57.568 "bdev_lvol_delete", 00:05:57.568 "bdev_lvol_set_read_only", 00:05:57.568 "bdev_lvol_resize", 00:05:57.568 "bdev_lvol_decouple_parent", 00:05:57.568 "bdev_lvol_inflate", 00:05:57.568 "bdev_lvol_rename", 00:05:57.568 "bdev_lvol_clone_bdev", 00:05:57.568 "bdev_lvol_clone", 00:05:57.568 "bdev_lvol_snapshot", 00:05:57.568 "bdev_lvol_create", 00:05:57.568 "bdev_lvol_delete_lvstore", 00:05:57.568 "bdev_lvol_rename_lvstore", 00:05:57.568 "bdev_lvol_create_lvstore", 00:05:57.568 "bdev_raid_set_options", 00:05:57.568 "bdev_raid_remove_base_bdev", 00:05:57.568 "bdev_raid_add_base_bdev", 00:05:57.568 "bdev_raid_delete", 00:05:57.568 "bdev_raid_create", 00:05:57.568 "bdev_raid_get_bdevs", 00:05:57.568 "bdev_error_inject_error", 00:05:57.568 "bdev_error_delete", 00:05:57.568 "bdev_error_create", 00:05:57.568 "bdev_split_delete", 00:05:57.568 "bdev_split_create", 00:05:57.568 "bdev_delay_delete", 00:05:57.568 "bdev_delay_create", 00:05:57.568 "bdev_delay_update_latency", 00:05:57.568 "bdev_zone_block_delete", 00:05:57.568 "bdev_zone_block_create", 00:05:57.568 "blobfs_create", 00:05:57.568 "blobfs_detect", 00:05:57.568 "blobfs_set_cache_size", 00:05:57.569 "bdev_aio_delete", 00:05:57.569 "bdev_aio_rescan", 00:05:57.569 "bdev_aio_create", 00:05:57.569 "bdev_ftl_set_property", 00:05:57.569 "bdev_ftl_get_properties", 00:05:57.569 "bdev_ftl_get_stats", 00:05:57.569 "bdev_ftl_unmap", 00:05:57.569 "bdev_ftl_unload", 00:05:57.569 "bdev_ftl_delete", 00:05:57.569 "bdev_ftl_load", 00:05:57.569 "bdev_ftl_create", 00:05:57.569 "bdev_virtio_attach_controller", 00:05:57.569 "bdev_virtio_scsi_get_devices", 00:05:57.569 "bdev_virtio_detach_controller", 00:05:57.569 "bdev_virtio_blk_set_hotplug", 00:05:57.569 "bdev_iscsi_delete", 00:05:57.569 "bdev_iscsi_create", 00:05:57.569 "bdev_iscsi_set_options", 00:05:57.569 "accel_error_inject_error", 00:05:57.569 "ioat_scan_accel_module", 00:05:57.569 "dsa_scan_accel_module", 00:05:57.569 "iaa_scan_accel_module", 00:05:57.569 "vfu_virtio_create_scsi_endpoint", 00:05:57.569 "vfu_virtio_scsi_remove_target", 00:05:57.569 "vfu_virtio_scsi_add_target", 00:05:57.569 "vfu_virtio_create_blk_endpoint", 00:05:57.569 "vfu_virtio_delete_endpoint", 00:05:57.569 "iscsi_set_options", 00:05:57.569 "iscsi_get_auth_groups", 00:05:57.569 "iscsi_auth_group_remove_secret", 00:05:57.569 "iscsi_auth_group_add_secret", 00:05:57.569 "iscsi_delete_auth_group", 00:05:57.569 "iscsi_create_auth_group", 00:05:57.569 "iscsi_set_discovery_auth", 00:05:57.569 "iscsi_get_options", 00:05:57.569 "iscsi_target_node_request_logout", 00:05:57.569 "iscsi_target_node_set_redirect", 00:05:57.569 "iscsi_target_node_set_auth", 00:05:57.569 "iscsi_target_node_add_lun", 00:05:57.569 "iscsi_get_connections", 00:05:57.569 "iscsi_portal_group_set_auth", 00:05:57.569 "iscsi_start_portal_group", 00:05:57.569 "iscsi_delete_portal_group", 00:05:57.569 "iscsi_create_portal_group", 00:05:57.569 "iscsi_get_portal_groups", 00:05:57.569 "iscsi_delete_target_node", 00:05:57.569 "iscsi_target_node_remove_pg_ig_maps", 00:05:57.569 "iscsi_target_node_add_pg_ig_maps", 00:05:57.569 "iscsi_create_target_node", 00:05:57.569 "iscsi_get_target_nodes", 00:05:57.569 "iscsi_delete_initiator_group", 00:05:57.569 "iscsi_initiator_group_remove_initiators", 00:05:57.569 "iscsi_initiator_group_add_initiators", 00:05:57.569 "iscsi_create_initiator_group", 00:05:57.569 "iscsi_get_initiator_groups", 00:05:57.569 "nvmf_set_crdt", 00:05:57.569 "nvmf_set_config", 00:05:57.569 "nvmf_set_max_subsystems", 00:05:57.569 "nvmf_subsystem_get_listeners", 00:05:57.569 "nvmf_subsystem_get_qpairs", 00:05:57.569 "nvmf_subsystem_get_controllers", 00:05:57.569 "nvmf_get_stats", 00:05:57.569 "nvmf_get_transports", 00:05:57.569 "nvmf_create_transport", 00:05:57.569 "nvmf_get_targets", 00:05:57.569 "nvmf_delete_target", 00:05:57.569 "nvmf_create_target", 00:05:57.569 "nvmf_subsystem_allow_any_host", 00:05:57.569 "nvmf_subsystem_remove_host", 00:05:57.569 "nvmf_subsystem_add_host", 00:05:57.569 "nvmf_subsystem_remove_ns", 00:05:57.569 "nvmf_subsystem_add_ns", 00:05:57.569 "nvmf_subsystem_listener_set_ana_state", 00:05:57.569 "nvmf_discovery_get_referrals", 00:05:57.569 "nvmf_discovery_remove_referral", 00:05:57.569 "nvmf_discovery_add_referral", 00:05:57.569 "nvmf_subsystem_remove_listener", 00:05:57.569 "nvmf_subsystem_add_listener", 00:05:57.569 "nvmf_delete_subsystem", 00:05:57.569 "nvmf_create_subsystem", 00:05:57.569 "nvmf_get_subsystems", 00:05:57.569 "env_dpdk_get_mem_stats", 00:05:57.569 "nbd_get_disks", 00:05:57.569 "nbd_stop_disk", 00:05:57.569 "nbd_start_disk", 00:05:57.569 "ublk_recover_disk", 00:05:57.569 "ublk_get_disks", 00:05:57.569 "ublk_stop_disk", 00:05:57.569 "ublk_start_disk", 00:05:57.569 "ublk_destroy_target", 00:05:57.569 "ublk_create_target", 00:05:57.569 "virtio_blk_create_transport", 00:05:57.569 "virtio_blk_get_transports", 00:05:57.569 "vhost_controller_set_coalescing", 00:05:57.569 "vhost_get_controllers", 00:05:57.569 "vhost_delete_controller", 00:05:57.569 "vhost_create_blk_controller", 00:05:57.569 "vhost_scsi_controller_remove_target", 00:05:57.569 "vhost_scsi_controller_add_target", 00:05:57.569 "vhost_start_scsi_controller", 00:05:57.569 "vhost_create_scsi_controller", 00:05:57.569 "thread_set_cpumask", 00:05:57.569 "framework_get_scheduler", 00:05:57.569 "framework_set_scheduler", 00:05:57.569 "framework_get_reactors", 00:05:57.569 "thread_get_io_channels", 00:05:57.569 "thread_get_pollers", 00:05:57.569 "thread_get_stats", 00:05:57.569 "framework_monitor_context_switch", 00:05:57.569 "spdk_kill_instance", 00:05:57.569 "log_enable_timestamps", 00:05:57.569 "log_get_flags", 00:05:57.569 "log_clear_flag", 00:05:57.569 "log_set_flag", 00:05:57.569 "log_get_level", 00:05:57.569 "log_set_level", 00:05:57.569 "log_get_print_level", 00:05:57.569 "log_set_print_level", 00:05:57.569 "framework_enable_cpumask_locks", 00:05:57.569 "framework_disable_cpumask_locks", 00:05:57.569 "framework_wait_init", 00:05:57.569 "framework_start_init", 00:05:57.569 "scsi_get_devices", 00:05:57.569 "bdev_get_histogram", 00:05:57.569 "bdev_enable_histogram", 00:05:57.569 "bdev_set_qos_limit", 00:05:57.569 "bdev_set_qd_sampling_period", 00:05:57.569 "bdev_get_bdevs", 00:05:57.569 "bdev_reset_iostat", 00:05:57.569 "bdev_get_iostat", 00:05:57.569 "bdev_examine", 00:05:57.569 "bdev_wait_for_examine", 00:05:57.569 "bdev_set_options", 00:05:57.569 "notify_get_notifications", 00:05:57.569 "notify_get_types", 00:05:57.569 "accel_get_stats", 00:05:57.569 "accel_set_options", 00:05:57.569 "accel_set_driver", 00:05:57.569 "accel_crypto_key_destroy", 00:05:57.569 "accel_crypto_keys_get", 00:05:57.569 "accel_crypto_key_create", 00:05:57.569 "accel_assign_opc", 00:05:57.569 "accel_get_module_info", 00:05:57.569 "accel_get_opc_assignments", 00:05:57.569 "vmd_rescan", 00:05:57.569 "vmd_remove_device", 00:05:57.569 "vmd_enable", 00:05:57.569 "sock_set_default_impl", 00:05:57.569 "sock_impl_set_options", 00:05:57.569 "sock_impl_get_options", 00:05:57.569 "iobuf_get_stats", 00:05:57.569 "iobuf_set_options", 00:05:57.569 "framework_get_pci_devices", 00:05:57.569 "framework_get_config", 00:05:57.569 "framework_get_subsystems", 00:05:57.569 "vfu_tgt_set_base_path", 00:05:57.569 "trace_get_info", 00:05:57.569 "trace_get_tpoint_group_mask", 00:05:57.569 "trace_disable_tpoint_group", 00:05:57.569 "trace_enable_tpoint_group", 00:05:57.569 "trace_clear_tpoint_mask", 00:05:57.569 "trace_set_tpoint_mask", 00:05:57.569 "spdk_get_version", 00:05:57.569 "rpc_get_methods" 00:05:57.569 ] 00:05:57.569 13:39:37 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:57.569 13:39:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:57.569 13:39:37 -- common/autotest_common.sh@10 -- # set +x 00:05:57.569 13:39:37 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:57.569 13:39:37 -- spdkcli/tcp.sh@38 -- # killprocess 2177628 00:05:57.569 13:39:37 -- common/autotest_common.sh@936 -- # '[' -z 2177628 ']' 00:05:57.569 13:39:37 -- common/autotest_common.sh@940 -- # kill -0 2177628 00:05:57.569 13:39:37 -- common/autotest_common.sh@941 -- # uname 00:05:57.569 13:39:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:57.569 13:39:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2177628 00:05:57.829 13:39:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:57.829 13:39:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:57.829 13:39:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2177628' 00:05:57.829 killing process with pid 2177628 00:05:57.829 13:39:37 -- common/autotest_common.sh@955 -- # kill 2177628 00:05:57.829 13:39:37 -- common/autotest_common.sh@960 -- # wait 2177628 00:05:58.090 00:05:58.090 real 0m1.844s 00:05:58.090 user 0m3.540s 00:05:58.090 sys 0m0.503s 00:05:58.090 13:39:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.090 13:39:38 -- common/autotest_common.sh@10 -- # set +x 00:05:58.090 ************************************ 00:05:58.090 END TEST spdkcli_tcp 00:05:58.090 ************************************ 00:05:58.090 13:39:38 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:58.090 13:39:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.090 13:39:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.090 13:39:38 -- common/autotest_common.sh@10 -- # set +x 00:05:58.090 ************************************ 00:05:58.090 START TEST dpdk_mem_utility 00:05:58.091 ************************************ 00:05:58.091 13:39:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:58.091 * Looking for test storage... 00:05:58.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:58.091 13:39:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:58.091 13:39:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:58.091 13:39:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:58.349 13:39:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:58.349 13:39:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:58.349 13:39:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:58.349 13:39:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:58.349 13:39:38 -- scripts/common.sh@335 -- # IFS=.-: 00:05:58.349 13:39:38 -- scripts/common.sh@335 -- # read -ra ver1 00:05:58.349 13:39:38 -- scripts/common.sh@336 -- # IFS=.-: 00:05:58.349 13:39:38 -- scripts/common.sh@336 -- # read -ra ver2 00:05:58.349 13:39:38 -- scripts/common.sh@337 -- # local 'op=<' 00:05:58.349 13:39:38 -- scripts/common.sh@339 -- # ver1_l=2 00:05:58.349 13:39:38 -- scripts/common.sh@340 -- # ver2_l=1 00:05:58.349 13:39:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:58.349 13:39:38 -- scripts/common.sh@343 -- # case "$op" in 00:05:58.349 13:39:38 -- scripts/common.sh@344 -- # : 1 00:05:58.349 13:39:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:58.349 13:39:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:58.349 13:39:38 -- scripts/common.sh@364 -- # decimal 1 00:05:58.349 13:39:38 -- scripts/common.sh@352 -- # local d=1 00:05:58.349 13:39:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:58.349 13:39:38 -- scripts/common.sh@354 -- # echo 1 00:05:58.349 13:39:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:58.349 13:39:38 -- scripts/common.sh@365 -- # decimal 2 00:05:58.349 13:39:38 -- scripts/common.sh@352 -- # local d=2 00:05:58.349 13:39:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:58.349 13:39:38 -- scripts/common.sh@354 -- # echo 2 00:05:58.349 13:39:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:58.349 13:39:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:58.349 13:39:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:58.349 13:39:38 -- scripts/common.sh@367 -- # return 0 00:05:58.349 13:39:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:58.349 13:39:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:58.349 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.349 --rc genhtml_branch_coverage=1 00:05:58.349 --rc genhtml_function_coverage=1 00:05:58.349 --rc genhtml_legend=1 00:05:58.349 --rc geninfo_all_blocks=1 00:05:58.349 --rc geninfo_unexecuted_blocks=1 00:05:58.349 00:05:58.349 ' 00:05:58.349 13:39:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:58.349 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.349 --rc genhtml_branch_coverage=1 00:05:58.349 --rc genhtml_function_coverage=1 00:05:58.349 --rc genhtml_legend=1 00:05:58.349 --rc geninfo_all_blocks=1 00:05:58.349 --rc geninfo_unexecuted_blocks=1 00:05:58.349 00:05:58.349 ' 00:05:58.349 13:39:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:58.349 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.349 --rc genhtml_branch_coverage=1 00:05:58.349 --rc genhtml_function_coverage=1 00:05:58.349 --rc genhtml_legend=1 00:05:58.349 --rc geninfo_all_blocks=1 00:05:58.349 --rc geninfo_unexecuted_blocks=1 00:05:58.349 00:05:58.349 ' 00:05:58.349 13:39:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:58.349 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.349 --rc genhtml_branch_coverage=1 00:05:58.349 --rc genhtml_function_coverage=1 00:05:58.349 --rc genhtml_legend=1 00:05:58.349 --rc geninfo_all_blocks=1 00:05:58.349 --rc geninfo_unexecuted_blocks=1 00:05:58.349 00:05:58.349 ' 00:05:58.349 13:39:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:58.349 13:39:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2177970 00:05:58.349 13:39:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:58.349 13:39:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2177970 00:05:58.349 13:39:38 -- common/autotest_common.sh@829 -- # '[' -z 2177970 ']' 00:05:58.349 13:39:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:58.349 13:39:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.349 13:39:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:58.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:58.349 13:39:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.349 13:39:38 -- common/autotest_common.sh@10 -- # set +x 00:05:58.349 [2024-11-29 13:39:38.434184] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.349 [2024-11-29 13:39:38.434277] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2177970 ] 00:05:58.349 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.349 [2024-11-29 13:39:38.492726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.349 [2024-11-29 13:39:38.577377] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.349 [2024-11-29 13:39:38.577566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.289 13:39:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.289 13:39:39 -- common/autotest_common.sh@862 -- # return 0 00:05:59.289 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:59.289 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:59.289 13:39:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:59.289 13:39:39 -- common/autotest_common.sh@10 -- # set +x 00:05:59.289 { 00:05:59.289 "filename": "/tmp/spdk_mem_dump.txt" 00:05:59.289 } 00:05:59.289 13:39:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:59.289 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:59.289 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:59.289 1 heaps totaling size 814.000000 MiB 00:05:59.289 size: 814.000000 MiB heap id: 0 00:05:59.289 end heaps---------- 00:05:59.289 8 mempools totaling size 598.116089 MiB 00:05:59.289 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:59.289 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:59.289 size: 84.521057 MiB name: bdev_io_2177970 00:05:59.289 size: 51.011292 MiB name: evtpool_2177970 00:05:59.289 size: 50.003479 MiB name: msgpool_2177970 00:05:59.289 size: 21.763794 MiB name: PDU_Pool 00:05:59.289 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:59.289 size: 0.026123 MiB name: Session_Pool 00:05:59.289 end mempools------- 00:05:59.289 6 memzones totaling size 4.142822 MiB 00:05:59.289 size: 1.000366 MiB name: RG_ring_0_2177970 00:05:59.289 size: 1.000366 MiB name: RG_ring_1_2177970 00:05:59.289 size: 1.000366 MiB name: RG_ring_4_2177970 00:05:59.289 size: 1.000366 MiB name: RG_ring_5_2177970 00:05:59.289 size: 0.125366 MiB name: RG_ring_2_2177970 00:05:59.289 size: 0.015991 MiB name: RG_ring_3_2177970 00:05:59.289 end memzones------- 00:05:59.289 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:59.289 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:59.289 list of free elements. size: 12.519348 MiB 00:05:59.289 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:59.289 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:59.289 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:59.289 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:59.289 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:59.289 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:59.289 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:59.289 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:59.289 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:59.289 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:59.289 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:59.289 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:59.289 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:59.289 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:59.289 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:59.289 list of standard malloc elements. size: 199.218079 MiB 00:05:59.289 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:59.289 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:59.289 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:59.289 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:59.289 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:59.289 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:59.289 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:59.289 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:59.289 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:59.289 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:59.289 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:59.289 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:59.289 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:59.289 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:59.289 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:59.289 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:59.289 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:59.289 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:59.290 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:59.290 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:59.290 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:59.290 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:59.290 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:59.290 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:59.290 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:59.290 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:59.290 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:59.290 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:59.290 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:59.290 list of memzone associated elements. size: 602.262573 MiB 00:05:59.290 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:59.290 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:59.290 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:59.290 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:59.290 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:59.290 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2177970_0 00:05:59.290 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:59.290 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2177970_0 00:05:59.290 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:59.290 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2177970_0 00:05:59.290 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:59.290 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:59.290 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:59.290 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:59.290 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:59.290 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2177970 00:05:59.290 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:59.290 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2177970 00:05:59.290 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:59.290 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2177970 00:05:59.290 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:59.290 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:59.290 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:59.290 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:59.290 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:59.290 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:59.290 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:59.290 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:59.290 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:59.290 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2177970 00:05:59.290 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:59.290 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2177970 00:05:59.290 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:59.290 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2177970 00:05:59.290 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:59.290 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2177970 00:05:59.290 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:59.290 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2177970 00:05:59.290 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:59.290 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:59.290 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:59.290 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:59.290 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:59.290 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:59.290 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:59.290 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2177970 00:05:59.290 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:59.290 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:59.290 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:59.290 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:59.290 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:59.290 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2177970 00:05:59.290 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:59.290 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:59.290 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:59.290 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2177970 00:05:59.290 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:59.290 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2177970 00:05:59.290 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:59.290 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:59.290 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:59.290 13:39:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2177970 00:05:59.290 13:39:39 -- common/autotest_common.sh@936 -- # '[' -z 2177970 ']' 00:05:59.290 13:39:39 -- common/autotest_common.sh@940 -- # kill -0 2177970 00:05:59.290 13:39:39 -- common/autotest_common.sh@941 -- # uname 00:05:59.290 13:39:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.290 13:39:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2177970 00:05:59.290 13:39:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:59.290 13:39:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:59.290 13:39:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2177970' 00:05:59.290 killing process with pid 2177970 00:05:59.290 13:39:39 -- common/autotest_common.sh@955 -- # kill 2177970 00:05:59.290 13:39:39 -- common/autotest_common.sh@960 -- # wait 2177970 00:05:59.859 00:05:59.859 real 0m1.685s 00:05:59.859 user 0m1.863s 00:05:59.859 sys 0m0.445s 00:05:59.859 13:39:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.859 13:39:39 -- common/autotest_common.sh@10 -- # set +x 00:05:59.859 ************************************ 00:05:59.859 END TEST dpdk_mem_utility 00:05:59.859 ************************************ 00:05:59.859 13:39:39 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.859 13:39:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.859 13:39:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.859 13:39:39 -- common/autotest_common.sh@10 -- # set +x 00:05:59.859 ************************************ 00:05:59.859 START TEST event 00:05:59.859 ************************************ 00:05:59.859 13:39:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.859 * Looking for test storage... 00:05:59.859 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:59.859 13:39:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.859 13:39:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.859 13:39:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.859 13:39:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.859 13:39:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.859 13:39:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.859 13:39:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.859 13:39:40 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.859 13:39:40 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.859 13:39:40 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.859 13:39:40 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.859 13:39:40 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.859 13:39:40 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.859 13:39:40 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.859 13:39:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.859 13:39:40 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.859 13:39:40 -- scripts/common.sh@344 -- # : 1 00:05:59.859 13:39:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.859 13:39:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.859 13:39:40 -- scripts/common.sh@364 -- # decimal 1 00:05:59.859 13:39:40 -- scripts/common.sh@352 -- # local d=1 00:05:59.859 13:39:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.859 13:39:40 -- scripts/common.sh@354 -- # echo 1 00:05:59.859 13:39:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.859 13:39:40 -- scripts/common.sh@365 -- # decimal 2 00:05:59.859 13:39:40 -- scripts/common.sh@352 -- # local d=2 00:05:59.859 13:39:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.859 13:39:40 -- scripts/common.sh@354 -- # echo 2 00:05:59.859 13:39:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.859 13:39:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.859 13:39:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.859 13:39:40 -- scripts/common.sh@367 -- # return 0 00:05:59.859 13:39:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.859 13:39:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.859 --rc genhtml_branch_coverage=1 00:05:59.859 --rc genhtml_function_coverage=1 00:05:59.859 --rc genhtml_legend=1 00:05:59.859 --rc geninfo_all_blocks=1 00:05:59.859 --rc geninfo_unexecuted_blocks=1 00:05:59.859 00:05:59.859 ' 00:05:59.859 13:39:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.859 --rc genhtml_branch_coverage=1 00:05:59.859 --rc genhtml_function_coverage=1 00:05:59.859 --rc genhtml_legend=1 00:05:59.859 --rc geninfo_all_blocks=1 00:05:59.859 --rc geninfo_unexecuted_blocks=1 00:05:59.859 00:05:59.859 ' 00:05:59.859 13:39:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.859 --rc genhtml_branch_coverage=1 00:05:59.859 --rc genhtml_function_coverage=1 00:05:59.859 --rc genhtml_legend=1 00:05:59.859 --rc geninfo_all_blocks=1 00:05:59.859 --rc geninfo_unexecuted_blocks=1 00:05:59.859 00:05:59.860 ' 00:05:59.860 13:39:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.860 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.860 --rc genhtml_branch_coverage=1 00:05:59.860 --rc genhtml_function_coverage=1 00:05:59.860 --rc genhtml_legend=1 00:05:59.860 --rc geninfo_all_blocks=1 00:05:59.860 --rc geninfo_unexecuted_blocks=1 00:05:59.860 00:05:59.860 ' 00:05:59.860 13:39:40 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:59.860 13:39:40 -- bdev/nbd_common.sh@6 -- # set -e 00:05:59.860 13:39:40 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.860 13:39:40 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:59.860 13:39:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.860 13:39:40 -- common/autotest_common.sh@10 -- # set +x 00:05:59.860 ************************************ 00:05:59.860 START TEST event_perf 00:05:59.860 ************************************ 00:05:59.860 13:39:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.860 Running I/O for 1 seconds...[2024-11-29 13:39:40.134526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.860 [2024-11-29 13:39:40.134599] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2178173 ] 00:06:00.119 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.119 [2024-11-29 13:39:40.198234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:00.119 [2024-11-29 13:39:40.297023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:00.119 [2024-11-29 13:39:40.297050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:00.119 [2024-11-29 13:39:40.297093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:00.119 [2024-11-29 13:39:40.297095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.496 Running I/O for 1 seconds... 00:06:01.496 lcore 0: 226463 00:06:01.496 lcore 1: 226462 00:06:01.496 lcore 2: 226463 00:06:01.496 lcore 3: 226463 00:06:01.496 done. 00:06:01.496 00:06:01.496 real 0m1.256s 00:06:01.496 user 0m4.164s 00:06:01.496 sys 0m0.089s 00:06:01.496 13:39:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.496 13:39:41 -- common/autotest_common.sh@10 -- # set +x 00:06:01.496 ************************************ 00:06:01.496 END TEST event_perf 00:06:01.496 ************************************ 00:06:01.496 13:39:41 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.496 13:39:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:01.496 13:39:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.496 13:39:41 -- common/autotest_common.sh@10 -- # set +x 00:06:01.496 ************************************ 00:06:01.496 START TEST event_reactor 00:06:01.496 ************************************ 00:06:01.496 13:39:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.496 [2024-11-29 13:39:41.416983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.496 [2024-11-29 13:39:41.417065] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2178442 ] 00:06:01.496 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.496 [2024-11-29 13:39:41.476769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.496 [2024-11-29 13:39:41.568974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.435 test_start 00:06:02.435 oneshot 00:06:02.435 tick 100 00:06:02.435 tick 100 00:06:02.435 tick 250 00:06:02.435 tick 100 00:06:02.435 tick 100 00:06:02.435 tick 100 00:06:02.435 tick 250 00:06:02.435 tick 500 00:06:02.435 tick 100 00:06:02.435 tick 100 00:06:02.435 tick 250 00:06:02.435 tick 100 00:06:02.435 tick 100 00:06:02.435 test_end 00:06:02.435 00:06:02.435 real 0m1.245s 00:06:02.435 user 0m1.163s 00:06:02.435 sys 0m0.076s 00:06:02.435 13:39:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.435 13:39:42 -- common/autotest_common.sh@10 -- # set +x 00:06:02.435 ************************************ 00:06:02.435 END TEST event_reactor 00:06:02.435 ************************************ 00:06:02.435 13:39:42 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.435 13:39:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:02.435 13:39:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.435 13:39:42 -- common/autotest_common.sh@10 -- # set +x 00:06:02.435 ************************************ 00:06:02.435 START TEST event_reactor_perf 00:06:02.435 ************************************ 00:06:02.435 13:39:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.435 [2024-11-29 13:39:42.690637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.435 [2024-11-29 13:39:42.690721] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2178616 ] 00:06:02.694 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.694 [2024-11-29 13:39:42.757359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.694 [2024-11-29 13:39:42.843943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.074 test_start 00:06:04.074 test_end 00:06:04.074 Performance: 352964 events per second 00:06:04.074 00:06:04.074 real 0m1.251s 00:06:04.074 user 0m1.165s 00:06:04.074 sys 0m0.081s 00:06:04.074 13:39:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.074 13:39:43 -- common/autotest_common.sh@10 -- # set +x 00:06:04.074 ************************************ 00:06:04.074 END TEST event_reactor_perf 00:06:04.074 ************************************ 00:06:04.074 13:39:43 -- event/event.sh@49 -- # uname -s 00:06:04.074 13:39:43 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:04.074 13:39:43 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:04.074 13:39:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.074 13:39:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.074 13:39:43 -- common/autotest_common.sh@10 -- # set +x 00:06:04.074 ************************************ 00:06:04.074 START TEST event_scheduler 00:06:04.074 ************************************ 00:06:04.074 13:39:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:04.074 * Looking for test storage... 00:06:04.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:04.074 13:39:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.074 13:39:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.074 13:39:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.074 13:39:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.074 13:39:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.074 13:39:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.074 13:39:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.074 13:39:44 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.074 13:39:44 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.074 13:39:44 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.074 13:39:44 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.074 13:39:44 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.074 13:39:44 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.074 13:39:44 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.074 13:39:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.074 13:39:44 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.074 13:39:44 -- scripts/common.sh@344 -- # : 1 00:06:04.074 13:39:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.074 13:39:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.074 13:39:44 -- scripts/common.sh@364 -- # decimal 1 00:06:04.074 13:39:44 -- scripts/common.sh@352 -- # local d=1 00:06:04.074 13:39:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.074 13:39:44 -- scripts/common.sh@354 -- # echo 1 00:06:04.074 13:39:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.074 13:39:44 -- scripts/common.sh@365 -- # decimal 2 00:06:04.074 13:39:44 -- scripts/common.sh@352 -- # local d=2 00:06:04.074 13:39:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.074 13:39:44 -- scripts/common.sh@354 -- # echo 2 00:06:04.074 13:39:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.074 13:39:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.074 13:39:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.074 13:39:44 -- scripts/common.sh@367 -- # return 0 00:06:04.074 13:39:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.074 13:39:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.074 --rc genhtml_branch_coverage=1 00:06:04.074 --rc genhtml_function_coverage=1 00:06:04.074 --rc genhtml_legend=1 00:06:04.074 --rc geninfo_all_blocks=1 00:06:04.074 --rc geninfo_unexecuted_blocks=1 00:06:04.074 00:06:04.074 ' 00:06:04.074 13:39:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.074 --rc genhtml_branch_coverage=1 00:06:04.074 --rc genhtml_function_coverage=1 00:06:04.074 --rc genhtml_legend=1 00:06:04.074 --rc geninfo_all_blocks=1 00:06:04.074 --rc geninfo_unexecuted_blocks=1 00:06:04.074 00:06:04.074 ' 00:06:04.074 13:39:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.074 --rc genhtml_branch_coverage=1 00:06:04.074 --rc genhtml_function_coverage=1 00:06:04.074 --rc genhtml_legend=1 00:06:04.074 --rc geninfo_all_blocks=1 00:06:04.074 --rc geninfo_unexecuted_blocks=1 00:06:04.074 00:06:04.074 ' 00:06:04.074 13:39:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.074 --rc genhtml_branch_coverage=1 00:06:04.074 --rc genhtml_function_coverage=1 00:06:04.074 --rc genhtml_legend=1 00:06:04.074 --rc geninfo_all_blocks=1 00:06:04.074 --rc geninfo_unexecuted_blocks=1 00:06:04.074 00:06:04.074 ' 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2178810 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@37 -- # waitforlisten 2178810 00:06:04.074 13:39:44 -- common/autotest_common.sh@829 -- # '[' -z 2178810 ']' 00:06:04.074 13:39:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.074 13:39:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.074 13:39:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.074 13:39:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.074 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.074 [2024-11-29 13:39:44.134823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.074 [2024-11-29 13:39:44.134913] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2178810 ] 00:06:04.074 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.074 [2024-11-29 13:39:44.202335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:04.074 [2024-11-29 13:39:44.285018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.074 [2024-11-29 13:39:44.285081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.074 [2024-11-29 13:39:44.285150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:04.074 [2024-11-29 13:39:44.285153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:04.074 13:39:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.074 13:39:44 -- common/autotest_common.sh@862 -- # return 0 00:06:04.074 13:39:44 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:04.074 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.074 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.074 POWER: Env isn't set yet! 00:06:04.074 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:04.074 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:04.074 POWER: Cannot get available frequencies of lcore 0 00:06:04.074 POWER: Attempting to initialise PSTAT power management... 00:06:04.074 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:04.074 POWER: Initialized successfully for lcore 0 power management 00:06:04.335 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:04.335 POWER: Initialized successfully for lcore 1 power management 00:06:04.335 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:04.335 POWER: Initialized successfully for lcore 2 power management 00:06:04.335 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:04.335 POWER: Initialized successfully for lcore 3 power management 00:06:04.335 [2024-11-29 13:39:44.371571] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:04.335 [2024-11-29 13:39:44.371588] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:04.335 [2024-11-29 13:39:44.371598] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 [2024-11-29 13:39:44.473415] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:04.335 13:39:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.335 13:39:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 ************************************ 00:06:04.335 START TEST scheduler_create_thread 00:06:04.335 ************************************ 00:06:04.335 13:39:44 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 2 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 3 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 4 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 5 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 6 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 7 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 8 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 9 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 10 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.335 13:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.335 13:39:44 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:04.335 13:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.335 13:39:44 -- common/autotest_common.sh@10 -- # set +x 00:06:04.905 13:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.905 13:39:45 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:04.905 13:39:45 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:04.905 13:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.905 13:39:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.349 13:39:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.349 00:06:06.349 real 0m1.757s 00:06:06.349 user 0m0.012s 00:06:06.349 sys 0m0.002s 00:06:06.349 13:39:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.349 13:39:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.349 ************************************ 00:06:06.349 END TEST scheduler_create_thread 00:06:06.349 ************************************ 00:06:06.349 13:39:46 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:06.349 13:39:46 -- scheduler/scheduler.sh@46 -- # killprocess 2178810 00:06:06.349 13:39:46 -- common/autotest_common.sh@936 -- # '[' -z 2178810 ']' 00:06:06.349 13:39:46 -- common/autotest_common.sh@940 -- # kill -0 2178810 00:06:06.349 13:39:46 -- common/autotest_common.sh@941 -- # uname 00:06:06.349 13:39:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.349 13:39:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2178810 00:06:06.349 13:39:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:06.349 13:39:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:06.349 13:39:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2178810' 00:06:06.349 killing process with pid 2178810 00:06:06.349 13:39:46 -- common/autotest_common.sh@955 -- # kill 2178810 00:06:06.349 13:39:46 -- common/autotest_common.sh@960 -- # wait 2178810 00:06:06.610 [2024-11-29 13:39:46.717194] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:06.610 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:06.610 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:06.610 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:06.610 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:06.610 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:06.610 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:06.610 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:06.610 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:06.871 00:06:06.871 real 0m2.977s 00:06:06.871 user 0m3.847s 00:06:06.871 sys 0m0.329s 00:06:06.871 13:39:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.871 13:39:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.871 ************************************ 00:06:06.871 END TEST event_scheduler 00:06:06.871 ************************************ 00:06:06.871 13:39:46 -- event/event.sh@51 -- # modprobe -n nbd 00:06:06.871 13:39:46 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:06.871 13:39:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.871 13:39:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.871 13:39:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.871 ************************************ 00:06:06.871 START TEST app_repeat 00:06:06.871 ************************************ 00:06:06.871 13:39:46 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:06.871 13:39:46 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.871 13:39:46 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.871 13:39:46 -- event/event.sh@13 -- # local nbd_list 00:06:06.872 13:39:46 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:06.872 13:39:46 -- event/event.sh@14 -- # local bdev_list 00:06:06.872 13:39:46 -- event/event.sh@15 -- # local repeat_times=4 00:06:06.872 13:39:46 -- event/event.sh@17 -- # modprobe nbd 00:06:06.872 13:39:46 -- event/event.sh@19 -- # repeat_pid=2179195 00:06:06.872 13:39:46 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:06.872 13:39:46 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:06.872 13:39:46 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2179195' 00:06:06.872 Process app_repeat pid: 2179195 00:06:06.872 13:39:46 -- event/event.sh@23 -- # for i in {0..2} 00:06:06.872 13:39:46 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:06.872 spdk_app_start Round 0 00:06:06.872 13:39:46 -- event/event.sh@25 -- # waitforlisten 2179195 /var/tmp/spdk-nbd.sock 00:06:06.872 13:39:46 -- common/autotest_common.sh@829 -- # '[' -z 2179195 ']' 00:06:06.872 13:39:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:06.872 13:39:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.872 13:39:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:06.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:06.872 13:39:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.872 13:39:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.872 [2024-11-29 13:39:46.987294] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.872 [2024-11-29 13:39:46.987381] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2179195 ] 00:06:06.872 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.872 [2024-11-29 13:39:47.049246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:06.872 [2024-11-29 13:39:47.141248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:06.872 [2024-11-29 13:39:47.141252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.834 13:39:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.834 13:39:47 -- common/autotest_common.sh@862 -- # return 0 00:06:07.834 13:39:47 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.092 Malloc0 00:06:08.092 13:39:48 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.351 Malloc1 00:06:08.351 13:39:48 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@12 -- # local i 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.351 13:39:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:08.610 /dev/nbd0 00:06:08.610 13:39:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:08.610 13:39:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:08.610 13:39:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:08.610 13:39:48 -- common/autotest_common.sh@867 -- # local i 00:06:08.610 13:39:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.610 13:39:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.610 13:39:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:08.610 13:39:48 -- common/autotest_common.sh@871 -- # break 00:06:08.610 13:39:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.610 13:39:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.610 13:39:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.610 1+0 records in 00:06:08.610 1+0 records out 00:06:08.610 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019435 s, 21.1 MB/s 00:06:08.610 13:39:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.610 13:39:48 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.610 13:39:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.610 13:39:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.610 13:39:48 -- common/autotest_common.sh@887 -- # return 0 00:06:08.610 13:39:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.610 13:39:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.610 13:39:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:08.868 /dev/nbd1 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:08.868 13:39:49 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:08.868 13:39:49 -- common/autotest_common.sh@867 -- # local i 00:06:08.868 13:39:49 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.868 13:39:49 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.868 13:39:49 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:08.868 13:39:49 -- common/autotest_common.sh@871 -- # break 00:06:08.868 13:39:49 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.868 13:39:49 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.868 13:39:49 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.868 1+0 records in 00:06:08.868 1+0 records out 00:06:08.868 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204056 s, 20.1 MB/s 00:06:08.868 13:39:49 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.868 13:39:49 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.868 13:39:49 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.868 13:39:49 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.868 13:39:49 -- common/autotest_common.sh@887 -- # return 0 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.868 13:39:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.127 13:39:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:09.127 { 00:06:09.127 "nbd_device": "/dev/nbd0", 00:06:09.127 "bdev_name": "Malloc0" 00:06:09.127 }, 00:06:09.127 { 00:06:09.127 "nbd_device": "/dev/nbd1", 00:06:09.127 "bdev_name": "Malloc1" 00:06:09.127 } 00:06:09.127 ]' 00:06:09.127 13:39:49 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:09.127 { 00:06:09.127 "nbd_device": "/dev/nbd0", 00:06:09.127 "bdev_name": "Malloc0" 00:06:09.127 }, 00:06:09.127 { 00:06:09.127 "nbd_device": "/dev/nbd1", 00:06:09.127 "bdev_name": "Malloc1" 00:06:09.127 } 00:06:09.127 ]' 00:06:09.127 13:39:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:09.386 /dev/nbd1' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:09.386 /dev/nbd1' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@65 -- # count=2 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@95 -- # count=2 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:09.386 256+0 records in 00:06:09.386 256+0 records out 00:06:09.386 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508617 s, 206 MB/s 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:09.386 256+0 records in 00:06:09.386 256+0 records out 00:06:09.386 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022438 s, 46.7 MB/s 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:09.386 256+0 records in 00:06:09.386 256+0 records out 00:06:09.386 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021474 s, 48.8 MB/s 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@51 -- # local i 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.386 13:39:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:09.644 13:39:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:09.644 13:39:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:09.644 13:39:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:09.644 13:39:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@41 -- # break 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.645 13:39:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@41 -- # break 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.903 13:39:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@65 -- # true 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@65 -- # count=0 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@104 -- # count=0 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:10.162 13:39:50 -- bdev/nbd_common.sh@109 -- # return 0 00:06:10.162 13:39:50 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:10.421 13:39:50 -- event/event.sh@35 -- # sleep 3 00:06:10.682 [2024-11-29 13:39:50.862669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:10.682 [2024-11-29 13:39:50.948996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.682 [2024-11-29 13:39:50.948996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.943 [2024-11-29 13:39:51.010411] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:10.943 [2024-11-29 13:39:51.010519] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:13.477 13:39:53 -- event/event.sh@23 -- # for i in {0..2} 00:06:13.477 13:39:53 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:13.477 spdk_app_start Round 1 00:06:13.477 13:39:53 -- event/event.sh@25 -- # waitforlisten 2179195 /var/tmp/spdk-nbd.sock 00:06:13.477 13:39:53 -- common/autotest_common.sh@829 -- # '[' -z 2179195 ']' 00:06:13.477 13:39:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.477 13:39:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.477 13:39:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.477 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.477 13:39:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.477 13:39:53 -- common/autotest_common.sh@10 -- # set +x 00:06:13.735 13:39:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.735 13:39:53 -- common/autotest_common.sh@862 -- # return 0 00:06:13.735 13:39:53 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:13.993 Malloc0 00:06:13.993 13:39:54 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.251 Malloc1 00:06:14.251 13:39:54 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@12 -- # local i 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.251 13:39:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.509 /dev/nbd0 00:06:14.509 13:39:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.509 13:39:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.509 13:39:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:14.509 13:39:54 -- common/autotest_common.sh@867 -- # local i 00:06:14.509 13:39:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.509 13:39:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.509 13:39:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:14.509 13:39:54 -- common/autotest_common.sh@871 -- # break 00:06:14.509 13:39:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.509 13:39:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.509 13:39:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.509 1+0 records in 00:06:14.509 1+0 records out 00:06:14.509 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000176686 s, 23.2 MB/s 00:06:14.509 13:39:54 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.509 13:39:54 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.509 13:39:54 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.509 13:39:54 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.509 13:39:54 -- common/autotest_common.sh@887 -- # return 0 00:06:14.510 13:39:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.510 13:39:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.510 13:39:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:14.769 /dev/nbd1 00:06:14.769 13:39:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:14.769 13:39:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:14.769 13:39:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:14.769 13:39:54 -- common/autotest_common.sh@867 -- # local i 00:06:14.769 13:39:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.769 13:39:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.769 13:39:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:14.769 13:39:54 -- common/autotest_common.sh@871 -- # break 00:06:14.769 13:39:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.769 13:39:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.769 13:39:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.769 1+0 records in 00:06:14.769 1+0 records out 00:06:14.769 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000190917 s, 21.5 MB/s 00:06:14.769 13:39:55 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.769 13:39:55 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.769 13:39:55 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.769 13:39:55 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.769 13:39:55 -- common/autotest_common.sh@887 -- # return 0 00:06:14.769 13:39:55 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.769 13:39:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.769 13:39:55 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:14.769 13:39:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.769 13:39:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.028 13:39:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.028 { 00:06:15.028 "nbd_device": "/dev/nbd0", 00:06:15.028 "bdev_name": "Malloc0" 00:06:15.028 }, 00:06:15.028 { 00:06:15.028 "nbd_device": "/dev/nbd1", 00:06:15.028 "bdev_name": "Malloc1" 00:06:15.028 } 00:06:15.028 ]' 00:06:15.028 13:39:55 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.028 { 00:06:15.028 "nbd_device": "/dev/nbd0", 00:06:15.028 "bdev_name": "Malloc0" 00:06:15.028 }, 00:06:15.028 { 00:06:15.028 "nbd_device": "/dev/nbd1", 00:06:15.028 "bdev_name": "Malloc1" 00:06:15.028 } 00:06:15.028 ]' 00:06:15.028 13:39:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.285 /dev/nbd1' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.285 /dev/nbd1' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.285 256+0 records in 00:06:15.285 256+0 records out 00:06:15.285 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00529179 s, 198 MB/s 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.285 256+0 records in 00:06:15.285 256+0 records out 00:06:15.285 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209716 s, 50.0 MB/s 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.285 256+0 records in 00:06:15.285 256+0 records out 00:06:15.285 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239562 s, 43.8 MB/s 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.285 13:39:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.286 13:39:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@41 -- # break 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.543 13:39:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@41 -- # break 00:06:15.801 13:39:55 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.802 13:39:55 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.802 13:39:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.802 13:39:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:16.059 13:39:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:16.059 13:39:56 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:16.059 13:39:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:16.059 13:39:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@65 -- # true 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@65 -- # count=0 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.060 13:39:56 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.060 13:39:56 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:16.319 13:39:56 -- event/event.sh@35 -- # sleep 3 00:06:16.579 [2024-11-29 13:39:56.737839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:16.579 [2024-11-29 13:39:56.826889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.579 [2024-11-29 13:39:56.826895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.838 [2024-11-29 13:39:56.888766] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:16.838 [2024-11-29 13:39:56.888847] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.372 13:39:59 -- event/event.sh@23 -- # for i in {0..2} 00:06:19.372 13:39:59 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:19.372 spdk_app_start Round 2 00:06:19.372 13:39:59 -- event/event.sh@25 -- # waitforlisten 2179195 /var/tmp/spdk-nbd.sock 00:06:19.372 13:39:59 -- common/autotest_common.sh@829 -- # '[' -z 2179195 ']' 00:06:19.372 13:39:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.372 13:39:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.372 13:39:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.372 13:39:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.372 13:39:59 -- common/autotest_common.sh@10 -- # set +x 00:06:19.631 13:39:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:19.631 13:39:59 -- common/autotest_common.sh@862 -- # return 0 00:06:19.631 13:39:59 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:19.889 Malloc0 00:06:19.889 13:40:00 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.147 Malloc1 00:06:20.147 13:40:00 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.147 13:40:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.406 /dev/nbd0 00:06:20.406 13:40:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.406 13:40:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.406 13:40:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.406 13:40:00 -- common/autotest_common.sh@867 -- # local i 00:06:20.406 13:40:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.406 13:40:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.406 13:40:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.406 13:40:00 -- common/autotest_common.sh@871 -- # break 00:06:20.406 13:40:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.406 13:40:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.406 13:40:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.406 1+0 records in 00:06:20.406 1+0 records out 00:06:20.406 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000197017 s, 20.8 MB/s 00:06:20.406 13:40:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.406 13:40:00 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.406 13:40:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.406 13:40:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.406 13:40:00 -- common/autotest_common.sh@887 -- # return 0 00:06:20.406 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.406 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.406 13:40:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:20.665 /dev/nbd1 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:20.665 13:40:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:20.665 13:40:00 -- common/autotest_common.sh@867 -- # local i 00:06:20.665 13:40:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.665 13:40:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.665 13:40:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:20.665 13:40:00 -- common/autotest_common.sh@871 -- # break 00:06:20.665 13:40:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.665 13:40:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.665 13:40:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.665 1+0 records in 00:06:20.665 1+0 records out 00:06:20.665 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000215188 s, 19.0 MB/s 00:06:20.665 13:40:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.665 13:40:00 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.665 13:40:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.665 13:40:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.665 13:40:00 -- common/autotest_common.sh@887 -- # return 0 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.665 13:40:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:20.923 { 00:06:20.923 "nbd_device": "/dev/nbd0", 00:06:20.923 "bdev_name": "Malloc0" 00:06:20.923 }, 00:06:20.923 { 00:06:20.923 "nbd_device": "/dev/nbd1", 00:06:20.923 "bdev_name": "Malloc1" 00:06:20.923 } 00:06:20.923 ]' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:20.923 { 00:06:20.923 "nbd_device": "/dev/nbd0", 00:06:20.923 "bdev_name": "Malloc0" 00:06:20.923 }, 00:06:20.923 { 00:06:20.923 "nbd_device": "/dev/nbd1", 00:06:20.923 "bdev_name": "Malloc1" 00:06:20.923 } 00:06:20.923 ]' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:20.923 /dev/nbd1' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:20.923 /dev/nbd1' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@65 -- # count=2 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@95 -- # count=2 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:20.923 256+0 records in 00:06:20.923 256+0 records out 00:06:20.923 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00469867 s, 223 MB/s 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:20.923 256+0 records in 00:06:20.923 256+0 records out 00:06:20.923 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225886 s, 46.4 MB/s 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.923 13:40:01 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:21.183 256+0 records in 00:06:21.183 256+0 records out 00:06:21.183 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212967 s, 49.2 MB/s 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@51 -- # local i 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.183 13:40:01 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@41 -- # break 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.441 13:40:01 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@41 -- # break 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.700 13:40:01 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@65 -- # true 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@65 -- # count=0 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@104 -- # count=0 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:21.958 13:40:02 -- bdev/nbd_common.sh@109 -- # return 0 00:06:21.958 13:40:02 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.218 13:40:02 -- event/event.sh@35 -- # sleep 3 00:06:22.477 [2024-11-29 13:40:02.577184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:22.477 [2024-11-29 13:40:02.663830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.477 [2024-11-29 13:40:02.663836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.477 [2024-11-29 13:40:02.721310] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:22.477 [2024-11-29 13:40:02.721367] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.776 13:40:05 -- event/event.sh@38 -- # waitforlisten 2179195 /var/tmp/spdk-nbd.sock 00:06:25.776 13:40:05 -- common/autotest_common.sh@829 -- # '[' -z 2179195 ']' 00:06:25.776 13:40:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.776 13:40:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.776 13:40:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.776 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.776 13:40:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.776 13:40:05 -- common/autotest_common.sh@10 -- # set +x 00:06:25.776 13:40:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.777 13:40:05 -- common/autotest_common.sh@862 -- # return 0 00:06:25.777 13:40:05 -- event/event.sh@39 -- # killprocess 2179195 00:06:25.777 13:40:05 -- common/autotest_common.sh@936 -- # '[' -z 2179195 ']' 00:06:25.777 13:40:05 -- common/autotest_common.sh@940 -- # kill -0 2179195 00:06:25.777 13:40:05 -- common/autotest_common.sh@941 -- # uname 00:06:25.777 13:40:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.777 13:40:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2179195 00:06:25.777 13:40:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.777 13:40:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.777 13:40:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2179195' 00:06:25.777 killing process with pid 2179195 00:06:25.777 13:40:05 -- common/autotest_common.sh@955 -- # kill 2179195 00:06:25.777 13:40:05 -- common/autotest_common.sh@960 -- # wait 2179195 00:06:25.777 spdk_app_start is called in Round 0. 00:06:25.777 Shutdown signal received, stop current app iteration 00:06:25.777 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.777 spdk_app_start is called in Round 1. 00:06:25.777 Shutdown signal received, stop current app iteration 00:06:25.777 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.777 spdk_app_start is called in Round 2. 00:06:25.777 Shutdown signal received, stop current app iteration 00:06:25.777 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.777 spdk_app_start is called in Round 3. 00:06:25.777 Shutdown signal received, stop current app iteration 00:06:25.777 13:40:05 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:25.777 13:40:05 -- event/event.sh@42 -- # return 0 00:06:25.777 00:06:25.777 real 0m18.875s 00:06:25.777 user 0m41.455s 00:06:25.777 sys 0m3.152s 00:06:25.777 13:40:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.777 13:40:05 -- common/autotest_common.sh@10 -- # set +x 00:06:25.777 ************************************ 00:06:25.777 END TEST app_repeat 00:06:25.777 ************************************ 00:06:25.777 13:40:05 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:25.777 13:40:05 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.777 13:40:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.777 13:40:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.777 13:40:05 -- common/autotest_common.sh@10 -- # set +x 00:06:25.777 ************************************ 00:06:25.777 START TEST cpu_locks 00:06:25.777 ************************************ 00:06:25.777 13:40:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.777 * Looking for test storage... 00:06:25.777 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:25.777 13:40:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.777 13:40:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.777 13:40:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:25.777 13:40:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:25.777 13:40:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:25.777 13:40:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:25.777 13:40:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:25.777 13:40:05 -- scripts/common.sh@335 -- # IFS=.-: 00:06:25.777 13:40:05 -- scripts/common.sh@335 -- # read -ra ver1 00:06:25.777 13:40:05 -- scripts/common.sh@336 -- # IFS=.-: 00:06:25.777 13:40:05 -- scripts/common.sh@336 -- # read -ra ver2 00:06:25.777 13:40:05 -- scripts/common.sh@337 -- # local 'op=<' 00:06:25.777 13:40:05 -- scripts/common.sh@339 -- # ver1_l=2 00:06:25.777 13:40:05 -- scripts/common.sh@340 -- # ver2_l=1 00:06:25.777 13:40:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:25.777 13:40:05 -- scripts/common.sh@343 -- # case "$op" in 00:06:25.777 13:40:05 -- scripts/common.sh@344 -- # : 1 00:06:25.777 13:40:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:25.777 13:40:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:25.777 13:40:05 -- scripts/common.sh@364 -- # decimal 1 00:06:25.777 13:40:05 -- scripts/common.sh@352 -- # local d=1 00:06:25.777 13:40:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:25.777 13:40:05 -- scripts/common.sh@354 -- # echo 1 00:06:25.777 13:40:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:25.777 13:40:06 -- scripts/common.sh@365 -- # decimal 2 00:06:25.777 13:40:06 -- scripts/common.sh@352 -- # local d=2 00:06:25.777 13:40:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:25.777 13:40:06 -- scripts/common.sh@354 -- # echo 2 00:06:25.777 13:40:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:25.777 13:40:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:25.777 13:40:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:25.777 13:40:06 -- scripts/common.sh@367 -- # return 0 00:06:25.777 13:40:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:25.777 13:40:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:25.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.777 --rc genhtml_branch_coverage=1 00:06:25.777 --rc genhtml_function_coverage=1 00:06:25.777 --rc genhtml_legend=1 00:06:25.777 --rc geninfo_all_blocks=1 00:06:25.777 --rc geninfo_unexecuted_blocks=1 00:06:25.777 00:06:25.777 ' 00:06:25.777 13:40:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:25.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.777 --rc genhtml_branch_coverage=1 00:06:25.777 --rc genhtml_function_coverage=1 00:06:25.777 --rc genhtml_legend=1 00:06:25.777 --rc geninfo_all_blocks=1 00:06:25.777 --rc geninfo_unexecuted_blocks=1 00:06:25.777 00:06:25.777 ' 00:06:25.777 13:40:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:25.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.777 --rc genhtml_branch_coverage=1 00:06:25.777 --rc genhtml_function_coverage=1 00:06:25.777 --rc genhtml_legend=1 00:06:25.777 --rc geninfo_all_blocks=1 00:06:25.777 --rc geninfo_unexecuted_blocks=1 00:06:25.777 00:06:25.777 ' 00:06:25.777 13:40:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:25.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.777 --rc genhtml_branch_coverage=1 00:06:25.777 --rc genhtml_function_coverage=1 00:06:25.777 --rc genhtml_legend=1 00:06:25.777 --rc geninfo_all_blocks=1 00:06:25.777 --rc geninfo_unexecuted_blocks=1 00:06:25.777 00:06:25.777 ' 00:06:25.777 13:40:06 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:25.777 13:40:06 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:25.777 13:40:06 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:25.777 13:40:06 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:25.777 13:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.777 13:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.777 13:40:06 -- common/autotest_common.sh@10 -- # set +x 00:06:25.777 ************************************ 00:06:25.777 START TEST default_locks 00:06:25.777 ************************************ 00:06:25.777 13:40:06 -- common/autotest_common.sh@1114 -- # default_locks 00:06:25.777 13:40:06 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2181697 00:06:25.777 13:40:06 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:25.777 13:40:06 -- event/cpu_locks.sh@47 -- # waitforlisten 2181697 00:06:25.777 13:40:06 -- common/autotest_common.sh@829 -- # '[' -z 2181697 ']' 00:06:25.777 13:40:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.777 13:40:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.777 13:40:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.777 13:40:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.777 13:40:06 -- common/autotest_common.sh@10 -- # set +x 00:06:26.038 [2024-11-29 13:40:06.061058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.038 [2024-11-29 13:40:06.061141] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2181697 ] 00:06:26.038 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.038 [2024-11-29 13:40:06.125601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.038 [2024-11-29 13:40:06.213116] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.038 [2024-11-29 13:40:06.213299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.974 13:40:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.974 13:40:07 -- common/autotest_common.sh@862 -- # return 0 00:06:26.974 13:40:07 -- event/cpu_locks.sh@49 -- # locks_exist 2181697 00:06:26.974 13:40:07 -- event/cpu_locks.sh@22 -- # lslocks -p 2181697 00:06:26.974 13:40:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.234 lslocks: write error 00:06:27.234 13:40:07 -- event/cpu_locks.sh@50 -- # killprocess 2181697 00:06:27.234 13:40:07 -- common/autotest_common.sh@936 -- # '[' -z 2181697 ']' 00:06:27.234 13:40:07 -- common/autotest_common.sh@940 -- # kill -0 2181697 00:06:27.234 13:40:07 -- common/autotest_common.sh@941 -- # uname 00:06:27.234 13:40:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.234 13:40:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2181697 00:06:27.234 13:40:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.234 13:40:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.234 13:40:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2181697' 00:06:27.234 killing process with pid 2181697 00:06:27.234 13:40:07 -- common/autotest_common.sh@955 -- # kill 2181697 00:06:27.234 13:40:07 -- common/autotest_common.sh@960 -- # wait 2181697 00:06:27.493 13:40:07 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2181697 00:06:27.493 13:40:07 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.493 13:40:07 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2181697 00:06:27.493 13:40:07 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:27.493 13:40:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.493 13:40:07 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:27.493 13:40:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.493 13:40:07 -- common/autotest_common.sh@653 -- # waitforlisten 2181697 00:06:27.493 13:40:07 -- common/autotest_common.sh@829 -- # '[' -z 2181697 ']' 00:06:27.493 13:40:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.493 13:40:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.493 13:40:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.493 13:40:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.493 13:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:27.493 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2181697) - No such process 00:06:27.493 ERROR: process (pid: 2181697) is no longer running 00:06:27.493 13:40:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.493 13:40:07 -- common/autotest_common.sh@862 -- # return 1 00:06:27.493 13:40:07 -- common/autotest_common.sh@653 -- # es=1 00:06:27.493 13:40:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.493 13:40:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.493 13:40:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.493 13:40:07 -- event/cpu_locks.sh@54 -- # no_locks 00:06:27.493 13:40:07 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:27.493 13:40:07 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:27.493 13:40:07 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:27.493 00:06:27.493 real 0m1.733s 00:06:27.493 user 0m1.865s 00:06:27.493 sys 0m0.578s 00:06:27.493 13:40:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.493 13:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:27.493 ************************************ 00:06:27.493 END TEST default_locks 00:06:27.493 ************************************ 00:06:27.493 13:40:07 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:27.493 13:40:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.493 13:40:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.493 13:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:27.493 ************************************ 00:06:27.493 START TEST default_locks_via_rpc 00:06:27.493 ************************************ 00:06:27.493 13:40:07 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:27.493 13:40:07 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2181988 00:06:27.493 13:40:07 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:27.493 13:40:07 -- event/cpu_locks.sh@63 -- # waitforlisten 2181988 00:06:27.493 13:40:07 -- common/autotest_common.sh@829 -- # '[' -z 2181988 ']' 00:06:27.493 13:40:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.493 13:40:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.493 13:40:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.752 13:40:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.752 13:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:27.752 [2024-11-29 13:40:07.822377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.752 [2024-11-29 13:40:07.822490] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2181988 ] 00:06:27.752 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.752 [2024-11-29 13:40:07.885718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.752 [2024-11-29 13:40:07.971647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.752 [2024-11-29 13:40:07.971834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.688 13:40:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.688 13:40:08 -- common/autotest_common.sh@862 -- # return 0 00:06:28.688 13:40:08 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:28.688 13:40:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.688 13:40:08 -- common/autotest_common.sh@10 -- # set +x 00:06:28.688 13:40:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.688 13:40:08 -- event/cpu_locks.sh@67 -- # no_locks 00:06:28.688 13:40:08 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:28.688 13:40:08 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:28.688 13:40:08 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:28.688 13:40:08 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:28.688 13:40:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.688 13:40:08 -- common/autotest_common.sh@10 -- # set +x 00:06:28.688 13:40:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.688 13:40:08 -- event/cpu_locks.sh@71 -- # locks_exist 2181988 00:06:28.688 13:40:08 -- event/cpu_locks.sh@22 -- # lslocks -p 2181988 00:06:28.688 13:40:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:28.947 13:40:09 -- event/cpu_locks.sh@73 -- # killprocess 2181988 00:06:28.947 13:40:09 -- common/autotest_common.sh@936 -- # '[' -z 2181988 ']' 00:06:28.947 13:40:09 -- common/autotest_common.sh@940 -- # kill -0 2181988 00:06:28.947 13:40:09 -- common/autotest_common.sh@941 -- # uname 00:06:28.947 13:40:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.947 13:40:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2181988 00:06:28.947 13:40:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:28.947 13:40:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:28.947 13:40:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2181988' 00:06:28.947 killing process with pid 2181988 00:06:28.947 13:40:09 -- common/autotest_common.sh@955 -- # kill 2181988 00:06:28.947 13:40:09 -- common/autotest_common.sh@960 -- # wait 2181988 00:06:29.206 00:06:29.206 real 0m1.688s 00:06:29.206 user 0m1.838s 00:06:29.206 sys 0m0.542s 00:06:29.206 13:40:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.206 13:40:09 -- common/autotest_common.sh@10 -- # set +x 00:06:29.206 ************************************ 00:06:29.206 END TEST default_locks_via_rpc 00:06:29.206 ************************************ 00:06:29.206 13:40:09 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:29.206 13:40:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.206 13:40:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.206 13:40:09 -- common/autotest_common.sh@10 -- # set +x 00:06:29.206 ************************************ 00:06:29.206 START TEST non_locking_app_on_locked_coremask 00:06:29.206 ************************************ 00:06:29.206 13:40:09 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:29.206 13:40:09 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2182275 00:06:29.206 13:40:09 -- event/cpu_locks.sh@81 -- # waitforlisten 2182275 /var/tmp/spdk.sock 00:06:29.206 13:40:09 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:29.206 13:40:09 -- common/autotest_common.sh@829 -- # '[' -z 2182275 ']' 00:06:29.206 13:40:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.206 13:40:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.206 13:40:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.206 13:40:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.206 13:40:09 -- common/autotest_common.sh@10 -- # set +x 00:06:29.466 [2024-11-29 13:40:09.535996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.466 [2024-11-29 13:40:09.536097] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2182275 ] 00:06:29.466 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.466 [2024-11-29 13:40:09.601029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.466 [2024-11-29 13:40:09.693611] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.466 [2024-11-29 13:40:09.693800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.404 13:40:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.404 13:40:10 -- common/autotest_common.sh@862 -- # return 0 00:06:30.404 13:40:10 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2182320 00:06:30.404 13:40:10 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:30.404 13:40:10 -- event/cpu_locks.sh@85 -- # waitforlisten 2182320 /var/tmp/spdk2.sock 00:06:30.404 13:40:10 -- common/autotest_common.sh@829 -- # '[' -z 2182320 ']' 00:06:30.404 13:40:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:30.404 13:40:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.404 13:40:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:30.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:30.404 13:40:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.404 13:40:10 -- common/autotest_common.sh@10 -- # set +x 00:06:30.404 [2024-11-29 13:40:10.581344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.404 [2024-11-29 13:40:10.581451] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2182320 ] 00:06:30.404 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.404 [2024-11-29 13:40:10.670505] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.404 [2024-11-29 13:40:10.670538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.662 [2024-11-29 13:40:10.851793] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.663 [2024-11-29 13:40:10.851981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.599 13:40:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.599 13:40:11 -- common/autotest_common.sh@862 -- # return 0 00:06:31.599 13:40:11 -- event/cpu_locks.sh@87 -- # locks_exist 2182275 00:06:31.599 13:40:11 -- event/cpu_locks.sh@22 -- # lslocks -p 2182275 00:06:31.599 13:40:11 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:31.859 lslocks: write error 00:06:31.859 13:40:11 -- event/cpu_locks.sh@89 -- # killprocess 2182275 00:06:31.859 13:40:11 -- common/autotest_common.sh@936 -- # '[' -z 2182275 ']' 00:06:31.859 13:40:11 -- common/autotest_common.sh@940 -- # kill -0 2182275 00:06:31.859 13:40:11 -- common/autotest_common.sh@941 -- # uname 00:06:31.859 13:40:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.859 13:40:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2182275 00:06:31.859 13:40:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.859 13:40:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.859 13:40:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2182275' 00:06:31.859 killing process with pid 2182275 00:06:31.859 13:40:11 -- common/autotest_common.sh@955 -- # kill 2182275 00:06:31.859 13:40:11 -- common/autotest_common.sh@960 -- # wait 2182275 00:06:32.803 13:40:12 -- event/cpu_locks.sh@90 -- # killprocess 2182320 00:06:32.803 13:40:12 -- common/autotest_common.sh@936 -- # '[' -z 2182320 ']' 00:06:32.803 13:40:12 -- common/autotest_common.sh@940 -- # kill -0 2182320 00:06:32.803 13:40:12 -- common/autotest_common.sh@941 -- # uname 00:06:32.803 13:40:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.803 13:40:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2182320 00:06:32.803 13:40:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.803 13:40:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.803 13:40:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2182320' 00:06:32.803 killing process with pid 2182320 00:06:32.803 13:40:12 -- common/autotest_common.sh@955 -- # kill 2182320 00:06:32.803 13:40:12 -- common/autotest_common.sh@960 -- # wait 2182320 00:06:33.092 00:06:33.092 real 0m3.730s 00:06:33.092 user 0m4.143s 00:06:33.092 sys 0m1.077s 00:06:33.092 13:40:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.092 13:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:33.092 ************************************ 00:06:33.092 END TEST non_locking_app_on_locked_coremask 00:06:33.092 ************************************ 00:06:33.092 13:40:13 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:33.092 13:40:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.092 13:40:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.092 13:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:33.092 ************************************ 00:06:33.092 START TEST locking_app_on_unlocked_coremask 00:06:33.092 ************************************ 00:06:33.092 13:40:13 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:33.092 13:40:13 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2182739 00:06:33.092 13:40:13 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:33.092 13:40:13 -- event/cpu_locks.sh@99 -- # waitforlisten 2182739 /var/tmp/spdk.sock 00:06:33.092 13:40:13 -- common/autotest_common.sh@829 -- # '[' -z 2182739 ']' 00:06:33.092 13:40:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.092 13:40:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.092 13:40:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.092 13:40:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.092 13:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:33.092 [2024-11-29 13:40:13.296105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.092 [2024-11-29 13:40:13.296199] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2182739 ] 00:06:33.092 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.373 [2024-11-29 13:40:13.358782] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:33.373 [2024-11-29 13:40:13.358832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.373 [2024-11-29 13:40:13.444369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.373 [2024-11-29 13:40:13.444563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.309 13:40:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.310 13:40:14 -- common/autotest_common.sh@862 -- # return 0 00:06:34.310 13:40:14 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2182884 00:06:34.310 13:40:14 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:34.310 13:40:14 -- event/cpu_locks.sh@103 -- # waitforlisten 2182884 /var/tmp/spdk2.sock 00:06:34.310 13:40:14 -- common/autotest_common.sh@829 -- # '[' -z 2182884 ']' 00:06:34.310 13:40:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:34.310 13:40:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.310 13:40:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:34.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:34.310 13:40:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.310 13:40:14 -- common/autotest_common.sh@10 -- # set +x 00:06:34.310 [2024-11-29 13:40:14.292187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.310 [2024-11-29 13:40:14.292268] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2182884 ] 00:06:34.310 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.310 [2024-11-29 13:40:14.389204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.310 [2024-11-29 13:40:14.566410] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.310 [2024-11-29 13:40:14.566606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.243 13:40:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.244 13:40:15 -- common/autotest_common.sh@862 -- # return 0 00:06:35.244 13:40:15 -- event/cpu_locks.sh@105 -- # locks_exist 2182884 00:06:35.244 13:40:15 -- event/cpu_locks.sh@22 -- # lslocks -p 2182884 00:06:35.244 13:40:15 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.503 lslocks: write error 00:06:35.503 13:40:15 -- event/cpu_locks.sh@107 -- # killprocess 2182739 00:06:35.503 13:40:15 -- common/autotest_common.sh@936 -- # '[' -z 2182739 ']' 00:06:35.503 13:40:15 -- common/autotest_common.sh@940 -- # kill -0 2182739 00:06:35.503 13:40:15 -- common/autotest_common.sh@941 -- # uname 00:06:35.503 13:40:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.503 13:40:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2182739 00:06:35.503 13:40:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.503 13:40:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.503 13:40:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2182739' 00:06:35.503 killing process with pid 2182739 00:06:35.503 13:40:15 -- common/autotest_common.sh@955 -- # kill 2182739 00:06:35.503 13:40:15 -- common/autotest_common.sh@960 -- # wait 2182739 00:06:36.443 13:40:16 -- event/cpu_locks.sh@108 -- # killprocess 2182884 00:06:36.443 13:40:16 -- common/autotest_common.sh@936 -- # '[' -z 2182884 ']' 00:06:36.443 13:40:16 -- common/autotest_common.sh@940 -- # kill -0 2182884 00:06:36.443 13:40:16 -- common/autotest_common.sh@941 -- # uname 00:06:36.443 13:40:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.443 13:40:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2182884 00:06:36.443 13:40:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.443 13:40:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.443 13:40:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2182884' 00:06:36.443 killing process with pid 2182884 00:06:36.443 13:40:16 -- common/autotest_common.sh@955 -- # kill 2182884 00:06:36.443 13:40:16 -- common/autotest_common.sh@960 -- # wait 2182884 00:06:36.701 00:06:36.701 real 0m3.657s 00:06:36.701 user 0m4.011s 00:06:36.701 sys 0m1.079s 00:06:36.701 13:40:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.701 13:40:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.701 ************************************ 00:06:36.701 END TEST locking_app_on_unlocked_coremask 00:06:36.701 ************************************ 00:06:36.701 13:40:16 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:36.701 13:40:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.701 13:40:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.701 13:40:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.701 ************************************ 00:06:36.701 START TEST locking_app_on_locked_coremask 00:06:36.701 ************************************ 00:06:36.701 13:40:16 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:36.701 13:40:16 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2183190 00:06:36.701 13:40:16 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:36.701 13:40:16 -- event/cpu_locks.sh@116 -- # waitforlisten 2183190 /var/tmp/spdk.sock 00:06:36.701 13:40:16 -- common/autotest_common.sh@829 -- # '[' -z 2183190 ']' 00:06:36.701 13:40:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.701 13:40:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.701 13:40:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.701 13:40:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.701 13:40:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.960 [2024-11-29 13:40:16.983980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.961 [2024-11-29 13:40:16.984078] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183190 ] 00:06:36.961 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.961 [2024-11-29 13:40:17.049461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.961 [2024-11-29 13:40:17.135531] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.961 [2024-11-29 13:40:17.135722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.896 13:40:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.896 13:40:17 -- common/autotest_common.sh@862 -- # return 0 00:06:37.896 13:40:17 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2183330 00:06:37.896 13:40:17 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2183330 /var/tmp/spdk2.sock 00:06:37.896 13:40:17 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:37.896 13:40:17 -- common/autotest_common.sh@650 -- # local es=0 00:06:37.896 13:40:17 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2183330 /var/tmp/spdk2.sock 00:06:37.896 13:40:17 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:37.896 13:40:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.896 13:40:17 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:37.896 13:40:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.896 13:40:17 -- common/autotest_common.sh@653 -- # waitforlisten 2183330 /var/tmp/spdk2.sock 00:06:37.896 13:40:17 -- common/autotest_common.sh@829 -- # '[' -z 2183330 ']' 00:06:37.896 13:40:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:37.896 13:40:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.896 13:40:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:37.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:37.896 13:40:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.896 13:40:17 -- common/autotest_common.sh@10 -- # set +x 00:06:37.896 [2024-11-29 13:40:17.973355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.896 [2024-11-29 13:40:17.973456] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183330 ] 00:06:37.896 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.896 [2024-11-29 13:40:18.070081] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2183190 has claimed it. 00:06:37.896 [2024-11-29 13:40:18.070141] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:38.462 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2183330) - No such process 00:06:38.462 ERROR: process (pid: 2183330) is no longer running 00:06:38.462 13:40:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.462 13:40:18 -- common/autotest_common.sh@862 -- # return 1 00:06:38.462 13:40:18 -- common/autotest_common.sh@653 -- # es=1 00:06:38.462 13:40:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:38.463 13:40:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:38.463 13:40:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:38.463 13:40:18 -- event/cpu_locks.sh@122 -- # locks_exist 2183190 00:06:38.463 13:40:18 -- event/cpu_locks.sh@22 -- # lslocks -p 2183190 00:06:38.463 13:40:18 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:39.032 lslocks: write error 00:06:39.032 13:40:19 -- event/cpu_locks.sh@124 -- # killprocess 2183190 00:06:39.032 13:40:19 -- common/autotest_common.sh@936 -- # '[' -z 2183190 ']' 00:06:39.032 13:40:19 -- common/autotest_common.sh@940 -- # kill -0 2183190 00:06:39.032 13:40:19 -- common/autotest_common.sh@941 -- # uname 00:06:39.032 13:40:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.032 13:40:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2183190 00:06:39.032 13:40:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.032 13:40:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.032 13:40:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2183190' 00:06:39.032 killing process with pid 2183190 00:06:39.032 13:40:19 -- common/autotest_common.sh@955 -- # kill 2183190 00:06:39.032 13:40:19 -- common/autotest_common.sh@960 -- # wait 2183190 00:06:39.291 00:06:39.291 real 0m2.604s 00:06:39.291 user 0m2.940s 00:06:39.291 sys 0m0.707s 00:06:39.291 13:40:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.291 13:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:39.291 ************************************ 00:06:39.291 END TEST locking_app_on_locked_coremask 00:06:39.291 ************************************ 00:06:39.291 13:40:19 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:39.291 13:40:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.291 13:40:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.291 13:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:39.291 ************************************ 00:06:39.291 START TEST locking_overlapped_coremask 00:06:39.291 ************************************ 00:06:39.291 13:40:19 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:39.291 13:40:19 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2183590 00:06:39.291 13:40:19 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:39.291 13:40:19 -- event/cpu_locks.sh@133 -- # waitforlisten 2183590 /var/tmp/spdk.sock 00:06:39.291 13:40:19 -- common/autotest_common.sh@829 -- # '[' -z 2183590 ']' 00:06:39.291 13:40:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.291 13:40:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.291 13:40:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.291 13:40:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.291 13:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:39.551 [2024-11-29 13:40:19.616571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.551 [2024-11-29 13:40:19.616668] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183590 ] 00:06:39.551 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.551 [2024-11-29 13:40:19.675142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:39.551 [2024-11-29 13:40:19.764567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.551 [2024-11-29 13:40:19.764817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.551 [2024-11-29 13:40:19.764873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.551 [2024-11-29 13:40:19.764877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.487 13:40:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.487 13:40:20 -- common/autotest_common.sh@862 -- # return 0 00:06:40.487 13:40:20 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2183644 00:06:40.487 13:40:20 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:40.487 13:40:20 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2183644 /var/tmp/spdk2.sock 00:06:40.487 13:40:20 -- common/autotest_common.sh@650 -- # local es=0 00:06:40.487 13:40:20 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2183644 /var/tmp/spdk2.sock 00:06:40.487 13:40:20 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:40.487 13:40:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.487 13:40:20 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:40.487 13:40:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.487 13:40:20 -- common/autotest_common.sh@653 -- # waitforlisten 2183644 /var/tmp/spdk2.sock 00:06:40.487 13:40:20 -- common/autotest_common.sh@829 -- # '[' -z 2183644 ']' 00:06:40.487 13:40:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.487 13:40:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.487 13:40:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.487 13:40:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.487 13:40:20 -- common/autotest_common.sh@10 -- # set +x 00:06:40.487 [2024-11-29 13:40:20.603109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:40.487 [2024-11-29 13:40:20.603191] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183644 ] 00:06:40.487 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.487 [2024-11-29 13:40:20.698164] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2183590 has claimed it. 00:06:40.487 [2024-11-29 13:40:20.698234] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:41.056 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2183644) - No such process 00:06:41.056 ERROR: process (pid: 2183644) is no longer running 00:06:41.056 13:40:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:41.056 13:40:21 -- common/autotest_common.sh@862 -- # return 1 00:06:41.056 13:40:21 -- common/autotest_common.sh@653 -- # es=1 00:06:41.056 13:40:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:41.056 13:40:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:41.056 13:40:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:41.056 13:40:21 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:41.056 13:40:21 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:41.056 13:40:21 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:41.056 13:40:21 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:41.056 13:40:21 -- event/cpu_locks.sh@141 -- # killprocess 2183590 00:06:41.056 13:40:21 -- common/autotest_common.sh@936 -- # '[' -z 2183590 ']' 00:06:41.056 13:40:21 -- common/autotest_common.sh@940 -- # kill -0 2183590 00:06:41.056 13:40:21 -- common/autotest_common.sh@941 -- # uname 00:06:41.056 13:40:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.056 13:40:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2183590 00:06:41.315 13:40:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.315 13:40:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.315 13:40:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2183590' 00:06:41.315 killing process with pid 2183590 00:06:41.315 13:40:21 -- common/autotest_common.sh@955 -- # kill 2183590 00:06:41.315 13:40:21 -- common/autotest_common.sh@960 -- # wait 2183590 00:06:41.574 00:06:41.574 real 0m2.209s 00:06:41.574 user 0m6.403s 00:06:41.574 sys 0m0.481s 00:06:41.574 13:40:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.574 13:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:41.574 ************************************ 00:06:41.574 END TEST locking_overlapped_coremask 00:06:41.574 ************************************ 00:06:41.574 13:40:21 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:41.574 13:40:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.574 13:40:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.574 13:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:41.574 ************************************ 00:06:41.574 START TEST locking_overlapped_coremask_via_rpc 00:06:41.574 ************************************ 00:06:41.574 13:40:21 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:41.574 13:40:21 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2183899 00:06:41.574 13:40:21 -- event/cpu_locks.sh@149 -- # waitforlisten 2183899 /var/tmp/spdk.sock 00:06:41.574 13:40:21 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:41.574 13:40:21 -- common/autotest_common.sh@829 -- # '[' -z 2183899 ']' 00:06:41.574 13:40:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.574 13:40:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.574 13:40:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.574 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.574 13:40:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.574 13:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:41.574 [2024-11-29 13:40:21.849660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.574 [2024-11-29 13:40:21.849791] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183899 ] 00:06:41.834 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.834 [2024-11-29 13:40:21.910510] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.834 [2024-11-29 13:40:21.910551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:41.834 [2024-11-29 13:40:21.994614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.834 [2024-11-29 13:40:21.994824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.834 [2024-11-29 13:40:21.994884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:41.834 [2024-11-29 13:40:21.994887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.778 13:40:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.778 13:40:22 -- common/autotest_common.sh@862 -- # return 0 00:06:42.778 13:40:22 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2183952 00:06:42.778 13:40:22 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:42.778 13:40:22 -- event/cpu_locks.sh@153 -- # waitforlisten 2183952 /var/tmp/spdk2.sock 00:06:42.778 13:40:22 -- common/autotest_common.sh@829 -- # '[' -z 2183952 ']' 00:06:42.778 13:40:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.778 13:40:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.778 13:40:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.778 13:40:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.778 13:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:42.778 [2024-11-29 13:40:22.862686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.778 [2024-11-29 13:40:22.862802] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2183952 ] 00:06:42.778 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.778 [2024-11-29 13:40:22.959399] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:42.778 [2024-11-29 13:40:22.959457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:43.038 [2024-11-29 13:40:23.129056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.038 [2024-11-29 13:40:23.129361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:43.038 [2024-11-29 13:40:23.132442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:43.038 [2024-11-29 13:40:23.132444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:43.607 13:40:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.607 13:40:23 -- common/autotest_common.sh@862 -- # return 0 00:06:43.607 13:40:23 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:43.607 13:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.607 13:40:23 -- common/autotest_common.sh@10 -- # set +x 00:06:43.607 13:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.607 13:40:23 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.607 13:40:23 -- common/autotest_common.sh@650 -- # local es=0 00:06:43.607 13:40:23 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.607 13:40:23 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:43.607 13:40:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.607 13:40:23 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:43.607 13:40:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.607 13:40:23 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.607 13:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.607 13:40:23 -- common/autotest_common.sh@10 -- # set +x 00:06:43.607 [2024-11-29 13:40:23.847505] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2183899 has claimed it. 00:06:43.607 request: 00:06:43.607 { 00:06:43.607 "method": "framework_enable_cpumask_locks", 00:06:43.607 "req_id": 1 00:06:43.607 } 00:06:43.607 Got JSON-RPC error response 00:06:43.607 response: 00:06:43.607 { 00:06:43.607 "code": -32603, 00:06:43.607 "message": "Failed to claim CPU core: 2" 00:06:43.607 } 00:06:43.607 13:40:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:43.607 13:40:23 -- common/autotest_common.sh@653 -- # es=1 00:06:43.607 13:40:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:43.607 13:40:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:43.607 13:40:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:43.607 13:40:23 -- event/cpu_locks.sh@158 -- # waitforlisten 2183899 /var/tmp/spdk.sock 00:06:43.607 13:40:23 -- common/autotest_common.sh@829 -- # '[' -z 2183899 ']' 00:06:43.607 13:40:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.607 13:40:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.607 13:40:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.607 13:40:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.607 13:40:23 -- common/autotest_common.sh@10 -- # set +x 00:06:43.866 13:40:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.866 13:40:24 -- common/autotest_common.sh@862 -- # return 0 00:06:43.866 13:40:24 -- event/cpu_locks.sh@159 -- # waitforlisten 2183952 /var/tmp/spdk2.sock 00:06:43.866 13:40:24 -- common/autotest_common.sh@829 -- # '[' -z 2183952 ']' 00:06:43.866 13:40:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:43.866 13:40:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.866 13:40:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:43.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:43.866 13:40:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.866 13:40:24 -- common/autotest_common.sh@10 -- # set +x 00:06:44.125 13:40:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.125 13:40:24 -- common/autotest_common.sh@862 -- # return 0 00:06:44.125 13:40:24 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:44.125 13:40:24 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:44.125 13:40:24 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:44.125 13:40:24 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:44.125 00:06:44.125 real 0m2.580s 00:06:44.125 user 0m1.297s 00:06:44.125 sys 0m0.210s 00:06:44.125 13:40:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.125 13:40:24 -- common/autotest_common.sh@10 -- # set +x 00:06:44.125 ************************************ 00:06:44.125 END TEST locking_overlapped_coremask_via_rpc 00:06:44.125 ************************************ 00:06:44.125 13:40:24 -- event/cpu_locks.sh@174 -- # cleanup 00:06:44.125 13:40:24 -- event/cpu_locks.sh@15 -- # [[ -z 2183899 ]] 00:06:44.125 13:40:24 -- event/cpu_locks.sh@15 -- # killprocess 2183899 00:06:44.125 13:40:24 -- common/autotest_common.sh@936 -- # '[' -z 2183899 ']' 00:06:44.125 13:40:24 -- common/autotest_common.sh@940 -- # kill -0 2183899 00:06:44.125 13:40:24 -- common/autotest_common.sh@941 -- # uname 00:06:44.385 13:40:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.385 13:40:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2183899 00:06:44.385 13:40:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.385 13:40:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.385 13:40:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2183899' 00:06:44.385 killing process with pid 2183899 00:06:44.385 13:40:24 -- common/autotest_common.sh@955 -- # kill 2183899 00:06:44.385 13:40:24 -- common/autotest_common.sh@960 -- # wait 2183899 00:06:44.645 13:40:24 -- event/cpu_locks.sh@16 -- # [[ -z 2183952 ]] 00:06:44.645 13:40:24 -- event/cpu_locks.sh@16 -- # killprocess 2183952 00:06:44.645 13:40:24 -- common/autotest_common.sh@936 -- # '[' -z 2183952 ']' 00:06:44.645 13:40:24 -- common/autotest_common.sh@940 -- # kill -0 2183952 00:06:44.645 13:40:24 -- common/autotest_common.sh@941 -- # uname 00:06:44.645 13:40:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.645 13:40:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2183952 00:06:44.645 13:40:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:44.645 13:40:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:44.645 13:40:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2183952' 00:06:44.645 killing process with pid 2183952 00:06:44.645 13:40:24 -- common/autotest_common.sh@955 -- # kill 2183952 00:06:44.645 13:40:24 -- common/autotest_common.sh@960 -- # wait 2183952 00:06:45.212 13:40:25 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.212 13:40:25 -- event/cpu_locks.sh@1 -- # cleanup 00:06:45.212 13:40:25 -- event/cpu_locks.sh@15 -- # [[ -z 2183899 ]] 00:06:45.212 13:40:25 -- event/cpu_locks.sh@15 -- # killprocess 2183899 00:06:45.212 13:40:25 -- common/autotest_common.sh@936 -- # '[' -z 2183899 ']' 00:06:45.212 13:40:25 -- common/autotest_common.sh@940 -- # kill -0 2183899 00:06:45.212 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2183899) - No such process 00:06:45.212 13:40:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2183899 is not found' 00:06:45.212 Process with pid 2183899 is not found 00:06:45.212 13:40:25 -- event/cpu_locks.sh@16 -- # [[ -z 2183952 ]] 00:06:45.212 13:40:25 -- event/cpu_locks.sh@16 -- # killprocess 2183952 00:06:45.212 13:40:25 -- common/autotest_common.sh@936 -- # '[' -z 2183952 ']' 00:06:45.212 13:40:25 -- common/autotest_common.sh@940 -- # kill -0 2183952 00:06:45.212 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2183952) - No such process 00:06:45.212 13:40:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2183952 is not found' 00:06:45.212 Process with pid 2183952 is not found 00:06:45.212 13:40:25 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.212 00:06:45.212 real 0m19.427s 00:06:45.212 user 0m35.360s 00:06:45.212 sys 0m5.542s 00:06:45.212 13:40:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.212 13:40:25 -- common/autotest_common.sh@10 -- # set +x 00:06:45.212 ************************************ 00:06:45.212 END TEST cpu_locks 00:06:45.212 ************************************ 00:06:45.212 00:06:45.212 real 0m45.344s 00:06:45.212 user 1m27.323s 00:06:45.212 sys 0m9.446s 00:06:45.212 13:40:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.212 13:40:25 -- common/autotest_common.sh@10 -- # set +x 00:06:45.212 ************************************ 00:06:45.212 END TEST event 00:06:45.212 ************************************ 00:06:45.212 13:40:25 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.212 13:40:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.212 13:40:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.212 13:40:25 -- common/autotest_common.sh@10 -- # set +x 00:06:45.212 ************************************ 00:06:45.212 START TEST thread 00:06:45.212 ************************************ 00:06:45.212 13:40:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.212 * Looking for test storage... 00:06:45.212 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:45.212 13:40:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:45.212 13:40:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:45.212 13:40:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:45.213 13:40:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:45.213 13:40:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:45.213 13:40:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:45.213 13:40:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:45.213 13:40:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:45.213 13:40:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:45.213 13:40:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:45.213 13:40:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:45.213 13:40:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:45.213 13:40:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:45.213 13:40:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:45.213 13:40:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:45.213 13:40:25 -- scripts/common.sh@344 -- # : 1 00:06:45.213 13:40:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:45.213 13:40:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:45.213 13:40:25 -- scripts/common.sh@364 -- # decimal 1 00:06:45.213 13:40:25 -- scripts/common.sh@352 -- # local d=1 00:06:45.213 13:40:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:45.213 13:40:25 -- scripts/common.sh@354 -- # echo 1 00:06:45.213 13:40:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:45.213 13:40:25 -- scripts/common.sh@365 -- # decimal 2 00:06:45.213 13:40:25 -- scripts/common.sh@352 -- # local d=2 00:06:45.213 13:40:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:45.213 13:40:25 -- scripts/common.sh@354 -- # echo 2 00:06:45.213 13:40:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:45.213 13:40:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:45.213 13:40:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:45.213 13:40:25 -- scripts/common.sh@367 -- # return 0 00:06:45.213 13:40:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:45.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.213 --rc genhtml_branch_coverage=1 00:06:45.213 --rc genhtml_function_coverage=1 00:06:45.213 --rc genhtml_legend=1 00:06:45.213 --rc geninfo_all_blocks=1 00:06:45.213 --rc geninfo_unexecuted_blocks=1 00:06:45.213 00:06:45.213 ' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:45.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.213 --rc genhtml_branch_coverage=1 00:06:45.213 --rc genhtml_function_coverage=1 00:06:45.213 --rc genhtml_legend=1 00:06:45.213 --rc geninfo_all_blocks=1 00:06:45.213 --rc geninfo_unexecuted_blocks=1 00:06:45.213 00:06:45.213 ' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:45.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.213 --rc genhtml_branch_coverage=1 00:06:45.213 --rc genhtml_function_coverage=1 00:06:45.213 --rc genhtml_legend=1 00:06:45.213 --rc geninfo_all_blocks=1 00:06:45.213 --rc geninfo_unexecuted_blocks=1 00:06:45.213 00:06:45.213 ' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:45.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.213 --rc genhtml_branch_coverage=1 00:06:45.213 --rc genhtml_function_coverage=1 00:06:45.213 --rc genhtml_legend=1 00:06:45.213 --rc geninfo_all_blocks=1 00:06:45.213 --rc geninfo_unexecuted_blocks=1 00:06:45.213 00:06:45.213 ' 00:06:45.213 13:40:25 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.213 13:40:25 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:45.213 13:40:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.213 13:40:25 -- common/autotest_common.sh@10 -- # set +x 00:06:45.213 ************************************ 00:06:45.213 START TEST thread_poller_perf 00:06:45.213 ************************************ 00:06:45.213 13:40:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.473 [2024-11-29 13:40:25.493188] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.473 [2024-11-29 13:40:25.493274] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184459 ] 00:06:45.473 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.473 [2024-11-29 13:40:25.550665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.473 [2024-11-29 13:40:25.638760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.473 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:46.855 [2024-11-29T12:40:27.137Z] ====================================== 00:06:46.855 [2024-11-29T12:40:27.137Z] busy:2717949212 (cyc) 00:06:46.855 [2024-11-29T12:40:27.137Z] total_run_count: 277000 00:06:46.855 [2024-11-29T12:40:27.137Z] tsc_hz: 2700000000 (cyc) 00:06:46.855 [2024-11-29T12:40:27.137Z] ====================================== 00:06:46.855 [2024-11-29T12:40:27.137Z] poller_cost: 9812 (cyc), 3634 (nsec) 00:06:46.855 00:06:46.855 real 0m1.251s 00:06:46.855 user 0m1.164s 00:06:46.855 sys 0m0.080s 00:06:46.855 13:40:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.855 13:40:26 -- common/autotest_common.sh@10 -- # set +x 00:06:46.855 ************************************ 00:06:46.855 END TEST thread_poller_perf 00:06:46.855 ************************************ 00:06:46.855 13:40:26 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.855 13:40:26 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:46.855 13:40:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.855 13:40:26 -- common/autotest_common.sh@10 -- # set +x 00:06:46.855 ************************************ 00:06:46.855 START TEST thread_poller_perf 00:06:46.855 ************************************ 00:06:46.855 13:40:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.855 [2024-11-29 13:40:26.776841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:46.855 [2024-11-29 13:40:26.776931] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184615 ] 00:06:46.855 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.855 [2024-11-29 13:40:26.841752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.855 [2024-11-29 13:40:26.929323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.855 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:47.797 [2024-11-29T12:40:28.079Z] ====================================== 00:06:47.797 [2024-11-29T12:40:28.079Z] busy:2703333622 (cyc) 00:06:47.797 [2024-11-29T12:40:28.079Z] total_run_count: 3874000 00:06:47.797 [2024-11-29T12:40:28.079Z] tsc_hz: 2700000000 (cyc) 00:06:47.797 [2024-11-29T12:40:28.079Z] ====================================== 00:06:47.797 [2024-11-29T12:40:28.079Z] poller_cost: 697 (cyc), 258 (nsec) 00:06:47.797 00:06:47.797 real 0m1.251s 00:06:47.797 user 0m1.159s 00:06:47.797 sys 0m0.085s 00:06:47.797 13:40:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.797 13:40:28 -- common/autotest_common.sh@10 -- # set +x 00:06:47.797 ************************************ 00:06:47.797 END TEST thread_poller_perf 00:06:47.797 ************************************ 00:06:47.797 13:40:28 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:47.797 00:06:47.797 real 0m2.698s 00:06:47.797 user 0m2.434s 00:06:47.797 sys 0m0.268s 00:06:47.798 13:40:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.798 13:40:28 -- common/autotest_common.sh@10 -- # set +x 00:06:47.798 ************************************ 00:06:47.798 END TEST thread 00:06:47.798 ************************************ 00:06:47.798 13:40:28 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:47.798 13:40:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:47.798 13:40:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.798 13:40:28 -- common/autotest_common.sh@10 -- # set +x 00:06:47.798 ************************************ 00:06:47.798 START TEST accel 00:06:47.798 ************************************ 00:06:47.798 13:40:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:48.057 * Looking for test storage... 00:06:48.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:48.057 13:40:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.057 13:40:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.057 13:40:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.057 13:40:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.057 13:40:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.057 13:40:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.057 13:40:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.057 13:40:28 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.057 13:40:28 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.057 13:40:28 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.057 13:40:28 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.057 13:40:28 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.057 13:40:28 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.057 13:40:28 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.057 13:40:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.057 13:40:28 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.057 13:40:28 -- scripts/common.sh@344 -- # : 1 00:06:48.057 13:40:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.057 13:40:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.057 13:40:28 -- scripts/common.sh@364 -- # decimal 1 00:06:48.057 13:40:28 -- scripts/common.sh@352 -- # local d=1 00:06:48.057 13:40:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.057 13:40:28 -- scripts/common.sh@354 -- # echo 1 00:06:48.057 13:40:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.057 13:40:28 -- scripts/common.sh@365 -- # decimal 2 00:06:48.057 13:40:28 -- scripts/common.sh@352 -- # local d=2 00:06:48.057 13:40:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.057 13:40:28 -- scripts/common.sh@354 -- # echo 2 00:06:48.057 13:40:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.057 13:40:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.057 13:40:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.057 13:40:28 -- scripts/common.sh@367 -- # return 0 00:06:48.057 13:40:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.057 13:40:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.057 --rc genhtml_branch_coverage=1 00:06:48.057 --rc genhtml_function_coverage=1 00:06:48.057 --rc genhtml_legend=1 00:06:48.057 --rc geninfo_all_blocks=1 00:06:48.057 --rc geninfo_unexecuted_blocks=1 00:06:48.057 00:06:48.058 ' 00:06:48.058 13:40:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.058 --rc genhtml_branch_coverage=1 00:06:48.058 --rc genhtml_function_coverage=1 00:06:48.058 --rc genhtml_legend=1 00:06:48.058 --rc geninfo_all_blocks=1 00:06:48.058 --rc geninfo_unexecuted_blocks=1 00:06:48.058 00:06:48.058 ' 00:06:48.058 13:40:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.058 --rc genhtml_branch_coverage=1 00:06:48.058 --rc genhtml_function_coverage=1 00:06:48.058 --rc genhtml_legend=1 00:06:48.058 --rc geninfo_all_blocks=1 00:06:48.058 --rc geninfo_unexecuted_blocks=1 00:06:48.058 00:06:48.058 ' 00:06:48.058 13:40:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.058 --rc genhtml_branch_coverage=1 00:06:48.058 --rc genhtml_function_coverage=1 00:06:48.058 --rc genhtml_legend=1 00:06:48.058 --rc geninfo_all_blocks=1 00:06:48.058 --rc geninfo_unexecuted_blocks=1 00:06:48.058 00:06:48.058 ' 00:06:48.058 13:40:28 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:48.058 13:40:28 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:48.058 13:40:28 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:48.058 13:40:28 -- accel/accel.sh@59 -- # spdk_tgt_pid=2184821 00:06:48.058 13:40:28 -- accel/accel.sh@60 -- # waitforlisten 2184821 00:06:48.058 13:40:28 -- common/autotest_common.sh@829 -- # '[' -z 2184821 ']' 00:06:48.058 13:40:28 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:48.058 13:40:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:48.058 13:40:28 -- accel/accel.sh@58 -- # build_accel_config 00:06:48.058 13:40:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.058 13:40:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.058 13:40:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:48.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:48.058 13:40:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.058 13:40:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.058 13:40:28 -- common/autotest_common.sh@10 -- # set +x 00:06:48.058 13:40:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.058 13:40:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.058 13:40:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.058 13:40:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.058 13:40:28 -- accel/accel.sh@42 -- # jq -r . 00:06:48.058 [2024-11-29 13:40:28.251453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.058 [2024-11-29 13:40:28.251532] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184821 ] 00:06:48.058 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.058 [2024-11-29 13:40:28.312348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.317 [2024-11-29 13:40:28.400168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.317 [2024-11-29 13:40:28.400354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.261 13:40:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.261 13:40:29 -- common/autotest_common.sh@862 -- # return 0 00:06:49.261 13:40:29 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:49.261 13:40:29 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:49.261 13:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.261 13:40:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.261 13:40:29 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:49.261 13:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # IFS== 00:06:49.261 13:40:29 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.261 13:40:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.261 13:40:29 -- accel/accel.sh@67 -- # killprocess 2184821 00:06:49.261 13:40:29 -- common/autotest_common.sh@936 -- # '[' -z 2184821 ']' 00:06:49.261 13:40:29 -- common/autotest_common.sh@940 -- # kill -0 2184821 00:06:49.261 13:40:29 -- common/autotest_common.sh@941 -- # uname 00:06:49.261 13:40:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.261 13:40:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2184821 00:06:49.261 13:40:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.261 13:40:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.261 13:40:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2184821' 00:06:49.261 killing process with pid 2184821 00:06:49.261 13:40:29 -- common/autotest_common.sh@955 -- # kill 2184821 00:06:49.261 13:40:29 -- common/autotest_common.sh@960 -- # wait 2184821 00:06:49.521 13:40:29 -- accel/accel.sh@68 -- # trap - ERR 00:06:49.521 13:40:29 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:49.521 13:40:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.521 13:40:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.521 13:40:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.521 13:40:29 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:49.521 13:40:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:49.521 13:40:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.521 13:40:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.521 13:40:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.521 13:40:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.521 13:40:29 -- accel/accel.sh@42 -- # jq -r . 00:06:49.521 13:40:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.521 13:40:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.521 13:40:29 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:49.521 13:40:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:49.521 13:40:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.521 13:40:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.521 ************************************ 00:06:49.521 START TEST accel_missing_filename 00:06:49.521 ************************************ 00:06:49.521 13:40:29 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:49.521 13:40:29 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.521 13:40:29 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:49.521 13:40:29 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:49.521 13:40:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.521 13:40:29 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:49.521 13:40:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.521 13:40:29 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:49.521 13:40:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:49.521 13:40:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.521 13:40:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.521 13:40:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.521 13:40:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.521 13:40:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.521 13:40:29 -- accel/accel.sh@42 -- # jq -r . 00:06:49.521 [2024-11-29 13:40:29.776522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.521 [2024-11-29 13:40:29.776601] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185114 ] 00:06:49.782 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.782 [2024-11-29 13:40:29.841341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.782 [2024-11-29 13:40:29.930112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.782 [2024-11-29 13:40:29.991976] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.044 [2024-11-29 13:40:30.077730] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.044 A filename is required. 00:06:50.044 13:40:30 -- common/autotest_common.sh@653 -- # es=234 00:06:50.044 13:40:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.044 13:40:30 -- common/autotest_common.sh@662 -- # es=106 00:06:50.044 13:40:30 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.044 13:40:30 -- common/autotest_common.sh@670 -- # es=1 00:06:50.044 13:40:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.044 00:06:50.044 real 0m0.403s 00:06:50.044 user 0m0.296s 00:06:50.044 sys 0m0.140s 00:06:50.044 13:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.044 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.044 ************************************ 00:06:50.044 END TEST accel_missing_filename 00:06:50.044 ************************************ 00:06:50.044 13:40:30 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.044 13:40:30 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.044 13:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.044 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.044 ************************************ 00:06:50.044 START TEST accel_compress_verify 00:06:50.044 ************************************ 00:06:50.044 13:40:30 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.044 13:40:30 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.044 13:40:30 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.044 13:40:30 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.044 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.044 13:40:30 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.044 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.044 13:40:30 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.044 13:40:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.044 13:40:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.044 13:40:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.044 13:40:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.044 13:40:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.044 13:40:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.044 13:40:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.044 13:40:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.044 13:40:30 -- accel/accel.sh@42 -- # jq -r . 00:06:50.044 [2024-11-29 13:40:30.205847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.044 [2024-11-29 13:40:30.205928] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185147 ] 00:06:50.044 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.044 [2024-11-29 13:40:30.268422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.306 [2024-11-29 13:40:30.359718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.306 [2024-11-29 13:40:30.422053] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.306 [2024-11-29 13:40:30.503907] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.306 00:06:50.306 Compression does not support the verify option, aborting. 00:06:50.306 13:40:30 -- common/autotest_common.sh@653 -- # es=161 00:06:50.306 13:40:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.306 13:40:30 -- common/autotest_common.sh@662 -- # es=33 00:06:50.306 13:40:30 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.306 13:40:30 -- common/autotest_common.sh@670 -- # es=1 00:06:50.306 13:40:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.306 00:06:50.306 real 0m0.399s 00:06:50.306 user 0m0.293s 00:06:50.306 sys 0m0.139s 00:06:50.306 13:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.306 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.306 ************************************ 00:06:50.306 END TEST accel_compress_verify 00:06:50.306 ************************************ 00:06:50.566 13:40:30 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:50.566 13:40:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.566 13:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.566 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.566 ************************************ 00:06:50.566 START TEST accel_wrong_workload 00:06:50.566 ************************************ 00:06:50.566 13:40:30 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:50.566 13:40:30 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.566 13:40:30 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:50.566 13:40:30 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.566 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.566 13:40:30 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.566 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.566 13:40:30 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:50.566 13:40:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:50.566 13:40:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.566 13:40:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.566 13:40:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.566 13:40:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.566 13:40:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.566 13:40:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.566 13:40:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.566 13:40:30 -- accel/accel.sh@42 -- # jq -r . 00:06:50.566 Unsupported workload type: foobar 00:06:50.566 [2024-11-29 13:40:30.629217] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:50.566 accel_perf options: 00:06:50.566 [-h help message] 00:06:50.566 [-q queue depth per core] 00:06:50.566 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.566 [-T number of threads per core 00:06:50.566 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.566 [-t time in seconds] 00:06:50.566 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.566 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.566 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.566 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.566 [-S for crc32c workload, use this seed value (default 0) 00:06:50.566 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.566 [-f for fill workload, use this BYTE value (default 255) 00:06:50.566 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.566 [-y verify result if this switch is on] 00:06:50.566 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.566 Can be used to spread operations across a wider range of memory. 00:06:50.566 13:40:30 -- common/autotest_common.sh@653 -- # es=1 00:06:50.566 13:40:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.566 13:40:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.566 13:40:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.566 00:06:50.566 real 0m0.023s 00:06:50.566 user 0m0.011s 00:06:50.566 sys 0m0.012s 00:06:50.566 13:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.566 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.566 ************************************ 00:06:50.566 END TEST accel_wrong_workload 00:06:50.567 ************************************ 00:06:50.567 Error: writing output failed: Broken pipe 00:06:50.567 13:40:30 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.567 13:40:30 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.567 13:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.567 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.567 ************************************ 00:06:50.567 START TEST accel_negative_buffers 00:06:50.567 ************************************ 00:06:50.567 13:40:30 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.567 13:40:30 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.567 13:40:30 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:50.567 13:40:30 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.567 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.567 13:40:30 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.567 13:40:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.567 13:40:30 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:50.567 13:40:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:50.567 13:40:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.567 13:40:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.567 13:40:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.567 13:40:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.567 13:40:30 -- accel/accel.sh@42 -- # jq -r . 00:06:50.567 -x option must be non-negative. 00:06:50.567 [2024-11-29 13:40:30.673922] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:50.567 accel_perf options: 00:06:50.567 [-h help message] 00:06:50.567 [-q queue depth per core] 00:06:50.567 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.567 [-T number of threads per core 00:06:50.567 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.567 [-t time in seconds] 00:06:50.567 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.567 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.567 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.567 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.567 [-S for crc32c workload, use this seed value (default 0) 00:06:50.567 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.567 [-f for fill workload, use this BYTE value (default 255) 00:06:50.567 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.567 [-y verify result if this switch is on] 00:06:50.567 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.567 Can be used to spread operations across a wider range of memory. 00:06:50.567 13:40:30 -- common/autotest_common.sh@653 -- # es=1 00:06:50.567 13:40:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.567 13:40:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.567 13:40:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.567 00:06:50.567 real 0m0.019s 00:06:50.567 user 0m0.014s 00:06:50.567 sys 0m0.005s 00:06:50.567 13:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.567 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.567 ************************************ 00:06:50.567 END TEST accel_negative_buffers 00:06:50.567 ************************************ 00:06:50.567 Error: writing output failed: Broken pipe 00:06:50.567 13:40:30 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:50.567 13:40:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:50.567 13:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.567 13:40:30 -- common/autotest_common.sh@10 -- # set +x 00:06:50.567 ************************************ 00:06:50.567 START TEST accel_crc32c 00:06:50.567 ************************************ 00:06:50.567 13:40:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:50.567 13:40:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.567 13:40:30 -- accel/accel.sh@17 -- # local accel_module 00:06:50.567 13:40:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:50.567 13:40:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:50.567 13:40:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.567 13:40:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.567 13:40:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.567 13:40:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.567 13:40:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.567 13:40:30 -- accel/accel.sh@42 -- # jq -r . 00:06:50.567 [2024-11-29 13:40:30.723358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.567 [2024-11-29 13:40:30.723509] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185208 ] 00:06:50.567 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.567 [2024-11-29 13:40:30.788718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.828 [2024-11-29 13:40:30.879771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.208 13:40:32 -- accel/accel.sh@18 -- # out=' 00:06:52.208 SPDK Configuration: 00:06:52.208 Core mask: 0x1 00:06:52.208 00:06:52.208 Accel Perf Configuration: 00:06:52.208 Workload Type: crc32c 00:06:52.208 CRC-32C seed: 32 00:06:52.208 Transfer size: 4096 bytes 00:06:52.208 Vector count 1 00:06:52.208 Module: software 00:06:52.208 Queue depth: 32 00:06:52.208 Allocate depth: 32 00:06:52.208 # threads/core: 1 00:06:52.208 Run time: 1 seconds 00:06:52.208 Verify: Yes 00:06:52.208 00:06:52.208 Running for 1 seconds... 00:06:52.208 00:06:52.208 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.208 ------------------------------------------------------------------------------------ 00:06:52.208 0,0 407008/s 1589 MiB/s 0 0 00:06:52.208 ==================================================================================== 00:06:52.209 Total 407008/s 1589 MiB/s 0 0' 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:52.209 13:40:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.209 13:40:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.209 13:40:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.209 13:40:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.209 13:40:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.209 13:40:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.209 13:40:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.209 13:40:32 -- accel/accel.sh@42 -- # jq -r . 00:06:52.209 [2024-11-29 13:40:32.117024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:52.209 [2024-11-29 13:40:32.117102] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185466 ] 00:06:52.209 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.209 [2024-11-29 13:40:32.178756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.209 [2024-11-29 13:40:32.268434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=0x1 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=crc32c 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=32 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=software 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=32 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=32 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=1 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val=Yes 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:52.209 13:40:32 -- accel/accel.sh@21 -- # val= 00:06:52.209 13:40:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # IFS=: 00:06:52.209 13:40:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@21 -- # val= 00:06:53.594 13:40:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # IFS=: 00:06:53.594 13:40:33 -- accel/accel.sh@20 -- # read -r var val 00:06:53.594 13:40:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.594 13:40:33 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:53.594 13:40:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.594 00:06:53.594 real 0m2.801s 00:06:53.594 user 0m2.502s 00:06:53.594 sys 0m0.293s 00:06:53.594 13:40:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.594 13:40:33 -- common/autotest_common.sh@10 -- # set +x 00:06:53.594 ************************************ 00:06:53.594 END TEST accel_crc32c 00:06:53.594 ************************************ 00:06:53.594 13:40:33 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:53.594 13:40:33 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:53.594 13:40:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.594 13:40:33 -- common/autotest_common.sh@10 -- # set +x 00:06:53.594 ************************************ 00:06:53.594 START TEST accel_crc32c_C2 00:06:53.594 ************************************ 00:06:53.594 13:40:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:53.594 13:40:33 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.594 13:40:33 -- accel/accel.sh@17 -- # local accel_module 00:06:53.594 13:40:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:53.594 13:40:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:53.594 13:40:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.594 13:40:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.594 13:40:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.594 13:40:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.594 13:40:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.594 13:40:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.594 13:40:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.594 13:40:33 -- accel/accel.sh@42 -- # jq -r . 00:06:53.594 [2024-11-29 13:40:33.555134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.594 [2024-11-29 13:40:33.555218] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185628 ] 00:06:53.594 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.594 [2024-11-29 13:40:33.619065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.594 [2024-11-29 13:40:33.707048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.974 13:40:34 -- accel/accel.sh@18 -- # out=' 00:06:54.974 SPDK Configuration: 00:06:54.974 Core mask: 0x1 00:06:54.974 00:06:54.974 Accel Perf Configuration: 00:06:54.974 Workload Type: crc32c 00:06:54.974 CRC-32C seed: 0 00:06:54.974 Transfer size: 4096 bytes 00:06:54.974 Vector count 2 00:06:54.974 Module: software 00:06:54.974 Queue depth: 32 00:06:54.974 Allocate depth: 32 00:06:54.974 # threads/core: 1 00:06:54.974 Run time: 1 seconds 00:06:54.974 Verify: Yes 00:06:54.974 00:06:54.974 Running for 1 seconds... 00:06:54.974 00:06:54.974 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.974 ------------------------------------------------------------------------------------ 00:06:54.974 0,0 316416/s 2472 MiB/s 0 0 00:06:54.974 ==================================================================================== 00:06:54.974 Total 316416/s 1236 MiB/s 0 0' 00:06:54.974 13:40:34 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:54.974 13:40:34 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:54.974 13:40:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.974 13:40:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.974 13:40:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.974 13:40:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.974 13:40:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.974 13:40:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.974 13:40:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.974 13:40:34 -- accel/accel.sh@42 -- # jq -r . 00:06:54.974 [2024-11-29 13:40:34.963533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:54.974 [2024-11-29 13:40:34.963608] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185768 ] 00:06:54.974 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.974 [2024-11-29 13:40:35.025042] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.974 [2024-11-29 13:40:35.115149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=0x1 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=crc32c 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=0 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=software 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=32 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=32 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=1 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val=Yes 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:54.974 13:40:35 -- accel/accel.sh@21 -- # val= 00:06:54.974 13:40:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # IFS=: 00:06:54.974 13:40:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@21 -- # val= 00:06:56.355 13:40:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # IFS=: 00:06:56.355 13:40:36 -- accel/accel.sh@20 -- # read -r var val 00:06:56.355 13:40:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:56.355 13:40:36 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:56.355 13:40:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.355 00:06:56.355 real 0m2.817s 00:06:56.355 user 0m2.547s 00:06:56.355 sys 0m0.262s 00:06:56.355 13:40:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.355 13:40:36 -- common/autotest_common.sh@10 -- # set +x 00:06:56.355 ************************************ 00:06:56.355 END TEST accel_crc32c_C2 00:06:56.355 ************************************ 00:06:56.355 13:40:36 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:56.356 13:40:36 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.356 13:40:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.356 13:40:36 -- common/autotest_common.sh@10 -- # set +x 00:06:56.356 ************************************ 00:06:56.356 START TEST accel_copy 00:06:56.356 ************************************ 00:06:56.356 13:40:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:56.356 13:40:36 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.356 13:40:36 -- accel/accel.sh@17 -- # local accel_module 00:06:56.356 13:40:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:56.356 13:40:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:56.356 13:40:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.356 13:40:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.356 13:40:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.356 13:40:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.356 13:40:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.356 13:40:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.356 13:40:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.356 13:40:36 -- accel/accel.sh@42 -- # jq -r . 00:06:56.356 [2024-11-29 13:40:36.392415] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.356 [2024-11-29 13:40:36.392493] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2185927 ] 00:06:56.356 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.356 [2024-11-29 13:40:36.454308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.356 [2024-11-29 13:40:36.549904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.741 13:40:37 -- accel/accel.sh@18 -- # out=' 00:06:57.741 SPDK Configuration: 00:06:57.741 Core mask: 0x1 00:06:57.741 00:06:57.741 Accel Perf Configuration: 00:06:57.741 Workload Type: copy 00:06:57.741 Transfer size: 4096 bytes 00:06:57.741 Vector count 1 00:06:57.741 Module: software 00:06:57.741 Queue depth: 32 00:06:57.741 Allocate depth: 32 00:06:57.741 # threads/core: 1 00:06:57.741 Run time: 1 seconds 00:06:57.741 Verify: Yes 00:06:57.741 00:06:57.741 Running for 1 seconds... 00:06:57.741 00:06:57.741 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.741 ------------------------------------------------------------------------------------ 00:06:57.741 0,0 279648/s 1092 MiB/s 0 0 00:06:57.741 ==================================================================================== 00:06:57.741 Total 279648/s 1092 MiB/s 0 0' 00:06:57.741 13:40:37 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:57.741 13:40:37 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:57.741 13:40:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.741 13:40:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.741 13:40:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.741 13:40:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.741 13:40:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.741 13:40:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.741 13:40:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.741 13:40:37 -- accel/accel.sh@42 -- # jq -r . 00:06:57.741 [2024-11-29 13:40:37.794983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.741 [2024-11-29 13:40:37.795051] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2186192 ] 00:06:57.741 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.741 [2024-11-29 13:40:37.856360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.741 [2024-11-29 13:40:37.946194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=0x1 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=copy 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=software 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=32 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=32 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=1 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val=Yes 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:57.741 13:40:38 -- accel/accel.sh@21 -- # val= 00:06:57.741 13:40:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # IFS=: 00:06:57.741 13:40:38 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@21 -- # val= 00:06:59.125 13:40:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # IFS=: 00:06:59.125 13:40:39 -- accel/accel.sh@20 -- # read -r var val 00:06:59.125 13:40:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.125 13:40:39 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:59.125 13:40:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.125 00:06:59.125 real 0m2.805s 00:06:59.125 user 0m2.506s 00:06:59.125 sys 0m0.289s 00:06:59.125 13:40:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.125 13:40:39 -- common/autotest_common.sh@10 -- # set +x 00:06:59.125 ************************************ 00:06:59.125 END TEST accel_copy 00:06:59.125 ************************************ 00:06:59.125 13:40:39 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.125 13:40:39 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:59.125 13:40:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.125 13:40:39 -- common/autotest_common.sh@10 -- # set +x 00:06:59.125 ************************************ 00:06:59.125 START TEST accel_fill 00:06:59.125 ************************************ 00:06:59.125 13:40:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.125 13:40:39 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.125 13:40:39 -- accel/accel.sh@17 -- # local accel_module 00:06:59.125 13:40:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.125 13:40:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.125 13:40:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.125 13:40:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.125 13:40:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.125 13:40:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.125 13:40:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.125 13:40:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.125 13:40:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.125 13:40:39 -- accel/accel.sh@42 -- # jq -r . 00:06:59.125 [2024-11-29 13:40:39.222295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.125 [2024-11-29 13:40:39.222379] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2186349 ] 00:06:59.125 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.125 [2024-11-29 13:40:39.284521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.125 [2024-11-29 13:40:39.375164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.558 13:40:40 -- accel/accel.sh@18 -- # out=' 00:07:00.558 SPDK Configuration: 00:07:00.558 Core mask: 0x1 00:07:00.558 00:07:00.558 Accel Perf Configuration: 00:07:00.558 Workload Type: fill 00:07:00.558 Fill pattern: 0x80 00:07:00.558 Transfer size: 4096 bytes 00:07:00.558 Vector count 1 00:07:00.558 Module: software 00:07:00.558 Queue depth: 64 00:07:00.558 Allocate depth: 64 00:07:00.558 # threads/core: 1 00:07:00.558 Run time: 1 seconds 00:07:00.558 Verify: Yes 00:07:00.558 00:07:00.558 Running for 1 seconds... 00:07:00.558 00:07:00.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.558 ------------------------------------------------------------------------------------ 00:07:00.558 0,0 407872/s 1593 MiB/s 0 0 00:07:00.558 ==================================================================================== 00:07:00.558 Total 407872/s 1593 MiB/s 0 0' 00:07:00.558 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.558 13:40:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.558 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.558 13:40:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.558 13:40:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.558 13:40:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.558 13:40:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.558 13:40:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.558 13:40:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.558 13:40:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.558 13:40:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.559 13:40:40 -- accel/accel.sh@42 -- # jq -r . 00:07:00.559 [2024-11-29 13:40:40.629069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.559 [2024-11-29 13:40:40.629142] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2186493 ] 00:07:00.559 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.559 [2024-11-29 13:40:40.690868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.559 [2024-11-29 13:40:40.782050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=0x1 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=fill 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=0x80 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=software 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=64 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=64 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=1 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val=Yes 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:00.819 13:40:40 -- accel/accel.sh@21 -- # val= 00:07:00.819 13:40:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # IFS=: 00:07:00.819 13:40:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@21 -- # val= 00:07:01.761 13:40:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # IFS=: 00:07:01.761 13:40:42 -- accel/accel.sh@20 -- # read -r var val 00:07:01.761 13:40:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.761 13:40:42 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:01.761 13:40:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.761 00:07:01.761 real 0m2.816s 00:07:01.761 user 0m2.516s 00:07:01.761 sys 0m0.292s 00:07:01.761 13:40:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.761 13:40:42 -- common/autotest_common.sh@10 -- # set +x 00:07:01.761 ************************************ 00:07:01.761 END TEST accel_fill 00:07:01.761 ************************************ 00:07:01.761 13:40:42 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:01.761 13:40:42 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:01.761 13:40:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.761 13:40:42 -- common/autotest_common.sh@10 -- # set +x 00:07:02.021 ************************************ 00:07:02.021 START TEST accel_copy_crc32c 00:07:02.021 ************************************ 00:07:02.021 13:40:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:02.021 13:40:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.021 13:40:42 -- accel/accel.sh@17 -- # local accel_module 00:07:02.021 13:40:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:02.021 13:40:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:02.021 13:40:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.021 13:40:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.021 13:40:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.021 13:40:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.021 13:40:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.021 13:40:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.021 13:40:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.021 13:40:42 -- accel/accel.sh@42 -- # jq -r . 00:07:02.021 [2024-11-29 13:40:42.061770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.021 [2024-11-29 13:40:42.061850] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2186650 ] 00:07:02.021 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.021 [2024-11-29 13:40:42.126103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.021 [2024-11-29 13:40:42.215851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.403 13:40:43 -- accel/accel.sh@18 -- # out=' 00:07:03.403 SPDK Configuration: 00:07:03.403 Core mask: 0x1 00:07:03.403 00:07:03.403 Accel Perf Configuration: 00:07:03.403 Workload Type: copy_crc32c 00:07:03.403 CRC-32C seed: 0 00:07:03.403 Vector size: 4096 bytes 00:07:03.403 Transfer size: 4096 bytes 00:07:03.403 Vector count 1 00:07:03.403 Module: software 00:07:03.403 Queue depth: 32 00:07:03.403 Allocate depth: 32 00:07:03.403 # threads/core: 1 00:07:03.403 Run time: 1 seconds 00:07:03.403 Verify: Yes 00:07:03.403 00:07:03.403 Running for 1 seconds... 00:07:03.403 00:07:03.403 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.403 ------------------------------------------------------------------------------------ 00:07:03.403 0,0 219232/s 856 MiB/s 0 0 00:07:03.403 ==================================================================================== 00:07:03.403 Total 219232/s 856 MiB/s 0 0' 00:07:03.403 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.403 13:40:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:03.403 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.403 13:40:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:03.403 13:40:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.403 13:40:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.403 13:40:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.403 13:40:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.403 13:40:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.403 13:40:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.403 13:40:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.403 13:40:43 -- accel/accel.sh@42 -- # jq -r . 00:07:03.403 [2024-11-29 13:40:43.465194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.403 [2024-11-29 13:40:43.465276] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2186913 ] 00:07:03.403 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.403 [2024-11-29 13:40:43.531662] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.403 [2024-11-29 13:40:43.621602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.403 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.403 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.403 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=0x1 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=0 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=software 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=32 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=32 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=1 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val=Yes 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:03.664 13:40:43 -- accel/accel.sh@21 -- # val= 00:07:03.664 13:40:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # IFS=: 00:07:03.664 13:40:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@21 -- # val= 00:07:04.603 13:40:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # IFS=: 00:07:04.603 13:40:44 -- accel/accel.sh@20 -- # read -r var val 00:07:04.603 13:40:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.603 13:40:44 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:04.603 13:40:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.603 00:07:04.603 real 0m2.813s 00:07:04.603 user 0m2.509s 00:07:04.603 sys 0m0.296s 00:07:04.603 13:40:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.603 13:40:44 -- common/autotest_common.sh@10 -- # set +x 00:07:04.603 ************************************ 00:07:04.603 END TEST accel_copy_crc32c 00:07:04.603 ************************************ 00:07:04.603 13:40:44 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:04.603 13:40:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:04.603 13:40:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.603 13:40:44 -- common/autotest_common.sh@10 -- # set +x 00:07:04.864 ************************************ 00:07:04.864 START TEST accel_copy_crc32c_C2 00:07:04.864 ************************************ 00:07:04.864 13:40:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:04.864 13:40:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.864 13:40:44 -- accel/accel.sh@17 -- # local accel_module 00:07:04.864 13:40:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:04.864 13:40:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:04.864 13:40:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.864 13:40:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.864 13:40:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.864 13:40:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.864 13:40:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.864 13:40:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.864 13:40:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.864 13:40:44 -- accel/accel.sh@42 -- # jq -r . 00:07:04.864 [2024-11-29 13:40:44.902532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:04.864 [2024-11-29 13:40:44.902609] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187078 ] 00:07:04.864 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.864 [2024-11-29 13:40:44.964681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.864 [2024-11-29 13:40:45.055290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.245 13:40:46 -- accel/accel.sh@18 -- # out=' 00:07:06.245 SPDK Configuration: 00:07:06.245 Core mask: 0x1 00:07:06.245 00:07:06.245 Accel Perf Configuration: 00:07:06.245 Workload Type: copy_crc32c 00:07:06.245 CRC-32C seed: 0 00:07:06.245 Vector size: 4096 bytes 00:07:06.245 Transfer size: 8192 bytes 00:07:06.245 Vector count 2 00:07:06.245 Module: software 00:07:06.245 Queue depth: 32 00:07:06.245 Allocate depth: 32 00:07:06.245 # threads/core: 1 00:07:06.245 Run time: 1 seconds 00:07:06.245 Verify: Yes 00:07:06.245 00:07:06.245 Running for 1 seconds... 00:07:06.245 00:07:06.245 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.245 ------------------------------------------------------------------------------------ 00:07:06.245 0,0 158176/s 1235 MiB/s 0 0 00:07:06.245 ==================================================================================== 00:07:06.245 Total 158176/s 617 MiB/s 0 0' 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:06.245 13:40:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.245 13:40:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.245 13:40:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.245 13:40:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.245 13:40:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.245 13:40:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.245 13:40:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.245 13:40:46 -- accel/accel.sh@42 -- # jq -r . 00:07:06.245 [2024-11-29 13:40:46.308286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.245 [2024-11-29 13:40:46.308360] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187216 ] 00:07:06.245 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.245 [2024-11-29 13:40:46.368900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.245 [2024-11-29 13:40:46.460910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val=0x1 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.245 13:40:46 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:06.245 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.245 13:40:46 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.245 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.504 13:40:46 -- accel/accel.sh@21 -- # val=0 00:07:06.504 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.504 13:40:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.504 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.504 13:40:46 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:06.504 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.504 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.504 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.504 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val=software 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val=32 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val=32 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val=1 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val=Yes 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:06.505 13:40:46 -- accel/accel.sh@21 -- # val= 00:07:06.505 13:40:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # IFS=: 00:07:06.505 13:40:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@21 -- # val= 00:07:07.447 13:40:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # IFS=: 00:07:07.447 13:40:47 -- accel/accel.sh@20 -- # read -r var val 00:07:07.447 13:40:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.448 13:40:47 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:07.448 13:40:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.448 00:07:07.448 real 0m2.816s 00:07:07.448 user 0m2.519s 00:07:07.448 sys 0m0.289s 00:07:07.448 13:40:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.448 13:40:47 -- common/autotest_common.sh@10 -- # set +x 00:07:07.448 ************************************ 00:07:07.448 END TEST accel_copy_crc32c_C2 00:07:07.448 ************************************ 00:07:07.448 13:40:47 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:07.448 13:40:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.448 13:40:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.448 13:40:47 -- common/autotest_common.sh@10 -- # set +x 00:07:07.448 ************************************ 00:07:07.448 START TEST accel_dualcast 00:07:07.448 ************************************ 00:07:07.448 13:40:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:07.448 13:40:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.448 13:40:47 -- accel/accel.sh@17 -- # local accel_module 00:07:07.448 13:40:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:07.448 13:40:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:07.448 13:40:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.448 13:40:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.448 13:40:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.448 13:40:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.448 13:40:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.448 13:40:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.448 13:40:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.448 13:40:47 -- accel/accel.sh@42 -- # jq -r . 00:07:07.709 [2024-11-29 13:40:47.741586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.709 [2024-11-29 13:40:47.741660] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187377 ] 00:07:07.709 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.709 [2024-11-29 13:40:47.803990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.709 [2024-11-29 13:40:47.892941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.119 13:40:49 -- accel/accel.sh@18 -- # out=' 00:07:09.119 SPDK Configuration: 00:07:09.119 Core mask: 0x1 00:07:09.119 00:07:09.119 Accel Perf Configuration: 00:07:09.119 Workload Type: dualcast 00:07:09.119 Transfer size: 4096 bytes 00:07:09.119 Vector count 1 00:07:09.119 Module: software 00:07:09.119 Queue depth: 32 00:07:09.119 Allocate depth: 32 00:07:09.119 # threads/core: 1 00:07:09.119 Run time: 1 seconds 00:07:09.119 Verify: Yes 00:07:09.119 00:07:09.119 Running for 1 seconds... 00:07:09.119 00:07:09.119 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.119 ------------------------------------------------------------------------------------ 00:07:09.119 0,0 299136/s 1168 MiB/s 0 0 00:07:09.119 ==================================================================================== 00:07:09.119 Total 299136/s 1168 MiB/s 0 0' 00:07:09.119 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.119 13:40:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:09.119 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.119 13:40:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:09.119 13:40:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.119 13:40:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.119 13:40:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.119 13:40:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.119 13:40:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.119 13:40:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.119 13:40:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.119 13:40:49 -- accel/accel.sh@42 -- # jq -r . 00:07:09.119 [2024-11-29 13:40:49.135812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.119 [2024-11-29 13:40:49.135884] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187634 ] 00:07:09.119 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.119 [2024-11-29 13:40:49.196556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.119 [2024-11-29 13:40:49.285732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.119 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.119 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.119 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.119 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.119 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.119 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.119 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=0x1 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=dualcast 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=software 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=32 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=32 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=1 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val=Yes 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:09.120 13:40:49 -- accel/accel.sh@21 -- # val= 00:07:09.120 13:40:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # IFS=: 00:07:09.120 13:40:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.501 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.501 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.501 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.501 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.501 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.501 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.501 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.501 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.502 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.502 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.502 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.502 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.502 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.502 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.502 13:40:50 -- accel/accel.sh@21 -- # val= 00:07:10.502 13:40:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # IFS=: 00:07:10.502 13:40:50 -- accel/accel.sh@20 -- # read -r var val 00:07:10.502 13:40:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.502 13:40:50 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:10.502 13:40:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.502 00:07:10.502 real 0m2.790s 00:07:10.502 user 0m2.489s 00:07:10.502 sys 0m0.291s 00:07:10.502 13:40:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.502 13:40:50 -- common/autotest_common.sh@10 -- # set +x 00:07:10.502 ************************************ 00:07:10.502 END TEST accel_dualcast 00:07:10.502 ************************************ 00:07:10.502 13:40:50 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:10.502 13:40:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:10.502 13:40:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.502 13:40:50 -- common/autotest_common.sh@10 -- # set +x 00:07:10.502 ************************************ 00:07:10.502 START TEST accel_compare 00:07:10.502 ************************************ 00:07:10.502 13:40:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:10.502 13:40:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.502 13:40:50 -- accel/accel.sh@17 -- # local accel_module 00:07:10.502 13:40:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:10.502 13:40:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:10.502 13:40:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.502 13:40:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.502 13:40:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.502 13:40:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.502 13:40:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.502 13:40:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.502 13:40:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.502 13:40:50 -- accel/accel.sh@42 -- # jq -r . 00:07:10.502 [2024-11-29 13:40:50.552025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.502 [2024-11-29 13:40:50.552107] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187805 ] 00:07:10.502 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.502 [2024-11-29 13:40:50.617910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.502 [2024-11-29 13:40:50.708920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.883 13:40:51 -- accel/accel.sh@18 -- # out=' 00:07:11.883 SPDK Configuration: 00:07:11.883 Core mask: 0x1 00:07:11.883 00:07:11.883 Accel Perf Configuration: 00:07:11.883 Workload Type: compare 00:07:11.883 Transfer size: 4096 bytes 00:07:11.883 Vector count 1 00:07:11.883 Module: software 00:07:11.883 Queue depth: 32 00:07:11.883 Allocate depth: 32 00:07:11.883 # threads/core: 1 00:07:11.883 Run time: 1 seconds 00:07:11.883 Verify: Yes 00:07:11.883 00:07:11.883 Running for 1 seconds... 00:07:11.883 00:07:11.883 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.883 ------------------------------------------------------------------------------------ 00:07:11.883 0,0 399136/s 1559 MiB/s 0 0 00:07:11.883 ==================================================================================== 00:07:11.883 Total 399136/s 1559 MiB/s 0 0' 00:07:11.883 13:40:51 -- accel/accel.sh@20 -- # IFS=: 00:07:11.883 13:40:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:11.883 13:40:51 -- accel/accel.sh@20 -- # read -r var val 00:07:11.883 13:40:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:11.883 13:40:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.883 13:40:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.883 13:40:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.883 13:40:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.883 13:40:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.883 13:40:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.883 13:40:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.883 13:40:51 -- accel/accel.sh@42 -- # jq -r . 00:07:11.883 [2024-11-29 13:40:51.963957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:11.883 [2024-11-29 13:40:51.964041] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187943 ] 00:07:11.883 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.883 [2024-11-29 13:40:52.025758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.883 [2024-11-29 13:40:52.115859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=0x1 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=compare 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=software 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=32 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=32 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=1 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val=Yes 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.143 13:40:52 -- accel/accel.sh@21 -- # val= 00:07:12.143 13:40:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.143 13:40:52 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@21 -- # val= 00:07:13.081 13:40:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # IFS=: 00:07:13.081 13:40:53 -- accel/accel.sh@20 -- # read -r var val 00:07:13.081 13:40:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.081 13:40:53 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:13.081 13:40:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.081 00:07:13.081 real 0m2.817s 00:07:13.081 user 0m2.525s 00:07:13.081 sys 0m0.284s 00:07:13.081 13:40:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.081 13:40:53 -- common/autotest_common.sh@10 -- # set +x 00:07:13.081 ************************************ 00:07:13.081 END TEST accel_compare 00:07:13.081 ************************************ 00:07:13.340 13:40:53 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:13.340 13:40:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.340 13:40:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.340 13:40:53 -- common/autotest_common.sh@10 -- # set +x 00:07:13.340 ************************************ 00:07:13.340 START TEST accel_xor 00:07:13.340 ************************************ 00:07:13.340 13:40:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:13.340 13:40:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.340 13:40:53 -- accel/accel.sh@17 -- # local accel_module 00:07:13.340 13:40:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:13.340 13:40:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:13.340 13:40:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.340 13:40:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.340 13:40:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.341 13:40:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.341 13:40:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.341 13:40:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.341 13:40:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.341 13:40:53 -- accel/accel.sh@42 -- # jq -r . 00:07:13.341 [2024-11-29 13:40:53.398650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.341 [2024-11-29 13:40:53.398739] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188098 ] 00:07:13.341 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.341 [2024-11-29 13:40:53.462290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.341 [2024-11-29 13:40:53.553488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.715 13:40:54 -- accel/accel.sh@18 -- # out=' 00:07:14.715 SPDK Configuration: 00:07:14.715 Core mask: 0x1 00:07:14.715 00:07:14.715 Accel Perf Configuration: 00:07:14.715 Workload Type: xor 00:07:14.715 Source buffers: 2 00:07:14.715 Transfer size: 4096 bytes 00:07:14.715 Vector count 1 00:07:14.715 Module: software 00:07:14.715 Queue depth: 32 00:07:14.715 Allocate depth: 32 00:07:14.715 # threads/core: 1 00:07:14.715 Run time: 1 seconds 00:07:14.715 Verify: Yes 00:07:14.715 00:07:14.715 Running for 1 seconds... 00:07:14.715 00:07:14.715 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.715 ------------------------------------------------------------------------------------ 00:07:14.715 0,0 193152/s 754 MiB/s 0 0 00:07:14.715 ==================================================================================== 00:07:14.715 Total 193152/s 754 MiB/s 0 0' 00:07:14.715 13:40:54 -- accel/accel.sh@20 -- # IFS=: 00:07:14.715 13:40:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:14.715 13:40:54 -- accel/accel.sh@20 -- # read -r var val 00:07:14.715 13:40:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:14.715 13:40:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.715 13:40:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.715 13:40:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.715 13:40:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.715 13:40:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.715 13:40:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.715 13:40:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.715 13:40:54 -- accel/accel.sh@42 -- # jq -r . 00:07:14.715 [2024-11-29 13:40:54.795315] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.715 [2024-11-29 13:40:54.795409] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188361 ] 00:07:14.715 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.715 [2024-11-29 13:40:54.859651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.715 [2024-11-29 13:40:54.947408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=0x1 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=xor 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=2 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=software 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=32 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=32 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=1 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val=Yes 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:14.974 13:40:55 -- accel/accel.sh@21 -- # val= 00:07:14.974 13:40:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # IFS=: 00:07:14.974 13:40:55 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@21 -- # val= 00:07:15.908 13:40:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # IFS=: 00:07:15.908 13:40:56 -- accel/accel.sh@20 -- # read -r var val 00:07:15.908 13:40:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:15.908 13:40:56 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:15.908 13:40:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:15.908 00:07:15.908 real 0m2.788s 00:07:15.908 user 0m2.488s 00:07:15.908 sys 0m0.291s 00:07:15.908 13:40:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.908 13:40:56 -- common/autotest_common.sh@10 -- # set +x 00:07:15.908 ************************************ 00:07:15.908 END TEST accel_xor 00:07:15.908 ************************************ 00:07:15.908 13:40:56 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:15.908 13:40:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:15.908 13:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.908 13:40:56 -- common/autotest_common.sh@10 -- # set +x 00:07:16.169 ************************************ 00:07:16.169 START TEST accel_xor 00:07:16.169 ************************************ 00:07:16.169 13:40:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:16.169 13:40:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.169 13:40:56 -- accel/accel.sh@17 -- # local accel_module 00:07:16.169 13:40:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:16.169 13:40:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:16.169 13:40:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.169 13:40:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.169 13:40:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.169 13:40:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.169 13:40:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.169 13:40:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.169 13:40:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.169 13:40:56 -- accel/accel.sh@42 -- # jq -r . 00:07:16.169 [2024-11-29 13:40:56.209369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.169 [2024-11-29 13:40:56.209469] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188526 ] 00:07:16.169 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.169 [2024-11-29 13:40:56.270615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.169 [2024-11-29 13:40:56.361529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.550 13:40:57 -- accel/accel.sh@18 -- # out=' 00:07:17.550 SPDK Configuration: 00:07:17.550 Core mask: 0x1 00:07:17.550 00:07:17.550 Accel Perf Configuration: 00:07:17.550 Workload Type: xor 00:07:17.550 Source buffers: 3 00:07:17.550 Transfer size: 4096 bytes 00:07:17.550 Vector count 1 00:07:17.550 Module: software 00:07:17.550 Queue depth: 32 00:07:17.550 Allocate depth: 32 00:07:17.550 # threads/core: 1 00:07:17.551 Run time: 1 seconds 00:07:17.551 Verify: Yes 00:07:17.551 00:07:17.551 Running for 1 seconds... 00:07:17.551 00:07:17.551 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.551 ------------------------------------------------------------------------------------ 00:07:17.551 0,0 185152/s 723 MiB/s 0 0 00:07:17.551 ==================================================================================== 00:07:17.551 Total 185152/s 723 MiB/s 0 0' 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.551 13:40:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:17.551 13:40:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.551 13:40:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.551 13:40:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.551 13:40:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.551 13:40:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.551 13:40:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.551 13:40:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.551 13:40:57 -- accel/accel.sh@42 -- # jq -r . 00:07:17.551 [2024-11-29 13:40:57.614929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.551 [2024-11-29 13:40:57.615013] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188670 ] 00:07:17.551 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.551 [2024-11-29 13:40:57.676997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.551 [2024-11-29 13:40:57.767090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.551 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.551 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.551 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.551 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.551 13:40:57 -- accel/accel.sh@21 -- # val=0x1 00:07:17.551 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.551 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.551 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.551 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.551 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.551 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=xor 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=3 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=software 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=32 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=32 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=1 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val=Yes 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:17.810 13:40:57 -- accel/accel.sh@21 -- # val= 00:07:17.810 13:40:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # IFS=: 00:07:17.810 13:40:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@21 -- # val= 00:07:18.748 13:40:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # IFS=: 00:07:18.748 13:40:58 -- accel/accel.sh@20 -- # read -r var val 00:07:18.748 13:40:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.748 13:40:58 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:18.748 13:40:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.748 00:07:18.749 real 0m2.810s 00:07:18.749 user 0m2.505s 00:07:18.749 sys 0m0.296s 00:07:18.749 13:40:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.749 13:40:58 -- common/autotest_common.sh@10 -- # set +x 00:07:18.749 ************************************ 00:07:18.749 END TEST accel_xor 00:07:18.749 ************************************ 00:07:18.749 13:40:59 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:18.749 13:40:59 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:18.749 13:40:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.749 13:40:59 -- common/autotest_common.sh@10 -- # set +x 00:07:18.749 ************************************ 00:07:18.749 START TEST accel_dif_verify 00:07:18.749 ************************************ 00:07:18.749 13:40:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:18.749 13:40:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.749 13:40:59 -- accel/accel.sh@17 -- # local accel_module 00:07:18.749 13:40:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:18.749 13:40:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:18.749 13:40:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.749 13:40:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.749 13:40:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.749 13:40:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.749 13:40:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.749 13:40:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.749 13:40:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.749 13:40:59 -- accel/accel.sh@42 -- # jq -r . 00:07:19.008 [2024-11-29 13:40:59.043940] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.008 [2024-11-29 13:40:59.044020] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188825 ] 00:07:19.008 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.008 [2024-11-29 13:40:59.105981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.008 [2024-11-29 13:40:59.197731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.391 13:41:00 -- accel/accel.sh@18 -- # out=' 00:07:20.391 SPDK Configuration: 00:07:20.391 Core mask: 0x1 00:07:20.391 00:07:20.391 Accel Perf Configuration: 00:07:20.391 Workload Type: dif_verify 00:07:20.391 Vector size: 4096 bytes 00:07:20.391 Transfer size: 4096 bytes 00:07:20.391 Block size: 512 bytes 00:07:20.391 Metadata size: 8 bytes 00:07:20.391 Vector count 1 00:07:20.391 Module: software 00:07:20.391 Queue depth: 32 00:07:20.391 Allocate depth: 32 00:07:20.391 # threads/core: 1 00:07:20.391 Run time: 1 seconds 00:07:20.391 Verify: No 00:07:20.391 00:07:20.391 Running for 1 seconds... 00:07:20.391 00:07:20.391 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.391 ------------------------------------------------------------------------------------ 00:07:20.391 0,0 82304/s 326 MiB/s 0 0 00:07:20.391 ==================================================================================== 00:07:20.391 Total 82304/s 321 MiB/s 0 0' 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:20.391 13:41:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.391 13:41:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.391 13:41:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.391 13:41:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.391 13:41:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.391 13:41:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.391 13:41:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.391 13:41:00 -- accel/accel.sh@42 -- # jq -r . 00:07:20.391 [2024-11-29 13:41:00.435271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.391 [2024-11-29 13:41:00.435354] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189078 ] 00:07:20.391 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.391 [2024-11-29 13:41:00.499132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.391 [2024-11-29 13:41:00.592732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=0x1 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=dif_verify 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=software 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=32 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=32 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=1 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val=No 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:20.391 13:41:00 -- accel/accel.sh@21 -- # val= 00:07:20.391 13:41:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # IFS=: 00:07:20.391 13:41:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@21 -- # val= 00:07:21.771 13:41:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # IFS=: 00:07:21.771 13:41:01 -- accel/accel.sh@20 -- # read -r var val 00:07:21.771 13:41:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.771 13:41:01 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:21.771 13:41:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.771 00:07:21.771 real 0m2.787s 00:07:21.771 user 0m2.486s 00:07:21.771 sys 0m0.295s 00:07:21.771 13:41:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.771 13:41:01 -- common/autotest_common.sh@10 -- # set +x 00:07:21.771 ************************************ 00:07:21.771 END TEST accel_dif_verify 00:07:21.771 ************************************ 00:07:21.771 13:41:01 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:21.771 13:41:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:21.771 13:41:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.771 13:41:01 -- common/autotest_common.sh@10 -- # set +x 00:07:21.771 ************************************ 00:07:21.771 START TEST accel_dif_generate 00:07:21.771 ************************************ 00:07:21.771 13:41:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:21.771 13:41:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.771 13:41:01 -- accel/accel.sh@17 -- # local accel_module 00:07:21.771 13:41:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:21.771 13:41:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:21.771 13:41:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.771 13:41:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.771 13:41:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.771 13:41:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.771 13:41:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.771 13:41:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.771 13:41:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.771 13:41:01 -- accel/accel.sh@42 -- # jq -r . 00:07:21.771 [2024-11-29 13:41:01.857988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:21.771 [2024-11-29 13:41:01.858073] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189251 ] 00:07:21.771 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.771 [2024-11-29 13:41:01.921793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.771 [2024-11-29 13:41:02.011407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.145 13:41:03 -- accel/accel.sh@18 -- # out=' 00:07:23.145 SPDK Configuration: 00:07:23.145 Core mask: 0x1 00:07:23.145 00:07:23.145 Accel Perf Configuration: 00:07:23.145 Workload Type: dif_generate 00:07:23.145 Vector size: 4096 bytes 00:07:23.145 Transfer size: 4096 bytes 00:07:23.145 Block size: 512 bytes 00:07:23.145 Metadata size: 8 bytes 00:07:23.145 Vector count 1 00:07:23.145 Module: software 00:07:23.145 Queue depth: 32 00:07:23.145 Allocate depth: 32 00:07:23.145 # threads/core: 1 00:07:23.145 Run time: 1 seconds 00:07:23.145 Verify: No 00:07:23.145 00:07:23.145 Running for 1 seconds... 00:07:23.145 00:07:23.145 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.145 ------------------------------------------------------------------------------------ 00:07:23.145 0,0 98656/s 391 MiB/s 0 0 00:07:23.145 ==================================================================================== 00:07:23.145 Total 98656/s 385 MiB/s 0 0' 00:07:23.145 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.145 13:41:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:23.145 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.145 13:41:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:23.145 13:41:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.145 13:41:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.145 13:41:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.145 13:41:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.145 13:41:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.145 13:41:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.145 13:41:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.145 13:41:03 -- accel/accel.sh@42 -- # jq -r . 00:07:23.145 [2024-11-29 13:41:03.268815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.145 [2024-11-29 13:41:03.268898] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189391 ] 00:07:23.145 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.145 [2024-11-29 13:41:03.331355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.145 [2024-11-29 13:41:03.421662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=0x1 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=dif_generate 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=software 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=32 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=32 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=1 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val=No 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:23.405 13:41:03 -- accel/accel.sh@21 -- # val= 00:07:23.405 13:41:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # IFS=: 00:07:23.405 13:41:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@21 -- # val= 00:07:24.786 13:41:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # IFS=: 00:07:24.786 13:41:04 -- accel/accel.sh@20 -- # read -r var val 00:07:24.786 13:41:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.786 13:41:04 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:24.786 13:41:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.786 00:07:24.786 real 0m2.821s 00:07:24.786 user 0m2.524s 00:07:24.786 sys 0m0.291s 00:07:24.786 13:41:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.786 13:41:04 -- common/autotest_common.sh@10 -- # set +x 00:07:24.786 ************************************ 00:07:24.786 END TEST accel_dif_generate 00:07:24.786 ************************************ 00:07:24.786 13:41:04 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:24.786 13:41:04 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:24.786 13:41:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.786 13:41:04 -- common/autotest_common.sh@10 -- # set +x 00:07:24.786 ************************************ 00:07:24.786 START TEST accel_dif_generate_copy 00:07:24.786 ************************************ 00:07:24.786 13:41:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:24.786 13:41:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.786 13:41:04 -- accel/accel.sh@17 -- # local accel_module 00:07:24.786 13:41:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:24.786 13:41:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:24.786 13:41:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.786 13:41:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.786 13:41:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.786 13:41:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.786 13:41:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.786 13:41:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.786 13:41:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.786 13:41:04 -- accel/accel.sh@42 -- # jq -r . 00:07:24.786 [2024-11-29 13:41:04.702272] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.786 [2024-11-29 13:41:04.702354] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189550 ] 00:07:24.786 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.786 [2024-11-29 13:41:04.765093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.786 [2024-11-29 13:41:04.858946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.162 13:41:06 -- accel/accel.sh@18 -- # out=' 00:07:26.162 SPDK Configuration: 00:07:26.162 Core mask: 0x1 00:07:26.162 00:07:26.162 Accel Perf Configuration: 00:07:26.162 Workload Type: dif_generate_copy 00:07:26.162 Vector size: 4096 bytes 00:07:26.162 Transfer size: 4096 bytes 00:07:26.162 Vector count 1 00:07:26.162 Module: software 00:07:26.162 Queue depth: 32 00:07:26.162 Allocate depth: 32 00:07:26.162 # threads/core: 1 00:07:26.162 Run time: 1 seconds 00:07:26.162 Verify: No 00:07:26.162 00:07:26.162 Running for 1 seconds... 00:07:26.162 00:07:26.162 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.162 ------------------------------------------------------------------------------------ 00:07:26.162 0,0 76160/s 302 MiB/s 0 0 00:07:26.162 ==================================================================================== 00:07:26.162 Total 76160/s 297 MiB/s 0 0' 00:07:26.162 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.162 13:41:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:26.162 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.162 13:41:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:26.162 13:41:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.162 13:41:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.162 13:41:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.162 13:41:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.162 13:41:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.162 13:41:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.162 13:41:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.162 13:41:06 -- accel/accel.sh@42 -- # jq -r . 00:07:26.162 [2024-11-29 13:41:06.103240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.163 [2024-11-29 13:41:06.103323] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189809 ] 00:07:26.163 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.163 [2024-11-29 13:41:06.164706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.163 [2024-11-29 13:41:06.254958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=0x1 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=software 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=32 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=32 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=1 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val=No 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:26.163 13:41:06 -- accel/accel.sh@21 -- # val= 00:07:26.163 13:41:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # IFS=: 00:07:26.163 13:41:06 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@21 -- # val= 00:07:27.544 13:41:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # IFS=: 00:07:27.544 13:41:07 -- accel/accel.sh@20 -- # read -r var val 00:07:27.544 13:41:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.544 13:41:07 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:27.544 13:41:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.544 00:07:27.544 real 0m2.804s 00:07:27.544 user 0m2.509s 00:07:27.544 sys 0m0.286s 00:07:27.544 13:41:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.545 13:41:07 -- common/autotest_common.sh@10 -- # set +x 00:07:27.545 ************************************ 00:07:27.545 END TEST accel_dif_generate_copy 00:07:27.545 ************************************ 00:07:27.545 13:41:07 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:27.545 13:41:07 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.545 13:41:07 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:27.545 13:41:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.545 13:41:07 -- common/autotest_common.sh@10 -- # set +x 00:07:27.545 ************************************ 00:07:27.545 START TEST accel_comp 00:07:27.545 ************************************ 00:07:27.545 13:41:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.545 13:41:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.545 13:41:07 -- accel/accel.sh@17 -- # local accel_module 00:07:27.545 13:41:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.545 13:41:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.545 13:41:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.545 13:41:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.545 13:41:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.545 13:41:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.545 13:41:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.545 13:41:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.545 13:41:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.545 13:41:07 -- accel/accel.sh@42 -- # jq -r . 00:07:27.545 [2024-11-29 13:41:07.526556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.545 [2024-11-29 13:41:07.526634] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2189970 ] 00:07:27.545 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.545 [2024-11-29 13:41:07.585461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.545 [2024-11-29 13:41:07.676876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.925 13:41:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.925 00:07:28.925 SPDK Configuration: 00:07:28.925 Core mask: 0x1 00:07:28.925 00:07:28.925 Accel Perf Configuration: 00:07:28.925 Workload Type: compress 00:07:28.925 Transfer size: 4096 bytes 00:07:28.925 Vector count 1 00:07:28.925 Module: software 00:07:28.925 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 Queue depth: 32 00:07:28.925 Allocate depth: 32 00:07:28.925 # threads/core: 1 00:07:28.925 Run time: 1 seconds 00:07:28.925 Verify: No 00:07:28.925 00:07:28.925 Running for 1 seconds... 00:07:28.925 00:07:28.925 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.925 ------------------------------------------------------------------------------------ 00:07:28.925 0,0 31552/s 131 MiB/s 0 0 00:07:28.925 ==================================================================================== 00:07:28.925 Total 31552/s 123 MiB/s 0 0' 00:07:28.925 13:41:08 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 13:41:08 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 13:41:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.925 13:41:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.925 13:41:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.925 13:41:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.925 13:41:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.925 13:41:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.925 13:41:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.925 13:41:08 -- accel/accel.sh@42 -- # jq -r . 00:07:28.925 [2024-11-29 13:41:08.933310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.925 [2024-11-29 13:41:08.933413] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2190118 ] 00:07:28.925 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.925 [2024-11-29 13:41:08.997425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.925 [2024-11-29 13:41:09.085326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=0x1 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=compress 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=software 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=32 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 13:41:09 -- accel/accel.sh@21 -- # val=32 00:07:28.925 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.926 13:41:09 -- accel/accel.sh@21 -- # val=1 00:07:28.926 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.926 13:41:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:28.926 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.926 13:41:09 -- accel/accel.sh@21 -- # val=No 00:07:28.926 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.926 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.926 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:28.926 13:41:09 -- accel/accel.sh@21 -- # val= 00:07:28.926 13:41:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # IFS=: 00:07:28.926 13:41:09 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@21 -- # val= 00:07:30.389 13:41:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # IFS=: 00:07:30.389 13:41:10 -- accel/accel.sh@20 -- # read -r var val 00:07:30.389 13:41:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.389 13:41:10 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:30.390 13:41:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.390 00:07:30.390 real 0m2.819s 00:07:30.390 user 0m2.511s 00:07:30.390 sys 0m0.301s 00:07:30.390 13:41:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.390 13:41:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.390 ************************************ 00:07:30.390 END TEST accel_comp 00:07:30.390 ************************************ 00:07:30.390 13:41:10 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.390 13:41:10 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:30.390 13:41:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.390 13:41:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.390 ************************************ 00:07:30.390 START TEST accel_decomp 00:07:30.390 ************************************ 00:07:30.390 13:41:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.390 13:41:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.390 13:41:10 -- accel/accel.sh@17 -- # local accel_module 00:07:30.390 13:41:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.390 13:41:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.390 13:41:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.390 13:41:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.390 13:41:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.390 13:41:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.390 13:41:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.390 13:41:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.390 13:41:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.390 13:41:10 -- accel/accel.sh@42 -- # jq -r . 00:07:30.390 [2024-11-29 13:41:10.372251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.390 [2024-11-29 13:41:10.372332] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2190275 ] 00:07:30.390 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.390 [2024-11-29 13:41:10.437629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.390 [2024-11-29 13:41:10.531653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.770 13:41:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.770 00:07:31.770 SPDK Configuration: 00:07:31.770 Core mask: 0x1 00:07:31.770 00:07:31.770 Accel Perf Configuration: 00:07:31.770 Workload Type: decompress 00:07:31.770 Transfer size: 4096 bytes 00:07:31.770 Vector count 1 00:07:31.770 Module: software 00:07:31.770 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.770 Queue depth: 32 00:07:31.770 Allocate depth: 32 00:07:31.770 # threads/core: 1 00:07:31.770 Run time: 1 seconds 00:07:31.770 Verify: Yes 00:07:31.770 00:07:31.770 Running for 1 seconds... 00:07:31.770 00:07:31.770 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.770 ------------------------------------------------------------------------------------ 00:07:31.770 0,0 56960/s 104 MiB/s 0 0 00:07:31.770 ==================================================================================== 00:07:31.770 Total 56960/s 222 MiB/s 0 0' 00:07:31.770 13:41:11 -- accel/accel.sh@20 -- # IFS=: 00:07:31.770 13:41:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.770 13:41:11 -- accel/accel.sh@20 -- # read -r var val 00:07:31.770 13:41:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.770 13:41:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.770 13:41:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.770 13:41:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.770 13:41:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.770 13:41:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.770 13:41:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.770 13:41:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.770 13:41:11 -- accel/accel.sh@42 -- # jq -r . 00:07:31.770 [2024-11-29 13:41:11.780133] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.770 [2024-11-29 13:41:11.780219] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2190540 ] 00:07:31.770 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.770 [2024-11-29 13:41:11.846613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.770 [2024-11-29 13:41:11.940484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.770 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.770 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.770 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.770 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.770 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.770 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.770 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.770 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.770 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=0x1 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=decompress 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=software 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=32 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=32 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=1 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val=Yes 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:31.771 13:41:12 -- accel/accel.sh@21 -- # val= 00:07:31.771 13:41:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # IFS=: 00:07:31.771 13:41:12 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@21 -- # val= 00:07:33.153 13:41:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # IFS=: 00:07:33.153 13:41:13 -- accel/accel.sh@20 -- # read -r var val 00:07:33.153 13:41:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.153 13:41:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:33.153 13:41:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.153 00:07:33.153 real 0m2.827s 00:07:33.153 user 0m2.526s 00:07:33.153 sys 0m0.294s 00:07:33.153 13:41:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.153 13:41:13 -- common/autotest_common.sh@10 -- # set +x 00:07:33.153 ************************************ 00:07:33.153 END TEST accel_decomp 00:07:33.153 ************************************ 00:07:33.153 13:41:13 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.153 13:41:13 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:33.153 13:41:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.153 13:41:13 -- common/autotest_common.sh@10 -- # set +x 00:07:33.153 ************************************ 00:07:33.153 START TEST accel_decmop_full 00:07:33.153 ************************************ 00:07:33.153 13:41:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.153 13:41:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.153 13:41:13 -- accel/accel.sh@17 -- # local accel_module 00:07:33.153 13:41:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.153 13:41:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.153 13:41:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.153 13:41:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.153 13:41:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.153 13:41:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.153 13:41:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.153 13:41:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.153 13:41:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.153 13:41:13 -- accel/accel.sh@42 -- # jq -r . 00:07:33.153 [2024-11-29 13:41:13.226065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.153 [2024-11-29 13:41:13.226148] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2190695 ] 00:07:33.153 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.153 [2024-11-29 13:41:13.291728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.153 [2024-11-29 13:41:13.382619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.534 13:41:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.534 00:07:34.534 SPDK Configuration: 00:07:34.534 Core mask: 0x1 00:07:34.534 00:07:34.534 Accel Perf Configuration: 00:07:34.534 Workload Type: decompress 00:07:34.534 Transfer size: 111250 bytes 00:07:34.534 Vector count 1 00:07:34.534 Module: software 00:07:34.534 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.534 Queue depth: 32 00:07:34.534 Allocate depth: 32 00:07:34.534 # threads/core: 1 00:07:34.534 Run time: 1 seconds 00:07:34.534 Verify: Yes 00:07:34.534 00:07:34.534 Running for 1 seconds... 00:07:34.534 00:07:34.534 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.534 ------------------------------------------------------------------------------------ 00:07:34.534 0,0 3808/s 157 MiB/s 0 0 00:07:34.535 ==================================================================================== 00:07:34.535 Total 3808/s 404 MiB/s 0 0' 00:07:34.535 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.535 13:41:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.535 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.535 13:41:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.535 13:41:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.535 13:41:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.535 13:41:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.535 13:41:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.535 13:41:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.535 13:41:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.535 13:41:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.535 13:41:14 -- accel/accel.sh@42 -- # jq -r . 00:07:34.535 [2024-11-29 13:41:14.638477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.535 [2024-11-29 13:41:14.638565] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2190843 ] 00:07:34.535 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.535 [2024-11-29 13:41:14.701763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.535 [2024-11-29 13:41:14.797829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=0x1 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=decompress 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=software 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=32 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=32 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=1 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val=Yes 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:34.794 13:41:14 -- accel/accel.sh@21 -- # val= 00:07:34.794 13:41:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # IFS=: 00:07:34.794 13:41:14 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@21 -- # val= 00:07:36.173 13:41:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # IFS=: 00:07:36.173 13:41:16 -- accel/accel.sh@20 -- # read -r var val 00:07:36.173 13:41:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.173 13:41:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:36.173 13:41:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.173 00:07:36.173 real 0m2.850s 00:07:36.173 user 0m2.552s 00:07:36.173 sys 0m0.288s 00:07:36.173 13:41:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.173 13:41:16 -- common/autotest_common.sh@10 -- # set +x 00:07:36.173 ************************************ 00:07:36.173 END TEST accel_decmop_full 00:07:36.173 ************************************ 00:07:36.173 13:41:16 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.173 13:41:16 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:36.173 13:41:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.173 13:41:16 -- common/autotest_common.sh@10 -- # set +x 00:07:36.173 ************************************ 00:07:36.173 START TEST accel_decomp_mcore 00:07:36.173 ************************************ 00:07:36.173 13:41:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.173 13:41:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.173 13:41:16 -- accel/accel.sh@17 -- # local accel_module 00:07:36.173 13:41:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.173 13:41:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.173 13:41:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.173 13:41:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.173 13:41:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.173 13:41:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.173 13:41:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.173 13:41:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.173 13:41:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.173 13:41:16 -- accel/accel.sh@42 -- # jq -r . 00:07:36.173 [2024-11-29 13:41:16.104313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.173 [2024-11-29 13:41:16.104411] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191002 ] 00:07:36.173 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.173 [2024-11-29 13:41:16.169463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.173 [2024-11-29 13:41:16.264552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.173 [2024-11-29 13:41:16.264610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.173 [2024-11-29 13:41:16.264664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.173 [2024-11-29 13:41:16.264668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.551 13:41:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.551 00:07:37.551 SPDK Configuration: 00:07:37.551 Core mask: 0xf 00:07:37.551 00:07:37.551 Accel Perf Configuration: 00:07:37.551 Workload Type: decompress 00:07:37.551 Transfer size: 4096 bytes 00:07:37.551 Vector count 1 00:07:37.551 Module: software 00:07:37.551 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.551 Queue depth: 32 00:07:37.551 Allocate depth: 32 00:07:37.551 # threads/core: 1 00:07:37.551 Run time: 1 seconds 00:07:37.551 Verify: Yes 00:07:37.551 00:07:37.551 Running for 1 seconds... 00:07:37.551 00:07:37.551 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.551 ------------------------------------------------------------------------------------ 00:07:37.551 0,0 50176/s 92 MiB/s 0 0 00:07:37.551 3,0 50592/s 93 MiB/s 0 0 00:07:37.551 2,0 50560/s 93 MiB/s 0 0 00:07:37.551 1,0 50432/s 92 MiB/s 0 0 00:07:37.551 ==================================================================================== 00:07:37.551 Total 201760/s 788 MiB/s 0 0' 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.551 13:41:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.551 13:41:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.551 13:41:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.551 13:41:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.551 13:41:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.551 13:41:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.551 13:41:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.551 13:41:17 -- accel/accel.sh@42 -- # jq -r . 00:07:37.551 [2024-11-29 13:41:17.522742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.551 [2024-11-29 13:41:17.522830] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191264 ] 00:07:37.551 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.551 [2024-11-29 13:41:17.584732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:37.551 [2024-11-29 13:41:17.683053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.551 [2024-11-29 13:41:17.683110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:37.551 [2024-11-29 13:41:17.683165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:37.551 [2024-11-29 13:41:17.683168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val=0xf 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val=decompress 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val=software 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.551 13:41:17 -- accel/accel.sh@21 -- # val=32 00:07:37.551 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.551 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val=32 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val=1 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val=Yes 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:37.552 13:41:17 -- accel/accel.sh@21 -- # val= 00:07:37.552 13:41:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # IFS=: 00:07:37.552 13:41:17 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@21 -- # val= 00:07:38.936 13:41:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # IFS=: 00:07:38.936 13:41:18 -- accel/accel.sh@20 -- # read -r var val 00:07:38.936 13:41:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.936 13:41:18 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:38.936 13:41:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.936 00:07:38.936 real 0m2.846s 00:07:38.936 user 0m9.433s 00:07:38.936 sys 0m0.322s 00:07:38.936 13:41:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.936 13:41:18 -- common/autotest_common.sh@10 -- # set +x 00:07:38.936 ************************************ 00:07:38.936 END TEST accel_decomp_mcore 00:07:38.936 ************************************ 00:07:38.936 13:41:18 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.936 13:41:18 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:38.936 13:41:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.936 13:41:18 -- common/autotest_common.sh@10 -- # set +x 00:07:38.936 ************************************ 00:07:38.936 START TEST accel_decomp_full_mcore 00:07:38.936 ************************************ 00:07:38.936 13:41:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.936 13:41:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.936 13:41:18 -- accel/accel.sh@17 -- # local accel_module 00:07:38.936 13:41:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.936 13:41:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.936 13:41:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.936 13:41:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.936 13:41:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.936 13:41:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.936 13:41:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.936 13:41:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.936 13:41:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.936 13:41:18 -- accel/accel.sh@42 -- # jq -r . 00:07:38.936 [2024-11-29 13:41:18.981586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.936 [2024-11-29 13:41:18.981669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191430 ] 00:07:38.936 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.936 [2024-11-29 13:41:19.046589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.936 [2024-11-29 13:41:19.140600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.936 [2024-11-29 13:41:19.140660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.936 [2024-11-29 13:41:19.140716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.936 [2024-11-29 13:41:19.140719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.319 13:41:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.319 00:07:40.319 SPDK Configuration: 00:07:40.319 Core mask: 0xf 00:07:40.319 00:07:40.319 Accel Perf Configuration: 00:07:40.319 Workload Type: decompress 00:07:40.319 Transfer size: 111250 bytes 00:07:40.319 Vector count 1 00:07:40.319 Module: software 00:07:40.319 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.319 Queue depth: 32 00:07:40.319 Allocate depth: 32 00:07:40.319 # threads/core: 1 00:07:40.319 Run time: 1 seconds 00:07:40.319 Verify: Yes 00:07:40.319 00:07:40.319 Running for 1 seconds... 00:07:40.319 00:07:40.319 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.319 ------------------------------------------------------------------------------------ 00:07:40.319 0,0 3776/s 155 MiB/s 0 0 00:07:40.319 3,0 3776/s 155 MiB/s 0 0 00:07:40.319 2,0 3776/s 155 MiB/s 0 0 00:07:40.319 1,0 3776/s 155 MiB/s 0 0 00:07:40.319 ==================================================================================== 00:07:40.319 Total 15104/s 1602 MiB/s 0 0' 00:07:40.319 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.319 13:41:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.319 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.319 13:41:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.319 13:41:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.319 13:41:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.319 13:41:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.319 13:41:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.319 13:41:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.319 13:41:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.319 13:41:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.319 13:41:20 -- accel/accel.sh@42 -- # jq -r . 00:07:40.319 [2024-11-29 13:41:20.411403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.319 [2024-11-29 13:41:20.411493] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191579 ] 00:07:40.319 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.319 [2024-11-29 13:41:20.473547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.319 [2024-11-29 13:41:20.570963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.319 [2024-11-29 13:41:20.571020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.319 [2024-11-29 13:41:20.571071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.319 [2024-11-29 13:41:20.571074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=0xf 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=decompress 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=software 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=32 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=32 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=1 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val=Yes 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:40.578 13:41:20 -- accel/accel.sh@21 -- # val= 00:07:40.578 13:41:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # IFS=: 00:07:40.578 13:41:20 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@21 -- # val= 00:07:41.959 13:41:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # IFS=: 00:07:41.959 13:41:21 -- accel/accel.sh@20 -- # read -r var val 00:07:41.959 13:41:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.959 13:41:21 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.959 13:41:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.959 00:07:41.959 real 0m2.862s 00:07:41.959 user 0m9.502s 00:07:41.959 sys 0m0.307s 00:07:41.959 13:41:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.959 13:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:41.959 ************************************ 00:07:41.959 END TEST accel_decomp_full_mcore 00:07:41.959 ************************************ 00:07:41.959 13:41:21 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.959 13:41:21 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:41.959 13:41:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.959 13:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:41.959 ************************************ 00:07:41.959 START TEST accel_decomp_mthread 00:07:41.959 ************************************ 00:07:41.959 13:41:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.959 13:41:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.959 13:41:21 -- accel/accel.sh@17 -- # local accel_module 00:07:41.959 13:41:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.959 13:41:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.959 13:41:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.959 13:41:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.959 13:41:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.959 13:41:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.959 13:41:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.959 13:41:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.959 13:41:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.959 13:41:21 -- accel/accel.sh@42 -- # jq -r . 00:07:41.959 [2024-11-29 13:41:21.874123] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.959 [2024-11-29 13:41:21.874209] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191735 ] 00:07:41.959 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.959 [2024-11-29 13:41:21.940072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.959 [2024-11-29 13:41:22.032934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.338 13:41:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.338 00:07:43.338 SPDK Configuration: 00:07:43.338 Core mask: 0x1 00:07:43.338 00:07:43.338 Accel Perf Configuration: 00:07:43.338 Workload Type: decompress 00:07:43.338 Transfer size: 4096 bytes 00:07:43.338 Vector count 1 00:07:43.338 Module: software 00:07:43.338 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.338 Queue depth: 32 00:07:43.338 Allocate depth: 32 00:07:43.338 # threads/core: 2 00:07:43.338 Run time: 1 seconds 00:07:43.338 Verify: Yes 00:07:43.338 00:07:43.338 Running for 1 seconds... 00:07:43.338 00:07:43.338 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.338 ------------------------------------------------------------------------------------ 00:07:43.338 0,1 28032/s 51 MiB/s 0 0 00:07:43.338 0,0 27936/s 51 MiB/s 0 0 00:07:43.338 ==================================================================================== 00:07:43.338 Total 55968/s 218 MiB/s 0 0' 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.338 13:41:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.338 13:41:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.338 13:41:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.338 13:41:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.338 13:41:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.338 13:41:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.338 13:41:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.338 13:41:23 -- accel/accel.sh@42 -- # jq -r . 00:07:43.338 [2024-11-29 13:41:23.294774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.338 [2024-11-29 13:41:23.294861] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192000 ] 00:07:43.338 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.338 [2024-11-29 13:41:23.357186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.338 [2024-11-29 13:41:23.450815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=0x1 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=decompress 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=software 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=32 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=32 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=2 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val=Yes 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.338 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.338 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.338 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:43.339 13:41:23 -- accel/accel.sh@21 -- # val= 00:07:43.339 13:41:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.339 13:41:23 -- accel/accel.sh@20 -- # IFS=: 00:07:43.339 13:41:23 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@21 -- # val= 00:07:44.719 13:41:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # IFS=: 00:07:44.719 13:41:24 -- accel/accel.sh@20 -- # read -r var val 00:07:44.719 13:41:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.719 13:41:24 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.719 13:41:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.719 00:07:44.719 real 0m2.840s 00:07:44.719 user 0m2.540s 00:07:44.719 sys 0m0.292s 00:07:44.719 13:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.719 13:41:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.719 ************************************ 00:07:44.719 END TEST accel_decomp_mthread 00:07:44.719 ************************************ 00:07:44.719 13:41:24 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 13:41:24 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:44.719 13:41:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.719 13:41:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.719 ************************************ 00:07:44.719 START TEST accel_deomp_full_mthread 00:07:44.719 ************************************ 00:07:44.719 13:41:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 13:41:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.719 13:41:24 -- accel/accel.sh@17 -- # local accel_module 00:07:44.719 13:41:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 13:41:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 13:41:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.719 13:41:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.719 13:41:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.719 13:41:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.719 13:41:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.719 13:41:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.719 13:41:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.719 13:41:24 -- accel/accel.sh@42 -- # jq -r . 00:07:44.719 [2024-11-29 13:41:24.738741] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.719 [2024-11-29 13:41:24.738823] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192157 ] 00:07:44.719 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.719 [2024-11-29 13:41:24.801947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.719 [2024-11-29 13:41:24.892971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.097 13:41:26 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.097 00:07:46.097 SPDK Configuration: 00:07:46.097 Core mask: 0x1 00:07:46.097 00:07:46.097 Accel Perf Configuration: 00:07:46.097 Workload Type: decompress 00:07:46.097 Transfer size: 111250 bytes 00:07:46.097 Vector count 1 00:07:46.097 Module: software 00:07:46.097 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.097 Queue depth: 32 00:07:46.097 Allocate depth: 32 00:07:46.097 # threads/core: 2 00:07:46.097 Run time: 1 seconds 00:07:46.097 Verify: Yes 00:07:46.097 00:07:46.097 Running for 1 seconds... 00:07:46.097 00:07:46.097 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.097 ------------------------------------------------------------------------------------ 00:07:46.097 0,1 1952/s 80 MiB/s 0 0 00:07:46.097 0,0 1920/s 79 MiB/s 0 0 00:07:46.097 ==================================================================================== 00:07:46.097 Total 3872/s 410 MiB/s 0 0' 00:07:46.097 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.097 13:41:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.097 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.097 13:41:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.097 13:41:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.097 13:41:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.097 13:41:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.097 13:41:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.097 13:41:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.098 13:41:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.098 13:41:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.098 13:41:26 -- accel/accel.sh@42 -- # jq -r . 00:07:46.098 [2024-11-29 13:41:26.185286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:46.098 [2024-11-29 13:41:26.185371] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192309 ] 00:07:46.098 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.098 [2024-11-29 13:41:26.246320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.098 [2024-11-29 13:41:26.339909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=0x1 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=decompress 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=software 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=32 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=32 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=2 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val=Yes 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:46.359 13:41:26 -- accel/accel.sh@21 -- # val= 00:07:46.359 13:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # IFS=: 00:07:46.359 13:41:26 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@21 -- # val= 00:07:47.738 13:41:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # IFS=: 00:07:47.738 13:41:27 -- accel/accel.sh@20 -- # read -r var val 00:07:47.738 13:41:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.738 13:41:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.738 13:41:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.738 00:07:47.738 real 0m2.897s 00:07:47.738 user 0m2.597s 00:07:47.738 sys 0m0.293s 00:07:47.738 13:41:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.738 13:41:27 -- common/autotest_common.sh@10 -- # set +x 00:07:47.738 ************************************ 00:07:47.738 END TEST accel_deomp_full_mthread 00:07:47.738 ************************************ 00:07:47.738 13:41:27 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:47.738 13:41:27 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.738 13:41:27 -- accel/accel.sh@129 -- # build_accel_config 00:07:47.738 13:41:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:47.738 13:41:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.738 13:41:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.738 13:41:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.738 13:41:27 -- common/autotest_common.sh@10 -- # set +x 00:07:47.738 13:41:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.738 13:41:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.738 13:41:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.738 13:41:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.738 13:41:27 -- accel/accel.sh@42 -- # jq -r . 00:07:47.738 ************************************ 00:07:47.738 START TEST accel_dif_functional_tests 00:07:47.738 ************************************ 00:07:47.738 13:41:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.738 [2024-11-29 13:41:27.681849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.739 [2024-11-29 13:41:27.681934] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192568 ] 00:07:47.739 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.739 [2024-11-29 13:41:27.745235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:47.739 [2024-11-29 13:41:27.841784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.739 [2024-11-29 13:41:27.841838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.739 [2024-11-29 13:41:27.841842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.739 00:07:47.739 00:07:47.739 CUnit - A unit testing framework for C - Version 2.1-3 00:07:47.739 http://cunit.sourceforge.net/ 00:07:47.739 00:07:47.739 00:07:47.739 Suite: accel_dif 00:07:47.739 Test: verify: DIF generated, GUARD check ...passed 00:07:47.739 Test: verify: DIF generated, APPTAG check ...passed 00:07:47.739 Test: verify: DIF generated, REFTAG check ...passed 00:07:47.739 Test: verify: DIF not generated, GUARD check ...[2024-11-29 13:41:27.941178] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.739 [2024-11-29 13:41:27.941253] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.739 passed 00:07:47.739 Test: verify: DIF not generated, APPTAG check ...[2024-11-29 13:41:27.941295] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.739 [2024-11-29 13:41:27.941326] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.739 passed 00:07:47.739 Test: verify: DIF not generated, REFTAG check ...[2024-11-29 13:41:27.941361] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.739 [2024-11-29 13:41:27.941389] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.739 passed 00:07:47.739 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:47.739 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-29 13:41:27.941468] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:47.739 passed 00:07:47.739 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:47.739 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:47.739 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:47.739 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-29 13:41:27.941619] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:47.739 passed 00:07:47.739 Test: generate copy: DIF generated, GUARD check ...passed 00:07:47.739 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:47.739 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:47.739 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:47.739 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:47.739 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:47.739 Test: generate copy: iovecs-len validate ...[2024-11-29 13:41:27.941872] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:47.739 passed 00:07:47.739 Test: generate copy: buffer alignment validate ...passed 00:07:47.739 00:07:47.739 Run Summary: Type Total Ran Passed Failed Inactive 00:07:47.739 suites 1 1 n/a 0 0 00:07:47.739 tests 20 20 20 0 0 00:07:47.739 asserts 204 204 204 0 n/a 00:07:47.739 00:07:47.739 Elapsed time = 0.003 seconds 00:07:47.998 00:07:47.998 real 0m0.517s 00:07:47.998 user 0m0.816s 00:07:47.998 sys 0m0.184s 00:07:47.998 13:41:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.998 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:47.998 ************************************ 00:07:47.998 END TEST accel_dif_functional_tests 00:07:47.998 ************************************ 00:07:47.998 00:07:47.998 real 1m0.115s 00:07:47.998 user 1m7.852s 00:07:47.998 sys 0m7.304s 00:07:47.998 13:41:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.998 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:47.998 ************************************ 00:07:47.998 END TEST accel 00:07:47.998 ************************************ 00:07:47.998 13:41:28 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:47.998 13:41:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:47.998 13:41:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.998 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:47.998 ************************************ 00:07:47.998 START TEST accel_rpc 00:07:47.998 ************************************ 00:07:47.998 13:41:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:47.998 * Looking for test storage... 00:07:47.998 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:47.998 13:41:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.998 13:41:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.998 13:41:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:48.257 13:41:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:48.257 13:41:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:48.257 13:41:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:48.257 13:41:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:48.257 13:41:28 -- scripts/common.sh@335 -- # IFS=.-: 00:07:48.257 13:41:28 -- scripts/common.sh@335 -- # read -ra ver1 00:07:48.257 13:41:28 -- scripts/common.sh@336 -- # IFS=.-: 00:07:48.257 13:41:28 -- scripts/common.sh@336 -- # read -ra ver2 00:07:48.257 13:41:28 -- scripts/common.sh@337 -- # local 'op=<' 00:07:48.257 13:41:28 -- scripts/common.sh@339 -- # ver1_l=2 00:07:48.257 13:41:28 -- scripts/common.sh@340 -- # ver2_l=1 00:07:48.257 13:41:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:48.257 13:41:28 -- scripts/common.sh@343 -- # case "$op" in 00:07:48.257 13:41:28 -- scripts/common.sh@344 -- # : 1 00:07:48.257 13:41:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:48.257 13:41:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:48.257 13:41:28 -- scripts/common.sh@364 -- # decimal 1 00:07:48.257 13:41:28 -- scripts/common.sh@352 -- # local d=1 00:07:48.257 13:41:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:48.257 13:41:28 -- scripts/common.sh@354 -- # echo 1 00:07:48.257 13:41:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:48.257 13:41:28 -- scripts/common.sh@365 -- # decimal 2 00:07:48.257 13:41:28 -- scripts/common.sh@352 -- # local d=2 00:07:48.257 13:41:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:48.257 13:41:28 -- scripts/common.sh@354 -- # echo 2 00:07:48.257 13:41:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:48.257 13:41:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:48.257 13:41:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:48.257 13:41:28 -- scripts/common.sh@367 -- # return 0 00:07:48.257 13:41:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:48.257 13:41:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:48.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.257 --rc genhtml_branch_coverage=1 00:07:48.257 --rc genhtml_function_coverage=1 00:07:48.257 --rc genhtml_legend=1 00:07:48.257 --rc geninfo_all_blocks=1 00:07:48.257 --rc geninfo_unexecuted_blocks=1 00:07:48.257 00:07:48.257 ' 00:07:48.257 13:41:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:48.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.257 --rc genhtml_branch_coverage=1 00:07:48.257 --rc genhtml_function_coverage=1 00:07:48.257 --rc genhtml_legend=1 00:07:48.257 --rc geninfo_all_blocks=1 00:07:48.257 --rc geninfo_unexecuted_blocks=1 00:07:48.257 00:07:48.257 ' 00:07:48.257 13:41:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:48.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.257 --rc genhtml_branch_coverage=1 00:07:48.257 --rc genhtml_function_coverage=1 00:07:48.257 --rc genhtml_legend=1 00:07:48.257 --rc geninfo_all_blocks=1 00:07:48.257 --rc geninfo_unexecuted_blocks=1 00:07:48.257 00:07:48.257 ' 00:07:48.257 13:41:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:48.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.257 --rc genhtml_branch_coverage=1 00:07:48.257 --rc genhtml_function_coverage=1 00:07:48.257 --rc genhtml_legend=1 00:07:48.257 --rc geninfo_all_blocks=1 00:07:48.257 --rc geninfo_unexecuted_blocks=1 00:07:48.257 00:07:48.257 ' 00:07:48.257 13:41:28 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:48.257 13:41:28 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2192664 00:07:48.257 13:41:28 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:48.257 13:41:28 -- accel/accel_rpc.sh@15 -- # waitforlisten 2192664 00:07:48.257 13:41:28 -- common/autotest_common.sh@829 -- # '[' -z 2192664 ']' 00:07:48.257 13:41:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.257 13:41:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.257 13:41:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.257 13:41:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.257 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.257 [2024-11-29 13:41:28.396495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.257 [2024-11-29 13:41:28.396604] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192664 ] 00:07:48.257 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.257 [2024-11-29 13:41:28.460107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.516 [2024-11-29 13:41:28.551635] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.516 [2024-11-29 13:41:28.551829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.516 13:41:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.516 13:41:28 -- common/autotest_common.sh@862 -- # return 0 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:48.516 13:41:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.516 13:41:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.516 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.516 ************************************ 00:07:48.516 START TEST accel_assign_opcode 00:07:48.516 ************************************ 00:07:48.516 13:41:28 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:48.516 13:41:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.516 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.516 [2024-11-29 13:41:28.616403] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:48.516 13:41:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:48.516 13:41:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.516 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.516 [2024-11-29 13:41:28.624416] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:48.516 13:41:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.516 13:41:28 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:48.516 13:41:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.516 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.776 13:41:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.776 13:41:28 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:48.776 13:41:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.776 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.776 13:41:28 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:48.776 13:41:28 -- accel/accel_rpc.sh@42 -- # grep software 00:07:48.776 13:41:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.776 software 00:07:48.776 00:07:48.776 real 0m0.297s 00:07:48.776 user 0m0.042s 00:07:48.776 sys 0m0.005s 00:07:48.776 13:41:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.776 13:41:28 -- common/autotest_common.sh@10 -- # set +x 00:07:48.776 ************************************ 00:07:48.776 END TEST accel_assign_opcode 00:07:48.776 ************************************ 00:07:48.776 13:41:28 -- accel/accel_rpc.sh@55 -- # killprocess 2192664 00:07:48.776 13:41:28 -- common/autotest_common.sh@936 -- # '[' -z 2192664 ']' 00:07:48.776 13:41:28 -- common/autotest_common.sh@940 -- # kill -0 2192664 00:07:48.776 13:41:28 -- common/autotest_common.sh@941 -- # uname 00:07:48.776 13:41:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.776 13:41:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2192664 00:07:48.776 13:41:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:48.776 13:41:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:48.776 13:41:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2192664' 00:07:48.776 killing process with pid 2192664 00:07:48.776 13:41:28 -- common/autotest_common.sh@955 -- # kill 2192664 00:07:48.776 13:41:28 -- common/autotest_common.sh@960 -- # wait 2192664 00:07:49.343 00:07:49.343 real 0m1.178s 00:07:49.343 user 0m1.127s 00:07:49.343 sys 0m0.408s 00:07:49.343 13:41:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.343 13:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:49.343 ************************************ 00:07:49.343 END TEST accel_rpc 00:07:49.343 ************************************ 00:07:49.343 13:41:29 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.343 13:41:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.343 13:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:49.343 ************************************ 00:07:49.343 START TEST app_cmdline 00:07:49.343 ************************************ 00:07:49.343 13:41:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.343 * Looking for test storage... 00:07:49.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:49.343 13:41:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.343 13:41:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.343 13:41:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.343 13:41:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.343 13:41:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.343 13:41:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.343 13:41:29 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.343 13:41:29 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.343 13:41:29 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.343 13:41:29 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.343 13:41:29 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.343 13:41:29 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.343 13:41:29 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.343 13:41:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.343 13:41:29 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.343 13:41:29 -- scripts/common.sh@344 -- # : 1 00:07:49.343 13:41:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.343 13:41:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.343 13:41:29 -- scripts/common.sh@364 -- # decimal 1 00:07:49.343 13:41:29 -- scripts/common.sh@352 -- # local d=1 00:07:49.343 13:41:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.343 13:41:29 -- scripts/common.sh@354 -- # echo 1 00:07:49.343 13:41:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.343 13:41:29 -- scripts/common.sh@365 -- # decimal 2 00:07:49.343 13:41:29 -- scripts/common.sh@352 -- # local d=2 00:07:49.343 13:41:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.343 13:41:29 -- scripts/common.sh@354 -- # echo 2 00:07:49.343 13:41:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.343 13:41:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.343 13:41:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.343 13:41:29 -- scripts/common.sh@367 -- # return 0 00:07:49.343 13:41:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.343 --rc genhtml_branch_coverage=1 00:07:49.343 --rc genhtml_function_coverage=1 00:07:49.343 --rc genhtml_legend=1 00:07:49.343 --rc geninfo_all_blocks=1 00:07:49.343 --rc geninfo_unexecuted_blocks=1 00:07:49.343 00:07:49.343 ' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.343 --rc genhtml_branch_coverage=1 00:07:49.343 --rc genhtml_function_coverage=1 00:07:49.343 --rc genhtml_legend=1 00:07:49.343 --rc geninfo_all_blocks=1 00:07:49.343 --rc geninfo_unexecuted_blocks=1 00:07:49.343 00:07:49.343 ' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.343 --rc genhtml_branch_coverage=1 00:07:49.343 --rc genhtml_function_coverage=1 00:07:49.343 --rc genhtml_legend=1 00:07:49.343 --rc geninfo_all_blocks=1 00:07:49.343 --rc geninfo_unexecuted_blocks=1 00:07:49.343 00:07:49.343 ' 00:07:49.343 13:41:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.343 --rc genhtml_branch_coverage=1 00:07:49.343 --rc genhtml_function_coverage=1 00:07:49.343 --rc genhtml_legend=1 00:07:49.343 --rc geninfo_all_blocks=1 00:07:49.343 --rc geninfo_unexecuted_blocks=1 00:07:49.343 00:07:49.343 ' 00:07:49.343 13:41:29 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:49.343 13:41:29 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2192877 00:07:49.344 13:41:29 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:49.344 13:41:29 -- app/cmdline.sh@18 -- # waitforlisten 2192877 00:07:49.344 13:41:29 -- common/autotest_common.sh@829 -- # '[' -z 2192877 ']' 00:07:49.344 13:41:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.344 13:41:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:49.344 13:41:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.344 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.344 13:41:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:49.344 13:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:49.344 [2024-11-29 13:41:29.617370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.344 [2024-11-29 13:41:29.617472] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192877 ] 00:07:49.602 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.602 [2024-11-29 13:41:29.678941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.602 [2024-11-29 13:41:29.770052] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.603 [2024-11-29 13:41:29.770248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.541 13:41:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.541 13:41:30 -- common/autotest_common.sh@862 -- # return 0 00:07:50.541 13:41:30 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:50.799 { 00:07:50.799 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:50.799 "fields": { 00:07:50.799 "major": 24, 00:07:50.800 "minor": 1, 00:07:50.800 "patch": 1, 00:07:50.800 "suffix": "-pre", 00:07:50.800 "commit": "c13c99a5e" 00:07:50.800 } 00:07:50.800 } 00:07:50.800 13:41:30 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:50.800 13:41:30 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:50.800 13:41:30 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:50.800 13:41:30 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:50.800 13:41:30 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:50.800 13:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.800 13:41:30 -- common/autotest_common.sh@10 -- # set +x 00:07:50.800 13:41:30 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:50.800 13:41:30 -- app/cmdline.sh@26 -- # sort 00:07:50.800 13:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.800 13:41:30 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:50.800 13:41:30 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:50.800 13:41:30 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.800 13:41:30 -- common/autotest_common.sh@650 -- # local es=0 00:07:50.800 13:41:30 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.800 13:41:30 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.800 13:41:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.800 13:41:30 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.800 13:41:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.800 13:41:30 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.800 13:41:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.800 13:41:30 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.800 13:41:30 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:50.800 13:41:30 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:51.060 request: 00:07:51.060 { 00:07:51.060 "method": "env_dpdk_get_mem_stats", 00:07:51.060 "req_id": 1 00:07:51.060 } 00:07:51.060 Got JSON-RPC error response 00:07:51.060 response: 00:07:51.060 { 00:07:51.060 "code": -32601, 00:07:51.060 "message": "Method not found" 00:07:51.060 } 00:07:51.060 13:41:31 -- common/autotest_common.sh@653 -- # es=1 00:07:51.060 13:41:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:51.060 13:41:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:51.060 13:41:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:51.060 13:41:31 -- app/cmdline.sh@1 -- # killprocess 2192877 00:07:51.060 13:41:31 -- common/autotest_common.sh@936 -- # '[' -z 2192877 ']' 00:07:51.060 13:41:31 -- common/autotest_common.sh@940 -- # kill -0 2192877 00:07:51.060 13:41:31 -- common/autotest_common.sh@941 -- # uname 00:07:51.060 13:41:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:51.060 13:41:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2192877 00:07:51.060 13:41:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:51.060 13:41:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:51.060 13:41:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2192877' 00:07:51.060 killing process with pid 2192877 00:07:51.060 13:41:31 -- common/autotest_common.sh@955 -- # kill 2192877 00:07:51.060 13:41:31 -- common/autotest_common.sh@960 -- # wait 2192877 00:07:51.629 00:07:51.629 real 0m2.204s 00:07:51.629 user 0m2.788s 00:07:51.629 sys 0m0.506s 00:07:51.629 13:41:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.629 13:41:31 -- common/autotest_common.sh@10 -- # set +x 00:07:51.629 ************************************ 00:07:51.629 END TEST app_cmdline 00:07:51.629 ************************************ 00:07:51.629 13:41:31 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.629 13:41:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:51.629 13:41:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.629 13:41:31 -- common/autotest_common.sh@10 -- # set +x 00:07:51.629 ************************************ 00:07:51.629 START TEST version 00:07:51.629 ************************************ 00:07:51.629 13:41:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.629 * Looking for test storage... 00:07:51.629 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:51.629 13:41:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.629 13:41:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.629 13:41:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.629 13:41:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.629 13:41:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.629 13:41:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.629 13:41:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.629 13:41:31 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.629 13:41:31 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.629 13:41:31 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.629 13:41:31 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.629 13:41:31 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.629 13:41:31 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.629 13:41:31 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.629 13:41:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.630 13:41:31 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.630 13:41:31 -- scripts/common.sh@344 -- # : 1 00:07:51.630 13:41:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.630 13:41:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.630 13:41:31 -- scripts/common.sh@364 -- # decimal 1 00:07:51.630 13:41:31 -- scripts/common.sh@352 -- # local d=1 00:07:51.630 13:41:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.630 13:41:31 -- scripts/common.sh@354 -- # echo 1 00:07:51.630 13:41:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.630 13:41:31 -- scripts/common.sh@365 -- # decimal 2 00:07:51.630 13:41:31 -- scripts/common.sh@352 -- # local d=2 00:07:51.630 13:41:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.630 13:41:31 -- scripts/common.sh@354 -- # echo 2 00:07:51.630 13:41:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.630 13:41:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.630 13:41:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.630 13:41:31 -- scripts/common.sh@367 -- # return 0 00:07:51.630 13:41:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.630 13:41:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.630 --rc genhtml_branch_coverage=1 00:07:51.630 --rc genhtml_function_coverage=1 00:07:51.630 --rc genhtml_legend=1 00:07:51.630 --rc geninfo_all_blocks=1 00:07:51.630 --rc geninfo_unexecuted_blocks=1 00:07:51.630 00:07:51.630 ' 00:07:51.630 13:41:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.630 --rc genhtml_branch_coverage=1 00:07:51.630 --rc genhtml_function_coverage=1 00:07:51.630 --rc genhtml_legend=1 00:07:51.630 --rc geninfo_all_blocks=1 00:07:51.630 --rc geninfo_unexecuted_blocks=1 00:07:51.630 00:07:51.630 ' 00:07:51.630 13:41:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.630 --rc genhtml_branch_coverage=1 00:07:51.630 --rc genhtml_function_coverage=1 00:07:51.630 --rc genhtml_legend=1 00:07:51.630 --rc geninfo_all_blocks=1 00:07:51.630 --rc geninfo_unexecuted_blocks=1 00:07:51.630 00:07:51.630 ' 00:07:51.630 13:41:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.630 --rc genhtml_branch_coverage=1 00:07:51.630 --rc genhtml_function_coverage=1 00:07:51.630 --rc genhtml_legend=1 00:07:51.630 --rc geninfo_all_blocks=1 00:07:51.630 --rc geninfo_unexecuted_blocks=1 00:07:51.630 00:07:51.630 ' 00:07:51.630 13:41:31 -- app/version.sh@17 -- # get_header_version major 00:07:51.630 13:41:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.630 13:41:31 -- app/version.sh@14 -- # cut -f2 00:07:51.630 13:41:31 -- app/version.sh@14 -- # tr -d '"' 00:07:51.630 13:41:31 -- app/version.sh@17 -- # major=24 00:07:51.630 13:41:31 -- app/version.sh@18 -- # get_header_version minor 00:07:51.630 13:41:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.630 13:41:31 -- app/version.sh@14 -- # cut -f2 00:07:51.630 13:41:31 -- app/version.sh@14 -- # tr -d '"' 00:07:51.630 13:41:31 -- app/version.sh@18 -- # minor=1 00:07:51.630 13:41:31 -- app/version.sh@19 -- # get_header_version patch 00:07:51.630 13:41:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.630 13:41:31 -- app/version.sh@14 -- # cut -f2 00:07:51.630 13:41:31 -- app/version.sh@14 -- # tr -d '"' 00:07:51.630 13:41:31 -- app/version.sh@19 -- # patch=1 00:07:51.630 13:41:31 -- app/version.sh@20 -- # get_header_version suffix 00:07:51.630 13:41:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.630 13:41:31 -- app/version.sh@14 -- # cut -f2 00:07:51.630 13:41:31 -- app/version.sh@14 -- # tr -d '"' 00:07:51.630 13:41:31 -- app/version.sh@20 -- # suffix=-pre 00:07:51.630 13:41:31 -- app/version.sh@22 -- # version=24.1 00:07:51.630 13:41:31 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:51.630 13:41:31 -- app/version.sh@25 -- # version=24.1.1 00:07:51.630 13:41:31 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:51.630 13:41:31 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:51.630 13:41:31 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:51.630 13:41:31 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:51.630 13:41:31 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:51.630 00:07:51.630 real 0m0.205s 00:07:51.630 user 0m0.146s 00:07:51.630 sys 0m0.083s 00:07:51.630 13:41:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.630 13:41:31 -- common/autotest_common.sh@10 -- # set +x 00:07:51.630 ************************************ 00:07:51.630 END TEST version 00:07:51.630 ************************************ 00:07:51.630 13:41:31 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@191 -- # uname -s 00:07:51.630 13:41:31 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:51.630 13:41:31 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.630 13:41:31 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.630 13:41:31 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:51.630 13:41:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:51.630 13:41:31 -- common/autotest_common.sh@10 -- # set +x 00:07:51.630 13:41:31 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:51.630 13:41:31 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:51.630 13:41:31 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.630 13:41:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.630 13:41:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.630 13:41:31 -- common/autotest_common.sh@10 -- # set +x 00:07:51.630 ************************************ 00:07:51.630 START TEST nvmf_tcp 00:07:51.630 ************************************ 00:07:51.630 13:41:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.890 * Looking for test storage... 00:07:51.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:51.890 13:41:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.890 13:41:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.890 13:41:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.890 13:41:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.890 13:41:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.890 13:41:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.890 13:41:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.890 13:41:32 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.890 13:41:32 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.890 13:41:32 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.890 13:41:32 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.890 13:41:32 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.890 13:41:32 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.890 13:41:32 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.890 13:41:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.890 13:41:32 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.890 13:41:32 -- scripts/common.sh@344 -- # : 1 00:07:51.890 13:41:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.890 13:41:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.890 13:41:32 -- scripts/common.sh@364 -- # decimal 1 00:07:51.890 13:41:32 -- scripts/common.sh@352 -- # local d=1 00:07:51.890 13:41:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.890 13:41:32 -- scripts/common.sh@354 -- # echo 1 00:07:51.890 13:41:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.890 13:41:32 -- scripts/common.sh@365 -- # decimal 2 00:07:51.890 13:41:32 -- scripts/common.sh@352 -- # local d=2 00:07:51.890 13:41:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.890 13:41:32 -- scripts/common.sh@354 -- # echo 2 00:07:51.890 13:41:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.890 13:41:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.890 13:41:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.890 13:41:32 -- scripts/common.sh@367 -- # return 0 00:07:51.890 13:41:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.890 13:41:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.890 --rc genhtml_branch_coverage=1 00:07:51.890 --rc genhtml_function_coverage=1 00:07:51.890 --rc genhtml_legend=1 00:07:51.890 --rc geninfo_all_blocks=1 00:07:51.890 --rc geninfo_unexecuted_blocks=1 00:07:51.890 00:07:51.890 ' 00:07:51.890 13:41:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.890 --rc genhtml_branch_coverage=1 00:07:51.890 --rc genhtml_function_coverage=1 00:07:51.890 --rc genhtml_legend=1 00:07:51.890 --rc geninfo_all_blocks=1 00:07:51.890 --rc geninfo_unexecuted_blocks=1 00:07:51.890 00:07:51.890 ' 00:07:51.890 13:41:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.890 --rc genhtml_branch_coverage=1 00:07:51.890 --rc genhtml_function_coverage=1 00:07:51.890 --rc genhtml_legend=1 00:07:51.890 --rc geninfo_all_blocks=1 00:07:51.890 --rc geninfo_unexecuted_blocks=1 00:07:51.890 00:07:51.890 ' 00:07:51.890 13:41:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.890 --rc genhtml_branch_coverage=1 00:07:51.890 --rc genhtml_function_coverage=1 00:07:51.890 --rc genhtml_legend=1 00:07:51.890 --rc geninfo_all_blocks=1 00:07:51.890 --rc geninfo_unexecuted_blocks=1 00:07:51.890 00:07:51.890 ' 00:07:51.890 13:41:32 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:51.890 13:41:32 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.891 13:41:32 -- nvmf/common.sh@7 -- # uname -s 00:07:51.891 13:41:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.891 13:41:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.891 13:41:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.891 13:41:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.891 13:41:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.891 13:41:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.891 13:41:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.891 13:41:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.891 13:41:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.891 13:41:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.891 13:41:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.891 13:41:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.891 13:41:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.891 13:41:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.891 13:41:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.891 13:41:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:51.891 13:41:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.891 13:41:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.891 13:41:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.891 13:41:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.891 13:41:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.891 13:41:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.891 13:41:32 -- paths/export.sh@5 -- # export PATH 00:07:51.891 13:41:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.891 13:41:32 -- nvmf/common.sh@46 -- # : 0 00:07:51.891 13:41:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:51.891 13:41:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:51.891 13:41:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:51.891 13:41:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.891 13:41:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.891 13:41:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:51.891 13:41:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:51.891 13:41:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:51.891 13:41:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:51.891 13:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:51.891 13:41:32 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.891 13:41:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.891 13:41:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.891 13:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:51.891 ************************************ 00:07:51.891 START TEST nvmf_example 00:07:51.891 ************************************ 00:07:51.891 13:41:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.891 * Looking for test storage... 00:07:51.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:51.891 13:41:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.891 13:41:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.891 13:41:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:52.151 13:41:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:52.151 13:41:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:52.151 13:41:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:52.151 13:41:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:52.151 13:41:32 -- scripts/common.sh@335 -- # IFS=.-: 00:07:52.151 13:41:32 -- scripts/common.sh@335 -- # read -ra ver1 00:07:52.151 13:41:32 -- scripts/common.sh@336 -- # IFS=.-: 00:07:52.151 13:41:32 -- scripts/common.sh@336 -- # read -ra ver2 00:07:52.151 13:41:32 -- scripts/common.sh@337 -- # local 'op=<' 00:07:52.151 13:41:32 -- scripts/common.sh@339 -- # ver1_l=2 00:07:52.151 13:41:32 -- scripts/common.sh@340 -- # ver2_l=1 00:07:52.151 13:41:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:52.151 13:41:32 -- scripts/common.sh@343 -- # case "$op" in 00:07:52.151 13:41:32 -- scripts/common.sh@344 -- # : 1 00:07:52.151 13:41:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:52.151 13:41:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:52.151 13:41:32 -- scripts/common.sh@364 -- # decimal 1 00:07:52.151 13:41:32 -- scripts/common.sh@352 -- # local d=1 00:07:52.151 13:41:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:52.151 13:41:32 -- scripts/common.sh@354 -- # echo 1 00:07:52.151 13:41:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:52.151 13:41:32 -- scripts/common.sh@365 -- # decimal 2 00:07:52.151 13:41:32 -- scripts/common.sh@352 -- # local d=2 00:07:52.151 13:41:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:52.151 13:41:32 -- scripts/common.sh@354 -- # echo 2 00:07:52.151 13:41:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:52.151 13:41:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:52.151 13:41:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:52.151 13:41:32 -- scripts/common.sh@367 -- # return 0 00:07:52.151 13:41:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:52.151 13:41:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:52.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.151 --rc genhtml_branch_coverage=1 00:07:52.151 --rc genhtml_function_coverage=1 00:07:52.151 --rc genhtml_legend=1 00:07:52.151 --rc geninfo_all_blocks=1 00:07:52.151 --rc geninfo_unexecuted_blocks=1 00:07:52.151 00:07:52.151 ' 00:07:52.151 13:41:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:52.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.151 --rc genhtml_branch_coverage=1 00:07:52.151 --rc genhtml_function_coverage=1 00:07:52.151 --rc genhtml_legend=1 00:07:52.151 --rc geninfo_all_blocks=1 00:07:52.151 --rc geninfo_unexecuted_blocks=1 00:07:52.151 00:07:52.151 ' 00:07:52.151 13:41:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:52.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.151 --rc genhtml_branch_coverage=1 00:07:52.151 --rc genhtml_function_coverage=1 00:07:52.151 --rc genhtml_legend=1 00:07:52.151 --rc geninfo_all_blocks=1 00:07:52.151 --rc geninfo_unexecuted_blocks=1 00:07:52.151 00:07:52.151 ' 00:07:52.151 13:41:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:52.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.151 --rc genhtml_branch_coverage=1 00:07:52.151 --rc genhtml_function_coverage=1 00:07:52.151 --rc genhtml_legend=1 00:07:52.151 --rc geninfo_all_blocks=1 00:07:52.151 --rc geninfo_unexecuted_blocks=1 00:07:52.151 00:07:52.151 ' 00:07:52.151 13:41:32 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.151 13:41:32 -- nvmf/common.sh@7 -- # uname -s 00:07:52.151 13:41:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.151 13:41:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.151 13:41:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.151 13:41:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.151 13:41:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.151 13:41:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.151 13:41:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.151 13:41:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.151 13:41:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.151 13:41:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.151 13:41:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.151 13:41:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.151 13:41:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.151 13:41:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.151 13:41:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.151 13:41:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:52.151 13:41:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.151 13:41:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.151 13:41:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.151 13:41:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.151 13:41:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.151 13:41:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.151 13:41:32 -- paths/export.sh@5 -- # export PATH 00:07:52.151 13:41:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.151 13:41:32 -- nvmf/common.sh@46 -- # : 0 00:07:52.151 13:41:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:52.151 13:41:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:52.151 13:41:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:52.151 13:41:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.151 13:41:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.151 13:41:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:52.151 13:41:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:52.151 13:41:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:52.151 13:41:32 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:52.151 13:41:32 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:52.151 13:41:32 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:52.151 13:41:32 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:52.151 13:41:32 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:52.151 13:41:32 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:52.151 13:41:32 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:52.151 13:41:32 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:52.151 13:41:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:52.151 13:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:52.151 13:41:32 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:52.151 13:41:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:52.151 13:41:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.151 13:41:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:52.151 13:41:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:52.151 13:41:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:52.151 13:41:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.152 13:41:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.152 13:41:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.152 13:41:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:52.152 13:41:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:52.152 13:41:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:52.152 13:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:54.062 13:41:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.062 13:41:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:54.062 13:41:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:54.062 13:41:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:54.062 13:41:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:54.062 13:41:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:54.062 13:41:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:54.062 13:41:34 -- nvmf/common.sh@294 -- # net_devs=() 00:07:54.062 13:41:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:54.062 13:41:34 -- nvmf/common.sh@295 -- # e810=() 00:07:54.062 13:41:34 -- nvmf/common.sh@295 -- # local -ga e810 00:07:54.062 13:41:34 -- nvmf/common.sh@296 -- # x722=() 00:07:54.062 13:41:34 -- nvmf/common.sh@296 -- # local -ga x722 00:07:54.063 13:41:34 -- nvmf/common.sh@297 -- # mlx=() 00:07:54.063 13:41:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:54.063 13:41:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.063 13:41:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.063 13:41:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:54.063 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:54.063 13:41:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.063 13:41:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:54.063 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:54.063 13:41:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.063 13:41:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.063 13:41:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.063 13:41:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:54.063 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:54.063 13:41:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.063 13:41:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.063 13:41:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.063 13:41:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:54.063 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:54.063 13:41:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:54.063 13:41:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:54.063 13:41:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:54.063 13:41:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:54.063 13:41:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:54.063 13:41:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:54.063 13:41:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:54.063 13:41:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:54.063 13:41:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:54.063 13:41:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:54.063 13:41:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:54.063 13:41:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:54.063 13:41:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:54.063 13:41:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:54.063 13:41:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:54.063 13:41:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:54.063 13:41:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:54.063 13:41:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:54.063 13:41:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:54.063 13:41:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:54.063 13:41:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:54.063 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:54.063 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:07:54.063 00:07:54.063 --- 10.0.0.2 ping statistics --- 00:07:54.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.063 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:07:54.063 13:41:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:54.063 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:54.063 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:07:54.063 00:07:54.063 --- 10.0.0.1 ping statistics --- 00:07:54.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.063 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:07:54.063 13:41:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:54.063 13:41:34 -- nvmf/common.sh@410 -- # return 0 00:07:54.063 13:41:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:54.063 13:41:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:54.063 13:41:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:54.063 13:41:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:54.063 13:41:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:54.063 13:41:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:54.063 13:41:34 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:54.063 13:41:34 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:54.063 13:41:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:54.063 13:41:34 -- common/autotest_common.sh@10 -- # set +x 00:07:54.063 13:41:34 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:54.063 13:41:34 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:54.063 13:41:34 -- target/nvmf_example.sh@34 -- # nvmfpid=2194979 00:07:54.063 13:41:34 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:54.063 13:41:34 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:54.063 13:41:34 -- target/nvmf_example.sh@36 -- # waitforlisten 2194979 00:07:54.063 13:41:34 -- common/autotest_common.sh@829 -- # '[' -z 2194979 ']' 00:07:54.063 13:41:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.063 13:41:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.063 13:41:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.063 13:41:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.063 13:41:34 -- common/autotest_common.sh@10 -- # set +x 00:07:54.323 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.262 13:41:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:55.262 13:41:35 -- common/autotest_common.sh@862 -- # return 0 00:07:55.262 13:41:35 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:55.262 13:41:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:55.262 13:41:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.262 13:41:35 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:55.262 13:41:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.262 13:41:35 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:55.262 13:41:35 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:55.262 13:41:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.262 13:41:35 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:55.262 13:41:35 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:55.262 13:41:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.262 13:41:35 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:55.262 13:41:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.262 13:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:55.262 13:41:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.262 13:41:35 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:55.262 13:41:35 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:55.262 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.540 Initializing NVMe Controllers 00:08:07.540 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:07.540 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:07.540 Initialization complete. Launching workers. 00:08:07.540 ======================================================== 00:08:07.540 Latency(us) 00:08:07.540 Device Information : IOPS MiB/s Average min max 00:08:07.540 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15773.10 61.61 4059.25 617.69 16667.76 00:08:07.540 ======================================================== 00:08:07.540 Total : 15773.10 61.61 4059.25 617.69 16667.76 00:08:07.540 00:08:07.540 13:41:45 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:07.540 13:41:45 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:07.540 13:41:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:07.540 13:41:45 -- nvmf/common.sh@116 -- # sync 00:08:07.541 13:41:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:07.541 13:41:45 -- nvmf/common.sh@119 -- # set +e 00:08:07.541 13:41:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:07.541 13:41:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:07.541 rmmod nvme_tcp 00:08:07.541 rmmod nvme_fabrics 00:08:07.541 rmmod nvme_keyring 00:08:07.541 13:41:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:07.541 13:41:45 -- nvmf/common.sh@123 -- # set -e 00:08:07.541 13:41:45 -- nvmf/common.sh@124 -- # return 0 00:08:07.541 13:41:45 -- nvmf/common.sh@477 -- # '[' -n 2194979 ']' 00:08:07.541 13:41:45 -- nvmf/common.sh@478 -- # killprocess 2194979 00:08:07.541 13:41:45 -- common/autotest_common.sh@936 -- # '[' -z 2194979 ']' 00:08:07.541 13:41:45 -- common/autotest_common.sh@940 -- # kill -0 2194979 00:08:07.541 13:41:45 -- common/autotest_common.sh@941 -- # uname 00:08:07.541 13:41:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:07.541 13:41:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2194979 00:08:07.541 13:41:45 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:07.541 13:41:45 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:07.541 13:41:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2194979' 00:08:07.541 killing process with pid 2194979 00:08:07.541 13:41:45 -- common/autotest_common.sh@955 -- # kill 2194979 00:08:07.541 13:41:45 -- common/autotest_common.sh@960 -- # wait 2194979 00:08:07.541 nvmf threads initialize successfully 00:08:07.541 bdev subsystem init successfully 00:08:07.541 created a nvmf target service 00:08:07.541 create targets's poll groups done 00:08:07.541 all subsystems of target started 00:08:07.541 nvmf target is running 00:08:07.541 all subsystems of target stopped 00:08:07.541 destroy targets's poll groups done 00:08:07.541 destroyed the nvmf target service 00:08:07.541 bdev subsystem finish successfully 00:08:07.541 nvmf threads destroy successfully 00:08:07.541 13:41:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:07.541 13:41:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:07.541 13:41:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:07.541 13:41:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:07.541 13:41:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:07.541 13:41:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:07.541 13:41:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:07.541 13:41:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:07.800 13:41:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:07.800 13:41:47 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:07.800 13:41:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:07.800 13:41:47 -- common/autotest_common.sh@10 -- # set +x 00:08:07.800 00:08:07.800 real 0m15.940s 00:08:07.800 user 0m45.209s 00:08:07.800 sys 0m3.226s 00:08:07.800 13:41:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:07.800 13:41:47 -- common/autotest_common.sh@10 -- # set +x 00:08:07.800 ************************************ 00:08:07.800 END TEST nvmf_example 00:08:07.800 ************************************ 00:08:07.800 13:41:48 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:07.800 13:41:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:07.800 13:41:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:07.800 13:41:48 -- common/autotest_common.sh@10 -- # set +x 00:08:07.800 ************************************ 00:08:07.800 START TEST nvmf_filesystem 00:08:07.800 ************************************ 00:08:07.800 13:41:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:07.800 * Looking for test storage... 00:08:07.800 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.800 13:41:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.064 13:41:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.064 13:41:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.064 13:41:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.064 13:41:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.064 13:41:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.064 13:41:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.064 13:41:48 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.064 13:41:48 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.064 13:41:48 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.064 13:41:48 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.064 13:41:48 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.064 13:41:48 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.064 13:41:48 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.064 13:41:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.064 13:41:48 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.064 13:41:48 -- scripts/common.sh@344 -- # : 1 00:08:08.064 13:41:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.064 13:41:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.064 13:41:48 -- scripts/common.sh@364 -- # decimal 1 00:08:08.064 13:41:48 -- scripts/common.sh@352 -- # local d=1 00:08:08.064 13:41:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.064 13:41:48 -- scripts/common.sh@354 -- # echo 1 00:08:08.064 13:41:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.064 13:41:48 -- scripts/common.sh@365 -- # decimal 2 00:08:08.064 13:41:48 -- scripts/common.sh@352 -- # local d=2 00:08:08.064 13:41:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.064 13:41:48 -- scripts/common.sh@354 -- # echo 2 00:08:08.064 13:41:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.064 13:41:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.064 13:41:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.064 13:41:48 -- scripts/common.sh@367 -- # return 0 00:08:08.064 13:41:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.064 13:41:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.064 --rc genhtml_branch_coverage=1 00:08:08.064 --rc genhtml_function_coverage=1 00:08:08.064 --rc genhtml_legend=1 00:08:08.064 --rc geninfo_all_blocks=1 00:08:08.064 --rc geninfo_unexecuted_blocks=1 00:08:08.064 00:08:08.064 ' 00:08:08.064 13:41:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.064 --rc genhtml_branch_coverage=1 00:08:08.064 --rc genhtml_function_coverage=1 00:08:08.064 --rc genhtml_legend=1 00:08:08.064 --rc geninfo_all_blocks=1 00:08:08.064 --rc geninfo_unexecuted_blocks=1 00:08:08.064 00:08:08.064 ' 00:08:08.064 13:41:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.064 --rc genhtml_branch_coverage=1 00:08:08.064 --rc genhtml_function_coverage=1 00:08:08.064 --rc genhtml_legend=1 00:08:08.064 --rc geninfo_all_blocks=1 00:08:08.064 --rc geninfo_unexecuted_blocks=1 00:08:08.064 00:08:08.064 ' 00:08:08.064 13:41:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.064 --rc genhtml_branch_coverage=1 00:08:08.064 --rc genhtml_function_coverage=1 00:08:08.064 --rc genhtml_legend=1 00:08:08.064 --rc geninfo_all_blocks=1 00:08:08.064 --rc geninfo_unexecuted_blocks=1 00:08:08.064 00:08:08.064 ' 00:08:08.064 13:41:48 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:08.064 13:41:48 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:08.064 13:41:48 -- common/autotest_common.sh@34 -- # set -e 00:08:08.064 13:41:48 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:08.064 13:41:48 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:08.064 13:41:48 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:08.064 13:41:48 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:08.064 13:41:48 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:08.064 13:41:48 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:08.064 13:41:48 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:08.064 13:41:48 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:08.064 13:41:48 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:08.064 13:41:48 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:08.064 13:41:48 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:08.064 13:41:48 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:08.064 13:41:48 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:08.064 13:41:48 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:08.064 13:41:48 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:08.064 13:41:48 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:08.064 13:41:48 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:08.064 13:41:48 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:08.064 13:41:48 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:08.064 13:41:48 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:08.064 13:41:48 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:08.064 13:41:48 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:08.064 13:41:48 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:08.064 13:41:48 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:08.064 13:41:48 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:08.064 13:41:48 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:08.064 13:41:48 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:08.064 13:41:48 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:08.064 13:41:48 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:08.064 13:41:48 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:08.064 13:41:48 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:08.064 13:41:48 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:08.064 13:41:48 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:08.064 13:41:48 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:08.064 13:41:48 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:08.064 13:41:48 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:08.064 13:41:48 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:08.064 13:41:48 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:08.064 13:41:48 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:08.064 13:41:48 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.065 13:41:48 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:08.065 13:41:48 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:08.065 13:41:48 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:08.065 13:41:48 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:08.065 13:41:48 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:08.065 13:41:48 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:08.065 13:41:48 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:08.065 13:41:48 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:08.065 13:41:48 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:08.065 13:41:48 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:08.065 13:41:48 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:08.065 13:41:48 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:08.065 13:41:48 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:08.065 13:41:48 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:08.065 13:41:48 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:08.065 13:41:48 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:08.065 13:41:48 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:08.065 13:41:48 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:08.065 13:41:48 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:08.065 13:41:48 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:08.065 13:41:48 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:08.065 13:41:48 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:08.065 13:41:48 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:08.065 13:41:48 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:08.065 13:41:48 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.065 13:41:48 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:08.065 13:41:48 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:08.065 13:41:48 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:08.065 13:41:48 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:08.065 13:41:48 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:08.065 13:41:48 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:08.065 13:41:48 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:08.065 13:41:48 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:08.065 13:41:48 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:08.065 13:41:48 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:08.065 13:41:48 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:08.065 13:41:48 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:08.065 13:41:48 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:08.065 13:41:48 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:08.065 13:41:48 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:08.065 13:41:48 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:08.065 13:41:48 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:08.065 13:41:48 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:08.065 13:41:48 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:08.065 13:41:48 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:08.065 13:41:48 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:08.065 13:41:48 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:08.065 13:41:48 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:08.065 13:41:48 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.065 13:41:48 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:08.065 13:41:48 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.065 13:41:48 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:08.065 13:41:48 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:08.065 13:41:48 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:08.065 13:41:48 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:08.065 13:41:48 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:08.065 13:41:48 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:08.065 13:41:48 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:08.065 13:41:48 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:08.065 #define SPDK_CONFIG_H 00:08:08.065 #define SPDK_CONFIG_APPS 1 00:08:08.065 #define SPDK_CONFIG_ARCH native 00:08:08.065 #undef SPDK_CONFIG_ASAN 00:08:08.065 #undef SPDK_CONFIG_AVAHI 00:08:08.065 #undef SPDK_CONFIG_CET 00:08:08.065 #define SPDK_CONFIG_COVERAGE 1 00:08:08.065 #define SPDK_CONFIG_CROSS_PREFIX 00:08:08.065 #undef SPDK_CONFIG_CRYPTO 00:08:08.065 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:08.065 #undef SPDK_CONFIG_CUSTOMOCF 00:08:08.065 #undef SPDK_CONFIG_DAOS 00:08:08.065 #define SPDK_CONFIG_DAOS_DIR 00:08:08.065 #define SPDK_CONFIG_DEBUG 1 00:08:08.065 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:08.065 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.065 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:08.065 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.065 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:08.065 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:08.065 #define SPDK_CONFIG_EXAMPLES 1 00:08:08.065 #undef SPDK_CONFIG_FC 00:08:08.065 #define SPDK_CONFIG_FC_PATH 00:08:08.065 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:08.065 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:08.065 #undef SPDK_CONFIG_FUSE 00:08:08.065 #undef SPDK_CONFIG_FUZZER 00:08:08.065 #define SPDK_CONFIG_FUZZER_LIB 00:08:08.065 #undef SPDK_CONFIG_GOLANG 00:08:08.065 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:08.065 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:08.065 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:08.065 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:08.065 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:08.065 #define SPDK_CONFIG_IDXD 1 00:08:08.065 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:08.065 #undef SPDK_CONFIG_IPSEC_MB 00:08:08.065 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:08.065 #define SPDK_CONFIG_ISAL 1 00:08:08.065 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:08.065 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:08.065 #define SPDK_CONFIG_LIBDIR 00:08:08.065 #undef SPDK_CONFIG_LTO 00:08:08.065 #define SPDK_CONFIG_MAX_LCORES 00:08:08.065 #define SPDK_CONFIG_NVME_CUSE 1 00:08:08.065 #undef SPDK_CONFIG_OCF 00:08:08.065 #define SPDK_CONFIG_OCF_PATH 00:08:08.065 #define SPDK_CONFIG_OPENSSL_PATH 00:08:08.065 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:08.065 #undef SPDK_CONFIG_PGO_USE 00:08:08.065 #define SPDK_CONFIG_PREFIX /usr/local 00:08:08.065 #undef SPDK_CONFIG_RAID5F 00:08:08.065 #undef SPDK_CONFIG_RBD 00:08:08.065 #define SPDK_CONFIG_RDMA 1 00:08:08.065 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:08.065 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:08.065 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:08.065 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:08.065 #define SPDK_CONFIG_SHARED 1 00:08:08.065 #undef SPDK_CONFIG_SMA 00:08:08.065 #define SPDK_CONFIG_TESTS 1 00:08:08.065 #undef SPDK_CONFIG_TSAN 00:08:08.065 #define SPDK_CONFIG_UBLK 1 00:08:08.065 #define SPDK_CONFIG_UBSAN 1 00:08:08.065 #undef SPDK_CONFIG_UNIT_TESTS 00:08:08.065 #undef SPDK_CONFIG_URING 00:08:08.065 #define SPDK_CONFIG_URING_PATH 00:08:08.065 #undef SPDK_CONFIG_URING_ZNS 00:08:08.065 #undef SPDK_CONFIG_USDT 00:08:08.065 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:08.065 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:08.065 #define SPDK_CONFIG_VFIO_USER 1 00:08:08.065 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:08.065 #define SPDK_CONFIG_VHOST 1 00:08:08.065 #define SPDK_CONFIG_VIRTIO 1 00:08:08.065 #undef SPDK_CONFIG_VTUNE 00:08:08.065 #define SPDK_CONFIG_VTUNE_DIR 00:08:08.065 #define SPDK_CONFIG_WERROR 1 00:08:08.065 #define SPDK_CONFIG_WPDK_DIR 00:08:08.065 #undef SPDK_CONFIG_XNVME 00:08:08.065 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:08.065 13:41:48 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:08.065 13:41:48 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.065 13:41:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.065 13:41:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.065 13:41:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.065 13:41:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.065 13:41:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.065 13:41:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.065 13:41:48 -- paths/export.sh@5 -- # export PATH 00:08:08.065 13:41:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.065 13:41:48 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:08.066 13:41:48 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:08.066 13:41:48 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:08.066 13:41:48 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:08.066 13:41:48 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:08.066 13:41:48 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:08.066 13:41:48 -- pm/common@16 -- # TEST_TAG=N/A 00:08:08.066 13:41:48 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:08.066 13:41:48 -- common/autotest_common.sh@52 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:08.066 13:41:48 -- common/autotest_common.sh@56 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:08.066 13:41:48 -- common/autotest_common.sh@58 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:08.066 13:41:48 -- common/autotest_common.sh@60 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:08.066 13:41:48 -- common/autotest_common.sh@62 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:08.066 13:41:48 -- common/autotest_common.sh@64 -- # : 00:08:08.066 13:41:48 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:08.066 13:41:48 -- common/autotest_common.sh@66 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:08.066 13:41:48 -- common/autotest_common.sh@68 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:08.066 13:41:48 -- common/autotest_common.sh@70 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:08.066 13:41:48 -- common/autotest_common.sh@72 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:08.066 13:41:48 -- common/autotest_common.sh@74 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:08.066 13:41:48 -- common/autotest_common.sh@76 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:08.066 13:41:48 -- common/autotest_common.sh@78 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:08.066 13:41:48 -- common/autotest_common.sh@80 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:08.066 13:41:48 -- common/autotest_common.sh@82 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:08.066 13:41:48 -- common/autotest_common.sh@84 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:08.066 13:41:48 -- common/autotest_common.sh@86 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:08.066 13:41:48 -- common/autotest_common.sh@88 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:08.066 13:41:48 -- common/autotest_common.sh@90 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:08.066 13:41:48 -- common/autotest_common.sh@92 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:08.066 13:41:48 -- common/autotest_common.sh@94 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:08.066 13:41:48 -- common/autotest_common.sh@96 -- # : tcp 00:08:08.066 13:41:48 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:08.066 13:41:48 -- common/autotest_common.sh@98 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:08.066 13:41:48 -- common/autotest_common.sh@100 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:08.066 13:41:48 -- common/autotest_common.sh@102 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:08.066 13:41:48 -- common/autotest_common.sh@104 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:08.066 13:41:48 -- common/autotest_common.sh@106 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:08.066 13:41:48 -- common/autotest_common.sh@108 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:08.066 13:41:48 -- common/autotest_common.sh@110 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:08.066 13:41:48 -- common/autotest_common.sh@112 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:08.066 13:41:48 -- common/autotest_common.sh@114 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:08.066 13:41:48 -- common/autotest_common.sh@116 -- # : 1 00:08:08.066 13:41:48 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:08.066 13:41:48 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.066 13:41:48 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:08.066 13:41:48 -- common/autotest_common.sh@120 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:08.066 13:41:48 -- common/autotest_common.sh@122 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:08.066 13:41:48 -- common/autotest_common.sh@124 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:08.066 13:41:48 -- common/autotest_common.sh@126 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:08.066 13:41:48 -- common/autotest_common.sh@128 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:08.066 13:41:48 -- common/autotest_common.sh@130 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:08.066 13:41:48 -- common/autotest_common.sh@132 -- # : v23.11 00:08:08.066 13:41:48 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:08.066 13:41:48 -- common/autotest_common.sh@134 -- # : true 00:08:08.066 13:41:48 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:08.066 13:41:48 -- common/autotest_common.sh@136 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:08.066 13:41:48 -- common/autotest_common.sh@138 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:08.066 13:41:48 -- common/autotest_common.sh@140 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:08.066 13:41:48 -- common/autotest_common.sh@142 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:08.066 13:41:48 -- common/autotest_common.sh@144 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:08.066 13:41:48 -- common/autotest_common.sh@146 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:08.066 13:41:48 -- common/autotest_common.sh@148 -- # : e810 00:08:08.066 13:41:48 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:08.066 13:41:48 -- common/autotest_common.sh@150 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:08.066 13:41:48 -- common/autotest_common.sh@152 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:08.066 13:41:48 -- common/autotest_common.sh@154 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:08.066 13:41:48 -- common/autotest_common.sh@156 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:08.066 13:41:48 -- common/autotest_common.sh@158 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:08.066 13:41:48 -- common/autotest_common.sh@160 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:08.066 13:41:48 -- common/autotest_common.sh@163 -- # : 00:08:08.066 13:41:48 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:08.066 13:41:48 -- common/autotest_common.sh@165 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:08.066 13:41:48 -- common/autotest_common.sh@167 -- # : 0 00:08:08.066 13:41:48 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:08.066 13:41:48 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.066 13:41:48 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:08.067 13:41:48 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:08.067 13:41:48 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:08.067 13:41:48 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:08.067 13:41:48 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:08.067 13:41:48 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:08.067 13:41:48 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:08.067 13:41:48 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:08.067 13:41:48 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:08.067 13:41:48 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:08.067 13:41:48 -- common/autotest_common.sh@196 -- # cat 00:08:08.067 13:41:48 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:08.067 13:41:48 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:08.067 13:41:48 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:08.067 13:41:48 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:08.067 13:41:48 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:08.067 13:41:48 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:08.067 13:41:48 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:08.067 13:41:48 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.067 13:41:48 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.067 13:41:48 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.067 13:41:48 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.067 13:41:48 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:08.067 13:41:48 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:08.067 13:41:48 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:08.067 13:41:48 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:08.067 13:41:48 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:08.067 13:41:48 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:08.067 13:41:48 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:08.067 13:41:48 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:08.067 13:41:48 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:08.067 13:41:48 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:08.067 13:41:48 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:08.067 13:41:48 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:08.067 13:41:48 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:08.067 13:41:48 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:08.067 13:41:48 -- common/autotest_common.sh@259 -- # valgrind= 00:08:08.067 13:41:48 -- common/autotest_common.sh@265 -- # uname -s 00:08:08.067 13:41:48 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:08.067 13:41:48 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:08.067 13:41:48 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:08.067 13:41:48 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:08.067 13:41:48 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:08.067 13:41:48 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:08.067 13:41:48 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:08.067 13:41:48 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:08.067 13:41:48 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:08.067 13:41:48 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:08.067 13:41:48 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:08.067 13:41:48 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:08.067 13:41:48 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:08.067 13:41:48 -- common/autotest_common.sh@319 -- # [[ -z 2196805 ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@319 -- # kill -0 2196805 00:08:08.067 13:41:48 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:08.067 13:41:48 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:08.067 13:41:48 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:08.067 13:41:48 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:08.067 13:41:48 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:08.067 13:41:48 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:08.067 13:41:48 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:08.067 13:41:48 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.kE2A1O 00:08:08.067 13:41:48 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:08.067 13:41:48 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:08.067 13:41:48 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.kE2A1O/tests/target /tmp/spdk.kE2A1O 00:08:08.067 13:41:48 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@328 -- # df -T 00:08:08.067 13:41:48 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=52700631040 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=9287888896 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991667200 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993600512 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=659456 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:08.067 13:41:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:08.067 13:41:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:08.067 13:41:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.067 13:41:48 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:08.067 * Looking for test storage... 00:08:08.067 13:41:48 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:08.067 13:41:48 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:08.067 13:41:48 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.068 13:41:48 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:08.068 13:41:48 -- common/autotest_common.sh@373 -- # mount=/ 00:08:08.068 13:41:48 -- common/autotest_common.sh@375 -- # target_space=52700631040 00:08:08.068 13:41:48 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:08.068 13:41:48 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:08.068 13:41:48 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@382 -- # new_size=11502481408 00:08:08.068 13:41:48 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:08.068 13:41:48 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.068 13:41:48 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.068 13:41:48 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.068 13:41:48 -- common/autotest_common.sh@390 -- # return 0 00:08:08.068 13:41:48 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:08.068 13:41:48 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:08.068 13:41:48 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:08.068 13:41:48 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1682 -- # true 00:08:08.068 13:41:48 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:08.068 13:41:48 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@27 -- # exec 00:08:08.068 13:41:48 -- common/autotest_common.sh@29 -- # exec 00:08:08.068 13:41:48 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:08.068 13:41:48 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:08.068 13:41:48 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:08.068 13:41:48 -- common/autotest_common.sh@18 -- # set -x 00:08:08.068 13:41:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.068 13:41:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.068 13:41:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.068 13:41:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.068 13:41:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.068 13:41:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.068 13:41:48 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.068 13:41:48 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.068 13:41:48 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.068 13:41:48 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.068 13:41:48 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.068 13:41:48 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.068 13:41:48 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.068 13:41:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.068 13:41:48 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.068 13:41:48 -- scripts/common.sh@344 -- # : 1 00:08:08.068 13:41:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.068 13:41:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.068 13:41:48 -- scripts/common.sh@364 -- # decimal 1 00:08:08.068 13:41:48 -- scripts/common.sh@352 -- # local d=1 00:08:08.068 13:41:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.068 13:41:48 -- scripts/common.sh@354 -- # echo 1 00:08:08.068 13:41:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.068 13:41:48 -- scripts/common.sh@365 -- # decimal 2 00:08:08.068 13:41:48 -- scripts/common.sh@352 -- # local d=2 00:08:08.068 13:41:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.068 13:41:48 -- scripts/common.sh@354 -- # echo 2 00:08:08.068 13:41:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.068 13:41:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.068 13:41:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.068 13:41:48 -- scripts/common.sh@367 -- # return 0 00:08:08.068 13:41:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.068 --rc genhtml_branch_coverage=1 00:08:08.068 --rc genhtml_function_coverage=1 00:08:08.068 --rc genhtml_legend=1 00:08:08.068 --rc geninfo_all_blocks=1 00:08:08.068 --rc geninfo_unexecuted_blocks=1 00:08:08.068 00:08:08.068 ' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.068 --rc genhtml_branch_coverage=1 00:08:08.068 --rc genhtml_function_coverage=1 00:08:08.068 --rc genhtml_legend=1 00:08:08.068 --rc geninfo_all_blocks=1 00:08:08.068 --rc geninfo_unexecuted_blocks=1 00:08:08.068 00:08:08.068 ' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.068 --rc genhtml_branch_coverage=1 00:08:08.068 --rc genhtml_function_coverage=1 00:08:08.068 --rc genhtml_legend=1 00:08:08.068 --rc geninfo_all_blocks=1 00:08:08.068 --rc geninfo_unexecuted_blocks=1 00:08:08.068 00:08:08.068 ' 00:08:08.068 13:41:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.068 --rc genhtml_branch_coverage=1 00:08:08.068 --rc genhtml_function_coverage=1 00:08:08.068 --rc genhtml_legend=1 00:08:08.068 --rc geninfo_all_blocks=1 00:08:08.068 --rc geninfo_unexecuted_blocks=1 00:08:08.068 00:08:08.068 ' 00:08:08.068 13:41:48 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:08.068 13:41:48 -- nvmf/common.sh@7 -- # uname -s 00:08:08.068 13:41:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:08.068 13:41:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:08.068 13:41:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:08.068 13:41:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:08.068 13:41:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:08.068 13:41:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:08.068 13:41:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:08.068 13:41:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:08.068 13:41:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:08.328 13:41:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:08.328 13:41:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.328 13:41:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.328 13:41:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:08.328 13:41:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:08.328 13:41:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:08.328 13:41:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.328 13:41:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.328 13:41:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.328 13:41:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.328 13:41:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.328 13:41:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.328 13:41:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.328 13:41:48 -- paths/export.sh@5 -- # export PATH 00:08:08.328 13:41:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.328 13:41:48 -- nvmf/common.sh@46 -- # : 0 00:08:08.328 13:41:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:08.328 13:41:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:08.328 13:41:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:08.328 13:41:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:08.328 13:41:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:08.328 13:41:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:08.328 13:41:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:08.328 13:41:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:08.328 13:41:48 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:08.328 13:41:48 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:08.328 13:41:48 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:08.328 13:41:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:08.328 13:41:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:08.328 13:41:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:08.328 13:41:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:08.328 13:41:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:08.328 13:41:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:08.328 13:41:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:08.328 13:41:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.328 13:41:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:08.328 13:41:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:08.328 13:41:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:08.328 13:41:48 -- common/autotest_common.sh@10 -- # set +x 00:08:10.264 13:41:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:10.264 13:41:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:10.264 13:41:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:10.264 13:41:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:10.264 13:41:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:10.264 13:41:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:10.264 13:41:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:10.264 13:41:50 -- nvmf/common.sh@294 -- # net_devs=() 00:08:10.264 13:41:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:10.264 13:41:50 -- nvmf/common.sh@295 -- # e810=() 00:08:10.264 13:41:50 -- nvmf/common.sh@295 -- # local -ga e810 00:08:10.264 13:41:50 -- nvmf/common.sh@296 -- # x722=() 00:08:10.264 13:41:50 -- nvmf/common.sh@296 -- # local -ga x722 00:08:10.264 13:41:50 -- nvmf/common.sh@297 -- # mlx=() 00:08:10.264 13:41:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:10.264 13:41:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:10.264 13:41:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:10.264 13:41:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:10.264 13:41:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.264 13:41:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:10.264 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:10.264 13:41:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.264 13:41:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:10.264 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:10.264 13:41:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.264 13:41:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.264 13:41:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.264 13:41:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:10.264 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:10.264 13:41:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.264 13:41:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.264 13:41:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.264 13:41:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.264 13:41:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:10.264 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:10.264 13:41:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.264 13:41:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:10.264 13:41:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:10.264 13:41:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:10.264 13:41:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:10.264 13:41:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:10.264 13:41:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:10.264 13:41:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:10.264 13:41:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:10.264 13:41:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:10.264 13:41:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:10.264 13:41:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:10.264 13:41:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:10.264 13:41:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:10.264 13:41:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:10.264 13:41:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:10.264 13:41:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:10.526 13:41:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:10.526 13:41:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:10.526 13:41:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:10.526 13:41:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:10.526 13:41:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:10.526 13:41:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:10.526 13:41:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:10.526 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:10.526 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:08:10.526 00:08:10.526 --- 10.0.0.2 ping statistics --- 00:08:10.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.526 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:08:10.526 13:41:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:10.526 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:10.526 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.193 ms 00:08:10.526 00:08:10.526 --- 10.0.0.1 ping statistics --- 00:08:10.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.526 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:08:10.526 13:41:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:10.526 13:41:50 -- nvmf/common.sh@410 -- # return 0 00:08:10.526 13:41:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:10.526 13:41:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:10.526 13:41:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:10.526 13:41:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:10.526 13:41:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:10.526 13:41:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:10.526 13:41:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:10.526 13:41:50 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:10.526 13:41:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:10.526 13:41:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.526 13:41:50 -- common/autotest_common.sh@10 -- # set +x 00:08:10.526 ************************************ 00:08:10.526 START TEST nvmf_filesystem_no_in_capsule 00:08:10.526 ************************************ 00:08:10.526 13:41:50 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:10.526 13:41:50 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:10.526 13:41:50 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:10.526 13:41:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:10.526 13:41:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:10.526 13:41:50 -- common/autotest_common.sh@10 -- # set +x 00:08:10.526 13:41:50 -- nvmf/common.sh@469 -- # nvmfpid=2198460 00:08:10.526 13:41:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:10.526 13:41:50 -- nvmf/common.sh@470 -- # waitforlisten 2198460 00:08:10.526 13:41:50 -- common/autotest_common.sh@829 -- # '[' -z 2198460 ']' 00:08:10.526 13:41:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.526 13:41:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:10.526 13:41:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.526 13:41:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:10.526 13:41:50 -- common/autotest_common.sh@10 -- # set +x 00:08:10.526 [2024-11-29 13:41:50.750422] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:10.526 [2024-11-29 13:41:50.750513] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:10.526 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.787 [2024-11-29 13:41:50.832264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:10.787 [2024-11-29 13:41:50.931638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:10.787 [2024-11-29 13:41:50.931805] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:10.787 [2024-11-29 13:41:50.931826] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:10.787 [2024-11-29 13:41:50.931840] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:10.787 [2024-11-29 13:41:50.931905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:10.787 [2024-11-29 13:41:50.931962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:10.787 [2024-11-29 13:41:50.932014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:10.787 [2024-11-29 13:41:50.932017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.718 13:41:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:11.718 13:41:51 -- common/autotest_common.sh@862 -- # return 0 00:08:11.718 13:41:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:11.718 13:41:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 13:41:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:11.718 13:41:51 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:11.718 13:41:51 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 [2024-11-29 13:41:51.762087] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 [2024-11-29 13:41:51.941779] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:11.718 13:41:51 -- common/autotest_common.sh@1369 -- # local bs 00:08:11.718 13:41:51 -- common/autotest_common.sh@1370 -- # local nb 00:08:11.718 13:41:51 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:11.718 13:41:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.718 13:41:51 -- common/autotest_common.sh@10 -- # set +x 00:08:11.718 13:41:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.718 13:41:51 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:11.718 { 00:08:11.718 "name": "Malloc1", 00:08:11.718 "aliases": [ 00:08:11.718 "ce17e8c4-8894-41fa-8e06-f1c67acb6ffc" 00:08:11.718 ], 00:08:11.718 "product_name": "Malloc disk", 00:08:11.718 "block_size": 512, 00:08:11.718 "num_blocks": 1048576, 00:08:11.718 "uuid": "ce17e8c4-8894-41fa-8e06-f1c67acb6ffc", 00:08:11.718 "assigned_rate_limits": { 00:08:11.718 "rw_ios_per_sec": 0, 00:08:11.718 "rw_mbytes_per_sec": 0, 00:08:11.718 "r_mbytes_per_sec": 0, 00:08:11.718 "w_mbytes_per_sec": 0 00:08:11.718 }, 00:08:11.718 "claimed": true, 00:08:11.718 "claim_type": "exclusive_write", 00:08:11.718 "zoned": false, 00:08:11.718 "supported_io_types": { 00:08:11.718 "read": true, 00:08:11.718 "write": true, 00:08:11.718 "unmap": true, 00:08:11.718 "write_zeroes": true, 00:08:11.718 "flush": true, 00:08:11.718 "reset": true, 00:08:11.718 "compare": false, 00:08:11.718 "compare_and_write": false, 00:08:11.718 "abort": true, 00:08:11.718 "nvme_admin": false, 00:08:11.718 "nvme_io": false 00:08:11.718 }, 00:08:11.718 "memory_domains": [ 00:08:11.718 { 00:08:11.718 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:11.718 "dma_device_type": 2 00:08:11.718 } 00:08:11.718 ], 00:08:11.718 "driver_specific": {} 00:08:11.718 } 00:08:11.718 ]' 00:08:11.718 13:41:51 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:11.976 13:41:52 -- common/autotest_common.sh@1372 -- # bs=512 00:08:11.976 13:41:52 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:11.976 13:41:52 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:11.976 13:41:52 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:11.976 13:41:52 -- common/autotest_common.sh@1377 -- # echo 512 00:08:11.976 13:41:52 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:11.976 13:41:52 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:12.541 13:41:52 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:12.541 13:41:52 -- common/autotest_common.sh@1187 -- # local i=0 00:08:12.541 13:41:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:12.541 13:41:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:12.541 13:41:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:14.453 13:41:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:14.453 13:41:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:14.453 13:41:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:14.453 13:41:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:14.453 13:41:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:14.453 13:41:54 -- common/autotest_common.sh@1197 -- # return 0 00:08:14.453 13:41:54 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:14.453 13:41:54 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:14.453 13:41:54 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:14.453 13:41:54 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:14.453 13:41:54 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:14.453 13:41:54 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:14.453 13:41:54 -- setup/common.sh@80 -- # echo 536870912 00:08:14.453 13:41:54 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:14.453 13:41:54 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:14.453 13:41:54 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:14.453 13:41:54 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:14.713 13:41:54 -- target/filesystem.sh@69 -- # partprobe 00:08:15.278 13:41:55 -- target/filesystem.sh@70 -- # sleep 1 00:08:16.216 13:41:56 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:16.216 13:41:56 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:16.216 13:41:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.216 13:41:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.216 13:41:56 -- common/autotest_common.sh@10 -- # set +x 00:08:16.216 ************************************ 00:08:16.216 START TEST filesystem_ext4 00:08:16.216 ************************************ 00:08:16.216 13:41:56 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:16.216 13:41:56 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:16.216 13:41:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.216 13:41:56 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:16.216 13:41:56 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:16.216 13:41:56 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.216 13:41:56 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.216 13:41:56 -- common/autotest_common.sh@915 -- # local force 00:08:16.216 13:41:56 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:16.216 13:41:56 -- common/autotest_common.sh@918 -- # force=-F 00:08:16.216 13:41:56 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:16.216 mke2fs 1.47.0 (5-Feb-2023) 00:08:16.475 Discarding device blocks: 0/522240 done 00:08:16.475 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:16.475 Filesystem UUID: 13b894c7-07fd-4504-ad50-6e0179a3a684 00:08:16.475 Superblock backups stored on blocks: 00:08:16.475 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:16.475 00:08:16.475 Allocating group tables: 0/64 done 00:08:16.475 Writing inode tables: 0/64 done 00:08:17.043 Creating journal (8192 blocks): done 00:08:19.251 Writing superblocks and filesystem accounting information: 0/6410/64 done 00:08:19.251 00:08:19.251 13:41:59 -- common/autotest_common.sh@931 -- # return 0 00:08:19.251 13:41:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:24.526 13:42:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:24.526 13:42:04 -- target/filesystem.sh@25 -- # sync 00:08:24.526 13:42:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:24.526 13:42:04 -- target/filesystem.sh@27 -- # sync 00:08:24.526 13:42:04 -- target/filesystem.sh@29 -- # i=0 00:08:24.526 13:42:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:24.526 13:42:04 -- target/filesystem.sh@37 -- # kill -0 2198460 00:08:24.526 13:42:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:24.526 13:42:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:24.526 13:42:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:24.526 13:42:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:24.526 00:08:24.526 real 0m8.186s 00:08:24.526 user 0m0.010s 00:08:24.526 sys 0m0.073s 00:08:24.526 13:42:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:24.526 13:42:04 -- common/autotest_common.sh@10 -- # set +x 00:08:24.526 ************************************ 00:08:24.526 END TEST filesystem_ext4 00:08:24.526 ************************************ 00:08:24.526 13:42:04 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:24.526 13:42:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:24.526 13:42:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:24.526 13:42:04 -- common/autotest_common.sh@10 -- # set +x 00:08:24.526 ************************************ 00:08:24.526 START TEST filesystem_btrfs 00:08:24.526 ************************************ 00:08:24.526 13:42:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:24.526 13:42:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:24.526 13:42:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:24.526 13:42:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:24.526 13:42:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:24.526 13:42:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:24.526 13:42:04 -- common/autotest_common.sh@914 -- # local i=0 00:08:24.526 13:42:04 -- common/autotest_common.sh@915 -- # local force 00:08:24.526 13:42:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:24.526 13:42:04 -- common/autotest_common.sh@920 -- # force=-f 00:08:24.526 13:42:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:24.785 btrfs-progs v6.8.1 00:08:24.785 See https://btrfs.readthedocs.io for more information. 00:08:24.785 00:08:24.785 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:24.785 NOTE: several default settings have changed in version 5.15, please make sure 00:08:24.785 this does not affect your deployments: 00:08:24.785 - DUP for metadata (-m dup) 00:08:24.785 - enabled no-holes (-O no-holes) 00:08:24.786 - enabled free-space-tree (-R free-space-tree) 00:08:24.786 00:08:24.786 Label: (null) 00:08:24.786 UUID: 17581287-3795-4c5c-8240-ec474142931d 00:08:24.786 Node size: 16384 00:08:24.786 Sector size: 4096 (CPU page size: 4096) 00:08:24.786 Filesystem size: 510.00MiB 00:08:24.786 Block group profiles: 00:08:24.786 Data: single 8.00MiB 00:08:24.786 Metadata: DUP 32.00MiB 00:08:24.786 System: DUP 8.00MiB 00:08:24.786 SSD detected: yes 00:08:24.786 Zoned device: no 00:08:24.786 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:24.786 Checksum: crc32c 00:08:24.786 Number of devices: 1 00:08:24.786 Devices: 00:08:24.786 ID SIZE PATH 00:08:24.786 1 510.00MiB /dev/nvme0n1p1 00:08:24.786 00:08:24.786 13:42:04 -- common/autotest_common.sh@931 -- # return 0 00:08:24.786 13:42:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:25.043 13:42:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:25.043 13:42:05 -- target/filesystem.sh@25 -- # sync 00:08:25.043 13:42:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:25.043 13:42:05 -- target/filesystem.sh@27 -- # sync 00:08:25.043 13:42:05 -- target/filesystem.sh@29 -- # i=0 00:08:25.043 13:42:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:25.043 13:42:05 -- target/filesystem.sh@37 -- # kill -0 2198460 00:08:25.043 13:42:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:25.043 13:42:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:25.043 13:42:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:25.043 13:42:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:25.043 00:08:25.043 real 0m0.617s 00:08:25.043 user 0m0.018s 00:08:25.043 sys 0m0.102s 00:08:25.043 13:42:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:25.043 13:42:05 -- common/autotest_common.sh@10 -- # set +x 00:08:25.043 ************************************ 00:08:25.043 END TEST filesystem_btrfs 00:08:25.043 ************************************ 00:08:25.043 13:42:05 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:25.043 13:42:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:25.043 13:42:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:25.043 13:42:05 -- common/autotest_common.sh@10 -- # set +x 00:08:25.043 ************************************ 00:08:25.043 START TEST filesystem_xfs 00:08:25.043 ************************************ 00:08:25.043 13:42:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:25.043 13:42:05 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:25.043 13:42:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:25.043 13:42:05 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:25.043 13:42:05 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:25.043 13:42:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:25.043 13:42:05 -- common/autotest_common.sh@914 -- # local i=0 00:08:25.043 13:42:05 -- common/autotest_common.sh@915 -- # local force 00:08:25.043 13:42:05 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:25.043 13:42:05 -- common/autotest_common.sh@920 -- # force=-f 00:08:25.043 13:42:05 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:25.303 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:25.303 = sectsz=512 attr=2, projid32bit=1 00:08:25.303 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:25.303 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:25.303 data = bsize=4096 blocks=130560, imaxpct=25 00:08:25.303 = sunit=0 swidth=0 blks 00:08:25.303 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:25.303 log =internal log bsize=4096 blocks=16384, version=2 00:08:25.303 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:25.303 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:26.244 Discarding blocks...Done. 00:08:26.244 13:42:06 -- common/autotest_common.sh@931 -- # return 0 00:08:26.244 13:42:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:28.777 13:42:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:28.777 13:42:08 -- target/filesystem.sh@25 -- # sync 00:08:28.777 13:42:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:28.777 13:42:08 -- target/filesystem.sh@27 -- # sync 00:08:28.777 13:42:08 -- target/filesystem.sh@29 -- # i=0 00:08:28.777 13:42:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:28.777 13:42:08 -- target/filesystem.sh@37 -- # kill -0 2198460 00:08:28.777 13:42:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:28.777 13:42:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:28.777 13:42:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:28.777 13:42:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:28.777 00:08:28.777 real 0m3.419s 00:08:28.777 user 0m0.015s 00:08:28.777 sys 0m0.062s 00:08:28.777 13:42:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.777 13:42:08 -- common/autotest_common.sh@10 -- # set +x 00:08:28.777 ************************************ 00:08:28.777 END TEST filesystem_xfs 00:08:28.777 ************************************ 00:08:28.777 13:42:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:28.777 13:42:09 -- target/filesystem.sh@93 -- # sync 00:08:28.777 13:42:09 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:29.035 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.035 13:42:09 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:29.035 13:42:09 -- common/autotest_common.sh@1208 -- # local i=0 00:08:29.035 13:42:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:29.035 13:42:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:29.035 13:42:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:29.035 13:42:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:29.035 13:42:09 -- common/autotest_common.sh@1220 -- # return 0 00:08:29.035 13:42:09 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:29.035 13:42:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.035 13:42:09 -- common/autotest_common.sh@10 -- # set +x 00:08:29.035 13:42:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.035 13:42:09 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:29.035 13:42:09 -- target/filesystem.sh@101 -- # killprocess 2198460 00:08:29.035 13:42:09 -- common/autotest_common.sh@936 -- # '[' -z 2198460 ']' 00:08:29.035 13:42:09 -- common/autotest_common.sh@940 -- # kill -0 2198460 00:08:29.035 13:42:09 -- common/autotest_common.sh@941 -- # uname 00:08:29.035 13:42:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:29.035 13:42:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2198460 00:08:29.035 13:42:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:29.035 13:42:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:29.035 13:42:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2198460' 00:08:29.035 killing process with pid 2198460 00:08:29.035 13:42:09 -- common/autotest_common.sh@955 -- # kill 2198460 00:08:29.035 13:42:09 -- common/autotest_common.sh@960 -- # wait 2198460 00:08:29.294 13:42:09 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:29.294 00:08:29.294 real 0m18.875s 00:08:29.294 user 1m13.098s 00:08:29.294 sys 0m2.333s 00:08:29.294 13:42:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:29.294 13:42:09 -- common/autotest_common.sh@10 -- # set +x 00:08:29.294 ************************************ 00:08:29.294 END TEST nvmf_filesystem_no_in_capsule 00:08:29.294 ************************************ 00:08:29.552 13:42:09 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:29.552 13:42:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:29.552 13:42:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.552 13:42:09 -- common/autotest_common.sh@10 -- # set +x 00:08:29.552 ************************************ 00:08:29.552 START TEST nvmf_filesystem_in_capsule 00:08:29.552 ************************************ 00:08:29.552 13:42:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:29.552 13:42:09 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:29.552 13:42:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:29.552 13:42:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:29.552 13:42:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:29.552 13:42:09 -- common/autotest_common.sh@10 -- # set +x 00:08:29.552 13:42:09 -- nvmf/common.sh@469 -- # nvmfpid=2201635 00:08:29.552 13:42:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:29.552 13:42:09 -- nvmf/common.sh@470 -- # waitforlisten 2201635 00:08:29.552 13:42:09 -- common/autotest_common.sh@829 -- # '[' -z 2201635 ']' 00:08:29.552 13:42:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:29.552 13:42:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:29.552 13:42:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:29.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:29.552 13:42:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:29.552 13:42:09 -- common/autotest_common.sh@10 -- # set +x 00:08:29.552 [2024-11-29 13:42:09.647724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:29.552 [2024-11-29 13:42:09.647798] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:29.552 EAL: No free 2048 kB hugepages reported on node 1 00:08:29.552 [2024-11-29 13:42:09.712806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:29.552 [2024-11-29 13:42:09.800915] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:29.552 [2024-11-29 13:42:09.801071] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:29.552 [2024-11-29 13:42:09.801089] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:29.552 [2024-11-29 13:42:09.801102] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:29.553 [2024-11-29 13:42:09.801153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:29.553 [2024-11-29 13:42:09.801194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:29.553 [2024-11-29 13:42:09.801285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:29.553 [2024-11-29 13:42:09.801288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:30.489 13:42:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:30.489 13:42:10 -- common/autotest_common.sh@862 -- # return 0 00:08:30.489 13:42:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:30.489 13:42:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:30.489 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.489 13:42:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:30.489 13:42:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:30.489 13:42:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:30.489 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.489 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.489 [2024-11-29 13:42:10.699314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:30.489 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.489 13:42:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:30.489 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.489 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.748 Malloc1 00:08:30.748 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.748 13:42:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:30.748 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.748 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.748 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.748 13:42:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:30.748 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.748 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.748 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.748 13:42:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:30.748 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.748 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.748 [2024-11-29 13:42:10.870943] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:30.748 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.748 13:42:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:30.748 13:42:10 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:30.748 13:42:10 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:30.748 13:42:10 -- common/autotest_common.sh@1369 -- # local bs 00:08:30.748 13:42:10 -- common/autotest_common.sh@1370 -- # local nb 00:08:30.748 13:42:10 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:30.748 13:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:30.748 13:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:30.748 13:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:30.748 13:42:10 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:30.748 { 00:08:30.748 "name": "Malloc1", 00:08:30.748 "aliases": [ 00:08:30.748 "523f6146-5162-445c-b97c-c7d48151af7e" 00:08:30.748 ], 00:08:30.748 "product_name": "Malloc disk", 00:08:30.748 "block_size": 512, 00:08:30.748 "num_blocks": 1048576, 00:08:30.748 "uuid": "523f6146-5162-445c-b97c-c7d48151af7e", 00:08:30.748 "assigned_rate_limits": { 00:08:30.748 "rw_ios_per_sec": 0, 00:08:30.748 "rw_mbytes_per_sec": 0, 00:08:30.748 "r_mbytes_per_sec": 0, 00:08:30.748 "w_mbytes_per_sec": 0 00:08:30.748 }, 00:08:30.748 "claimed": true, 00:08:30.748 "claim_type": "exclusive_write", 00:08:30.748 "zoned": false, 00:08:30.748 "supported_io_types": { 00:08:30.748 "read": true, 00:08:30.748 "write": true, 00:08:30.748 "unmap": true, 00:08:30.748 "write_zeroes": true, 00:08:30.748 "flush": true, 00:08:30.748 "reset": true, 00:08:30.748 "compare": false, 00:08:30.748 "compare_and_write": false, 00:08:30.748 "abort": true, 00:08:30.748 "nvme_admin": false, 00:08:30.748 "nvme_io": false 00:08:30.748 }, 00:08:30.748 "memory_domains": [ 00:08:30.748 { 00:08:30.748 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:30.748 "dma_device_type": 2 00:08:30.748 } 00:08:30.748 ], 00:08:30.748 "driver_specific": {} 00:08:30.748 } 00:08:30.748 ]' 00:08:30.748 13:42:10 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:30.748 13:42:10 -- common/autotest_common.sh@1372 -- # bs=512 00:08:30.748 13:42:10 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:30.748 13:42:10 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:30.748 13:42:10 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:30.748 13:42:10 -- common/autotest_common.sh@1377 -- # echo 512 00:08:30.748 13:42:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:30.748 13:42:10 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:31.690 13:42:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:31.690 13:42:11 -- common/autotest_common.sh@1187 -- # local i=0 00:08:31.690 13:42:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:31.690 13:42:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:31.690 13:42:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:33.597 13:42:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:33.597 13:42:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:33.597 13:42:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:33.597 13:42:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:33.597 13:42:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:33.597 13:42:13 -- common/autotest_common.sh@1197 -- # return 0 00:08:33.597 13:42:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:33.597 13:42:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:33.597 13:42:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:33.597 13:42:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:33.597 13:42:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:33.597 13:42:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:33.597 13:42:13 -- setup/common.sh@80 -- # echo 536870912 00:08:33.597 13:42:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:33.597 13:42:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:33.597 13:42:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:33.597 13:42:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:33.857 13:42:13 -- target/filesystem.sh@69 -- # partprobe 00:08:34.426 13:42:14 -- target/filesystem.sh@70 -- # sleep 1 00:08:35.365 13:42:15 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:35.365 13:42:15 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:35.365 13:42:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:35.365 13:42:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:35.365 13:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:35.365 ************************************ 00:08:35.365 START TEST filesystem_in_capsule_ext4 00:08:35.365 ************************************ 00:08:35.365 13:42:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:35.365 13:42:15 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:35.365 13:42:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:35.365 13:42:15 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:35.365 13:42:15 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:35.365 13:42:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:35.365 13:42:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:35.365 13:42:15 -- common/autotest_common.sh@915 -- # local force 00:08:35.365 13:42:15 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:35.365 13:42:15 -- common/autotest_common.sh@918 -- # force=-F 00:08:35.365 13:42:15 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:35.365 mke2fs 1.47.0 (5-Feb-2023) 00:08:35.365 Discarding device blocks: 0/522240 done 00:08:35.365 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:35.365 Filesystem UUID: 1ba8081a-8216-477e-bc5c-cbd81b3b6bd3 00:08:35.365 Superblock backups stored on blocks: 00:08:35.365 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:35.365 00:08:35.365 Allocating group tables: 0/64 done 00:08:35.365 Writing inode tables: 0/64 done 00:08:35.625 Creating journal (8192 blocks): done 00:08:37.608 Writing superblocks and filesystem accounting information: 0/64 done 00:08:37.608 00:08:37.608 13:42:17 -- common/autotest_common.sh@931 -- # return 0 00:08:37.608 13:42:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.181 13:42:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.181 13:42:23 -- target/filesystem.sh@25 -- # sync 00:08:44.181 13:42:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.181 13:42:23 -- target/filesystem.sh@27 -- # sync 00:08:44.181 13:42:23 -- target/filesystem.sh@29 -- # i=0 00:08:44.181 13:42:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.181 13:42:23 -- target/filesystem.sh@37 -- # kill -0 2201635 00:08:44.181 13:42:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.181 13:42:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.181 13:42:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.181 13:42:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.181 00:08:44.181 real 0m8.046s 00:08:44.181 user 0m0.015s 00:08:44.181 sys 0m0.067s 00:08:44.181 13:42:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.181 13:42:23 -- common/autotest_common.sh@10 -- # set +x 00:08:44.181 ************************************ 00:08:44.181 END TEST filesystem_in_capsule_ext4 00:08:44.181 ************************************ 00:08:44.181 13:42:23 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:44.181 13:42:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:44.181 13:42:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:44.181 13:42:23 -- common/autotest_common.sh@10 -- # set +x 00:08:44.181 ************************************ 00:08:44.181 START TEST filesystem_in_capsule_btrfs 00:08:44.181 ************************************ 00:08:44.181 13:42:23 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:44.181 13:42:23 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:44.181 13:42:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.181 13:42:23 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:44.181 13:42:23 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:44.181 13:42:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.181 13:42:23 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.181 13:42:23 -- common/autotest_common.sh@915 -- # local force 00:08:44.181 13:42:23 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:44.181 13:42:23 -- common/autotest_common.sh@920 -- # force=-f 00:08:44.181 13:42:23 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:44.181 btrfs-progs v6.8.1 00:08:44.181 See https://btrfs.readthedocs.io for more information. 00:08:44.181 00:08:44.181 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:44.181 NOTE: several default settings have changed in version 5.15, please make sure 00:08:44.181 this does not affect your deployments: 00:08:44.181 - DUP for metadata (-m dup) 00:08:44.181 - enabled no-holes (-O no-holes) 00:08:44.181 - enabled free-space-tree (-R free-space-tree) 00:08:44.181 00:08:44.181 Label: (null) 00:08:44.181 UUID: 50ec80ef-08e1-45e6-a510-94d78beae5fa 00:08:44.181 Node size: 16384 00:08:44.181 Sector size: 4096 (CPU page size: 4096) 00:08:44.181 Filesystem size: 510.00MiB 00:08:44.181 Block group profiles: 00:08:44.181 Data: single 8.00MiB 00:08:44.181 Metadata: DUP 32.00MiB 00:08:44.181 System: DUP 8.00MiB 00:08:44.181 SSD detected: yes 00:08:44.181 Zoned device: no 00:08:44.181 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:44.181 Checksum: crc32c 00:08:44.181 Number of devices: 1 00:08:44.181 Devices: 00:08:44.181 ID SIZE PATH 00:08:44.181 1 510.00MiB /dev/nvme0n1p1 00:08:44.181 00:08:44.181 13:42:23 -- common/autotest_common.sh@931 -- # return 0 00:08:44.181 13:42:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.440 13:42:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.440 13:42:24 -- target/filesystem.sh@25 -- # sync 00:08:44.440 13:42:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.440 13:42:24 -- target/filesystem.sh@27 -- # sync 00:08:44.440 13:42:24 -- target/filesystem.sh@29 -- # i=0 00:08:44.440 13:42:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.440 13:42:24 -- target/filesystem.sh@37 -- # kill -0 2201635 00:08:44.440 13:42:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.440 13:42:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.440 13:42:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.440 13:42:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.440 00:08:44.440 real 0m1.212s 00:08:44.440 user 0m0.015s 00:08:44.440 sys 0m0.106s 00:08:44.440 13:42:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.440 13:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:44.440 ************************************ 00:08:44.440 END TEST filesystem_in_capsule_btrfs 00:08:44.440 ************************************ 00:08:44.699 13:42:24 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:44.699 13:42:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:44.699 13:42:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:44.699 13:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:44.699 ************************************ 00:08:44.699 START TEST filesystem_in_capsule_xfs 00:08:44.699 ************************************ 00:08:44.699 13:42:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:44.699 13:42:24 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:44.699 13:42:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.699 13:42:24 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:44.699 13:42:24 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:44.699 13:42:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.699 13:42:24 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.699 13:42:24 -- common/autotest_common.sh@915 -- # local force 00:08:44.699 13:42:24 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:44.699 13:42:24 -- common/autotest_common.sh@920 -- # force=-f 00:08:44.699 13:42:24 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:44.699 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:44.699 = sectsz=512 attr=2, projid32bit=1 00:08:44.699 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:44.699 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:44.699 data = bsize=4096 blocks=130560, imaxpct=25 00:08:44.699 = sunit=0 swidth=0 blks 00:08:44.699 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:44.699 log =internal log bsize=4096 blocks=16384, version=2 00:08:44.699 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:44.699 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:45.635 Discarding blocks...Done. 00:08:45.635 13:42:25 -- common/autotest_common.sh@931 -- # return 0 00:08:45.635 13:42:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:48.175 13:42:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:48.175 13:42:28 -- target/filesystem.sh@25 -- # sync 00:08:48.175 13:42:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:48.175 13:42:28 -- target/filesystem.sh@27 -- # sync 00:08:48.175 13:42:28 -- target/filesystem.sh@29 -- # i=0 00:08:48.175 13:42:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:48.175 13:42:28 -- target/filesystem.sh@37 -- # kill -0 2201635 00:08:48.175 13:42:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:48.175 13:42:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:48.175 13:42:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:48.175 13:42:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:48.175 00:08:48.175 real 0m3.573s 00:08:48.175 user 0m0.020s 00:08:48.175 sys 0m0.057s 00:08:48.175 13:42:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:48.175 13:42:28 -- common/autotest_common.sh@10 -- # set +x 00:08:48.175 ************************************ 00:08:48.175 END TEST filesystem_in_capsule_xfs 00:08:48.175 ************************************ 00:08:48.175 13:42:28 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:48.175 13:42:28 -- target/filesystem.sh@93 -- # sync 00:08:48.175 13:42:28 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:48.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.175 13:42:28 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:48.175 13:42:28 -- common/autotest_common.sh@1208 -- # local i=0 00:08:48.175 13:42:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:48.175 13:42:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:48.435 13:42:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:48.435 13:42:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:48.435 13:42:28 -- common/autotest_common.sh@1220 -- # return 0 00:08:48.435 13:42:28 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:48.435 13:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:48.435 13:42:28 -- common/autotest_common.sh@10 -- # set +x 00:08:48.435 13:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:48.436 13:42:28 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:48.436 13:42:28 -- target/filesystem.sh@101 -- # killprocess 2201635 00:08:48.436 13:42:28 -- common/autotest_common.sh@936 -- # '[' -z 2201635 ']' 00:08:48.436 13:42:28 -- common/autotest_common.sh@940 -- # kill -0 2201635 00:08:48.436 13:42:28 -- common/autotest_common.sh@941 -- # uname 00:08:48.436 13:42:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:48.436 13:42:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2201635 00:08:48.436 13:42:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:48.436 13:42:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:48.436 13:42:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2201635' 00:08:48.436 killing process with pid 2201635 00:08:48.436 13:42:28 -- common/autotest_common.sh@955 -- # kill 2201635 00:08:48.436 13:42:28 -- common/autotest_common.sh@960 -- # wait 2201635 00:08:48.695 13:42:28 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:48.695 00:08:48.695 real 0m19.343s 00:08:48.695 user 1m15.169s 00:08:48.695 sys 0m2.272s 00:08:48.695 13:42:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:48.695 13:42:28 -- common/autotest_common.sh@10 -- # set +x 00:08:48.695 ************************************ 00:08:48.695 END TEST nvmf_filesystem_in_capsule 00:08:48.695 ************************************ 00:08:48.695 13:42:28 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:48.695 13:42:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:48.695 13:42:28 -- nvmf/common.sh@116 -- # sync 00:08:48.695 13:42:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:48.695 13:42:28 -- nvmf/common.sh@119 -- # set +e 00:08:48.695 13:42:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:48.695 13:42:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:48.695 rmmod nvme_tcp 00:08:48.956 rmmod nvme_fabrics 00:08:48.956 rmmod nvme_keyring 00:08:48.956 13:42:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:48.956 13:42:29 -- nvmf/common.sh@123 -- # set -e 00:08:48.956 13:42:29 -- nvmf/common.sh@124 -- # return 0 00:08:48.956 13:42:29 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:48.956 13:42:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:48.956 13:42:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:48.956 13:42:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:48.956 13:42:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:48.956 13:42:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:48.956 13:42:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:48.956 13:42:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:48.956 13:42:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.864 13:42:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:50.864 00:08:50.864 real 0m43.048s 00:08:50.864 user 2m29.324s 00:08:50.864 sys 0m6.343s 00:08:50.864 13:42:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:50.864 13:42:31 -- common/autotest_common.sh@10 -- # set +x 00:08:50.864 ************************************ 00:08:50.864 END TEST nvmf_filesystem 00:08:50.864 ************************************ 00:08:50.864 13:42:31 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:50.864 13:42:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:50.864 13:42:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:50.864 13:42:31 -- common/autotest_common.sh@10 -- # set +x 00:08:50.864 ************************************ 00:08:50.864 START TEST nvmf_discovery 00:08:50.864 ************************************ 00:08:50.864 13:42:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:50.864 * Looking for test storage... 00:08:51.123 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:51.123 13:42:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:51.123 13:42:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:51.123 13:42:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:51.123 13:42:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:51.123 13:42:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:51.123 13:42:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:51.123 13:42:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:51.123 13:42:31 -- scripts/common.sh@335 -- # IFS=.-: 00:08:51.123 13:42:31 -- scripts/common.sh@335 -- # read -ra ver1 00:08:51.123 13:42:31 -- scripts/common.sh@336 -- # IFS=.-: 00:08:51.123 13:42:31 -- scripts/common.sh@336 -- # read -ra ver2 00:08:51.123 13:42:31 -- scripts/common.sh@337 -- # local 'op=<' 00:08:51.123 13:42:31 -- scripts/common.sh@339 -- # ver1_l=2 00:08:51.123 13:42:31 -- scripts/common.sh@340 -- # ver2_l=1 00:08:51.123 13:42:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:51.123 13:42:31 -- scripts/common.sh@343 -- # case "$op" in 00:08:51.123 13:42:31 -- scripts/common.sh@344 -- # : 1 00:08:51.123 13:42:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:51.123 13:42:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:51.123 13:42:31 -- scripts/common.sh@364 -- # decimal 1 00:08:51.123 13:42:31 -- scripts/common.sh@352 -- # local d=1 00:08:51.123 13:42:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:51.123 13:42:31 -- scripts/common.sh@354 -- # echo 1 00:08:51.123 13:42:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:51.123 13:42:31 -- scripts/common.sh@365 -- # decimal 2 00:08:51.123 13:42:31 -- scripts/common.sh@352 -- # local d=2 00:08:51.123 13:42:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:51.123 13:42:31 -- scripts/common.sh@354 -- # echo 2 00:08:51.123 13:42:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:51.123 13:42:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:51.123 13:42:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:51.123 13:42:31 -- scripts/common.sh@367 -- # return 0 00:08:51.123 13:42:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:51.123 13:42:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:51.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.123 --rc genhtml_branch_coverage=1 00:08:51.123 --rc genhtml_function_coverage=1 00:08:51.123 --rc genhtml_legend=1 00:08:51.123 --rc geninfo_all_blocks=1 00:08:51.123 --rc geninfo_unexecuted_blocks=1 00:08:51.123 00:08:51.123 ' 00:08:51.123 13:42:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:51.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.123 --rc genhtml_branch_coverage=1 00:08:51.123 --rc genhtml_function_coverage=1 00:08:51.123 --rc genhtml_legend=1 00:08:51.123 --rc geninfo_all_blocks=1 00:08:51.123 --rc geninfo_unexecuted_blocks=1 00:08:51.123 00:08:51.123 ' 00:08:51.123 13:42:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:51.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.123 --rc genhtml_branch_coverage=1 00:08:51.123 --rc genhtml_function_coverage=1 00:08:51.123 --rc genhtml_legend=1 00:08:51.123 --rc geninfo_all_blocks=1 00:08:51.123 --rc geninfo_unexecuted_blocks=1 00:08:51.123 00:08:51.123 ' 00:08:51.123 13:42:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:51.123 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.123 --rc genhtml_branch_coverage=1 00:08:51.123 --rc genhtml_function_coverage=1 00:08:51.123 --rc genhtml_legend=1 00:08:51.123 --rc geninfo_all_blocks=1 00:08:51.123 --rc geninfo_unexecuted_blocks=1 00:08:51.123 00:08:51.123 ' 00:08:51.123 13:42:31 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:51.123 13:42:31 -- nvmf/common.sh@7 -- # uname -s 00:08:51.123 13:42:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.123 13:42:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.123 13:42:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.124 13:42:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.124 13:42:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.124 13:42:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.124 13:42:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.124 13:42:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.124 13:42:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.124 13:42:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.124 13:42:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.124 13:42:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.124 13:42:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.124 13:42:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.124 13:42:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:51.124 13:42:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:51.124 13:42:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.124 13:42:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.124 13:42:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.124 13:42:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.124 13:42:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.124 13:42:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.124 13:42:31 -- paths/export.sh@5 -- # export PATH 00:08:51.124 13:42:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.124 13:42:31 -- nvmf/common.sh@46 -- # : 0 00:08:51.124 13:42:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:51.124 13:42:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:51.124 13:42:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:51.124 13:42:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.124 13:42:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.124 13:42:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:51.124 13:42:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:51.124 13:42:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:51.124 13:42:31 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:51.124 13:42:31 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:51.124 13:42:31 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:51.124 13:42:31 -- target/discovery.sh@15 -- # hash nvme 00:08:51.124 13:42:31 -- target/discovery.sh@20 -- # nvmftestinit 00:08:51.124 13:42:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:51.124 13:42:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:51.124 13:42:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:51.124 13:42:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:51.124 13:42:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:51.124 13:42:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.124 13:42:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.124 13:42:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:51.124 13:42:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:51.124 13:42:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:51.124 13:42:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:51.124 13:42:31 -- common/autotest_common.sh@10 -- # set +x 00:08:53.666 13:42:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:53.666 13:42:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:53.666 13:42:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:53.666 13:42:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:53.666 13:42:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:53.666 13:42:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:53.666 13:42:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:53.666 13:42:33 -- nvmf/common.sh@294 -- # net_devs=() 00:08:53.666 13:42:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:53.666 13:42:33 -- nvmf/common.sh@295 -- # e810=() 00:08:53.666 13:42:33 -- nvmf/common.sh@295 -- # local -ga e810 00:08:53.666 13:42:33 -- nvmf/common.sh@296 -- # x722=() 00:08:53.666 13:42:33 -- nvmf/common.sh@296 -- # local -ga x722 00:08:53.666 13:42:33 -- nvmf/common.sh@297 -- # mlx=() 00:08:53.666 13:42:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:53.666 13:42:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:53.666 13:42:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:53.666 13:42:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:53.666 13:42:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:53.666 13:42:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:53.666 13:42:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:53.666 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:53.666 13:42:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:53.666 13:42:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:53.666 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:53.666 13:42:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:53.666 13:42:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:53.667 13:42:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:53.667 13:42:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.667 13:42:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:53.667 13:42:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.667 13:42:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:53.667 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:53.667 13:42:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.667 13:42:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:53.667 13:42:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.667 13:42:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:53.667 13:42:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.667 13:42:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:53.667 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:53.667 13:42:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.667 13:42:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:53.667 13:42:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:53.667 13:42:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:53.667 13:42:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:53.667 13:42:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:53.667 13:42:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:53.667 13:42:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:53.667 13:42:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:53.667 13:42:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:53.667 13:42:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:53.667 13:42:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:53.667 13:42:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:53.667 13:42:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:53.667 13:42:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:53.667 13:42:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:53.667 13:42:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:53.667 13:42:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:53.667 13:42:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:53.667 13:42:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:53.667 13:42:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:53.667 13:42:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:53.667 13:42:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:53.667 13:42:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:53.667 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:53.667 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:08:53.667 00:08:53.667 --- 10.0.0.2 ping statistics --- 00:08:53.667 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.667 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:08:53.667 13:42:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:53.667 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:53.667 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:08:53.667 00:08:53.667 --- 10.0.0.1 ping statistics --- 00:08:53.667 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.667 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:08:53.667 13:42:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:53.667 13:42:33 -- nvmf/common.sh@410 -- # return 0 00:08:53.667 13:42:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:53.667 13:42:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:53.667 13:42:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:53.667 13:42:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:53.667 13:42:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:53.667 13:42:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:53.667 13:42:33 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:53.667 13:42:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:53.667 13:42:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:53.667 13:42:33 -- common/autotest_common.sh@10 -- # set +x 00:08:53.667 13:42:33 -- nvmf/common.sh@469 -- # nvmfpid=2206145 00:08:53.667 13:42:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:53.667 13:42:33 -- nvmf/common.sh@470 -- # waitforlisten 2206145 00:08:53.667 13:42:33 -- common/autotest_common.sh@829 -- # '[' -z 2206145 ']' 00:08:53.667 13:42:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:53.667 13:42:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:53.667 13:42:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:53.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:53.667 13:42:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:53.667 13:42:33 -- common/autotest_common.sh@10 -- # set +x 00:08:53.667 [2024-11-29 13:42:33.600118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:53.667 [2024-11-29 13:42:33.600185] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:53.667 EAL: No free 2048 kB hugepages reported on node 1 00:08:53.667 [2024-11-29 13:42:33.666257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:53.667 [2024-11-29 13:42:33.758359] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:53.667 [2024-11-29 13:42:33.758534] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:53.667 [2024-11-29 13:42:33.758554] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:53.667 [2024-11-29 13:42:33.758569] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:53.667 [2024-11-29 13:42:33.758655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:53.667 [2024-11-29 13:42:33.758717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:53.667 [2024-11-29 13:42:33.758770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:53.667 [2024-11-29 13:42:33.758773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:54.605 13:42:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:54.605 13:42:34 -- common/autotest_common.sh@862 -- # return 0 00:08:54.605 13:42:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:54.605 13:42:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 13:42:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:54.605 13:42:34 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 [2024-11-29 13:42:34.621129] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@26 -- # seq 1 4 00:08:54.605 13:42:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.605 13:42:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 Null1 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 [2024-11-29 13:42:34.661413] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.605 13:42:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 Null2 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:54.605 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.605 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.605 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.605 13:42:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.606 13:42:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 Null3 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.606 13:42:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 Null4 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:54.606 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.606 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.606 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.606 13:42:34 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:54.865 00:08:54.865 Discovery Log Number of Records 6, Generation counter 6 00:08:54.865 =====Discovery Log Entry 0====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: current discovery subsystem 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4420 00:08:54.865 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: explicit discovery connections, duplicate discovery information 00:08:54.865 sectype: none 00:08:54.865 =====Discovery Log Entry 1====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: nvme subsystem 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4420 00:08:54.865 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: none 00:08:54.865 sectype: none 00:08:54.865 =====Discovery Log Entry 2====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: nvme subsystem 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4420 00:08:54.865 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: none 00:08:54.865 sectype: none 00:08:54.865 =====Discovery Log Entry 3====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: nvme subsystem 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4420 00:08:54.865 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: none 00:08:54.865 sectype: none 00:08:54.865 =====Discovery Log Entry 4====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: nvme subsystem 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4420 00:08:54.865 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: none 00:08:54.865 sectype: none 00:08:54.865 =====Discovery Log Entry 5====== 00:08:54.865 trtype: tcp 00:08:54.865 adrfam: ipv4 00:08:54.865 subtype: discovery subsystem referral 00:08:54.865 treq: not required 00:08:54.865 portid: 0 00:08:54.865 trsvcid: 4430 00:08:54.865 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:54.865 traddr: 10.0.0.2 00:08:54.865 eflags: none 00:08:54.865 sectype: none 00:08:54.865 13:42:34 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:54.865 Perform nvmf subsystem discovery via RPC 00:08:54.865 13:42:34 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:54.865 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 [2024-11-29 13:42:34.954234] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:54.865 [ 00:08:54.865 { 00:08:54.865 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:54.865 "subtype": "Discovery", 00:08:54.865 "listen_addresses": [ 00:08:54.865 { 00:08:54.865 "transport": "TCP", 00:08:54.865 "trtype": "TCP", 00:08:54.865 "adrfam": "IPv4", 00:08:54.865 "traddr": "10.0.0.2", 00:08:54.865 "trsvcid": "4420" 00:08:54.865 } 00:08:54.865 ], 00:08:54.865 "allow_any_host": true, 00:08:54.865 "hosts": [] 00:08:54.865 }, 00:08:54.865 { 00:08:54.865 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:54.865 "subtype": "NVMe", 00:08:54.865 "listen_addresses": [ 00:08:54.865 { 00:08:54.865 "transport": "TCP", 00:08:54.865 "trtype": "TCP", 00:08:54.865 "adrfam": "IPv4", 00:08:54.865 "traddr": "10.0.0.2", 00:08:54.865 "trsvcid": "4420" 00:08:54.865 } 00:08:54.865 ], 00:08:54.865 "allow_any_host": true, 00:08:54.865 "hosts": [], 00:08:54.865 "serial_number": "SPDK00000000000001", 00:08:54.865 "model_number": "SPDK bdev Controller", 00:08:54.865 "max_namespaces": 32, 00:08:54.865 "min_cntlid": 1, 00:08:54.865 "max_cntlid": 65519, 00:08:54.865 "namespaces": [ 00:08:54.865 { 00:08:54.865 "nsid": 1, 00:08:54.865 "bdev_name": "Null1", 00:08:54.865 "name": "Null1", 00:08:54.865 "nguid": "99CD245B979F4A488521CAC87C19FC33", 00:08:54.865 "uuid": "99cd245b-979f-4a48-8521-cac87c19fc33" 00:08:54.865 } 00:08:54.865 ] 00:08:54.865 }, 00:08:54.865 { 00:08:54.865 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:54.865 "subtype": "NVMe", 00:08:54.865 "listen_addresses": [ 00:08:54.865 { 00:08:54.865 "transport": "TCP", 00:08:54.865 "trtype": "TCP", 00:08:54.865 "adrfam": "IPv4", 00:08:54.865 "traddr": "10.0.0.2", 00:08:54.865 "trsvcid": "4420" 00:08:54.865 } 00:08:54.865 ], 00:08:54.865 "allow_any_host": true, 00:08:54.865 "hosts": [], 00:08:54.865 "serial_number": "SPDK00000000000002", 00:08:54.865 "model_number": "SPDK bdev Controller", 00:08:54.865 "max_namespaces": 32, 00:08:54.865 "min_cntlid": 1, 00:08:54.865 "max_cntlid": 65519, 00:08:54.865 "namespaces": [ 00:08:54.865 { 00:08:54.865 "nsid": 1, 00:08:54.865 "bdev_name": "Null2", 00:08:54.865 "name": "Null2", 00:08:54.865 "nguid": "A4357B12D5F94F26B017C1AD2C6C3327", 00:08:54.865 "uuid": "a4357b12-d5f9-4f26-b017-c1ad2c6c3327" 00:08:54.865 } 00:08:54.865 ] 00:08:54.865 }, 00:08:54.865 { 00:08:54.865 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:54.865 "subtype": "NVMe", 00:08:54.865 "listen_addresses": [ 00:08:54.865 { 00:08:54.865 "transport": "TCP", 00:08:54.865 "trtype": "TCP", 00:08:54.865 "adrfam": "IPv4", 00:08:54.865 "traddr": "10.0.0.2", 00:08:54.865 "trsvcid": "4420" 00:08:54.865 } 00:08:54.865 ], 00:08:54.865 "allow_any_host": true, 00:08:54.865 "hosts": [], 00:08:54.865 "serial_number": "SPDK00000000000003", 00:08:54.865 "model_number": "SPDK bdev Controller", 00:08:54.865 "max_namespaces": 32, 00:08:54.865 "min_cntlid": 1, 00:08:54.865 "max_cntlid": 65519, 00:08:54.865 "namespaces": [ 00:08:54.865 { 00:08:54.865 "nsid": 1, 00:08:54.865 "bdev_name": "Null3", 00:08:54.865 "name": "Null3", 00:08:54.865 "nguid": "6866A8EA441240F4B008350405BFE3FB", 00:08:54.865 "uuid": "6866a8ea-4412-40f4-b008-350405bfe3fb" 00:08:54.865 } 00:08:54.865 ] 00:08:54.865 }, 00:08:54.865 { 00:08:54.865 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:54.865 "subtype": "NVMe", 00:08:54.865 "listen_addresses": [ 00:08:54.865 { 00:08:54.865 "transport": "TCP", 00:08:54.865 "trtype": "TCP", 00:08:54.865 "adrfam": "IPv4", 00:08:54.865 "traddr": "10.0.0.2", 00:08:54.865 "trsvcid": "4420" 00:08:54.865 } 00:08:54.865 ], 00:08:54.865 "allow_any_host": true, 00:08:54.865 "hosts": [], 00:08:54.865 "serial_number": "SPDK00000000000004", 00:08:54.865 "model_number": "SPDK bdev Controller", 00:08:54.865 "max_namespaces": 32, 00:08:54.865 "min_cntlid": 1, 00:08:54.865 "max_cntlid": 65519, 00:08:54.865 "namespaces": [ 00:08:54.865 { 00:08:54.865 "nsid": 1, 00:08:54.865 "bdev_name": "Null4", 00:08:54.865 "name": "Null4", 00:08:54.865 "nguid": "F772499184174E248CEDF4E46E835137", 00:08:54.865 "uuid": "f7724991-8417-4e24-8ced-f4e46e835137" 00:08:54.865 } 00:08:54.865 ] 00:08:54.865 } 00:08:54.865 ] 00:08:54.865 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:34 -- target/discovery.sh@42 -- # seq 1 4 00:08:54.865 13:42:34 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.865 13:42:34 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:54.865 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:34 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:54.865 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:34 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.865 13:42:34 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:54.865 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:34 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:54.865 13:42:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:34 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.865 13:42:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.865 13:42:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:54.865 13:42:35 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:54.865 13:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.865 13:42:35 -- common/autotest_common.sh@10 -- # set +x 00:08:54.865 13:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.865 13:42:35 -- target/discovery.sh@49 -- # check_bdevs= 00:08:54.865 13:42:35 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:54.865 13:42:35 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:54.865 13:42:35 -- target/discovery.sh@57 -- # nvmftestfini 00:08:54.865 13:42:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:54.865 13:42:35 -- nvmf/common.sh@116 -- # sync 00:08:54.865 13:42:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:54.865 13:42:35 -- nvmf/common.sh@119 -- # set +e 00:08:54.865 13:42:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:54.865 13:42:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:54.865 rmmod nvme_tcp 00:08:54.865 rmmod nvme_fabrics 00:08:54.865 rmmod nvme_keyring 00:08:54.865 13:42:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:54.865 13:42:35 -- nvmf/common.sh@123 -- # set -e 00:08:54.865 13:42:35 -- nvmf/common.sh@124 -- # return 0 00:08:54.866 13:42:35 -- nvmf/common.sh@477 -- # '[' -n 2206145 ']' 00:08:54.866 13:42:35 -- nvmf/common.sh@478 -- # killprocess 2206145 00:08:54.866 13:42:35 -- common/autotest_common.sh@936 -- # '[' -z 2206145 ']' 00:08:54.866 13:42:35 -- common/autotest_common.sh@940 -- # kill -0 2206145 00:08:55.125 13:42:35 -- common/autotest_common.sh@941 -- # uname 00:08:55.125 13:42:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:55.125 13:42:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2206145 00:08:55.125 13:42:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:55.125 13:42:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:55.125 13:42:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2206145' 00:08:55.125 killing process with pid 2206145 00:08:55.125 13:42:35 -- common/autotest_common.sh@955 -- # kill 2206145 00:08:55.125 [2024-11-29 13:42:35.186410] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:55.125 13:42:35 -- common/autotest_common.sh@960 -- # wait 2206145 00:08:55.382 13:42:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:55.382 13:42:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:55.382 13:42:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:55.382 13:42:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:55.382 13:42:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:55.382 13:42:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.382 13:42:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.382 13:42:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.285 13:42:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:57.285 00:08:57.285 real 0m6.357s 00:08:57.285 user 0m7.694s 00:08:57.285 sys 0m1.987s 00:08:57.285 13:42:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:57.285 13:42:37 -- common/autotest_common.sh@10 -- # set +x 00:08:57.285 ************************************ 00:08:57.285 END TEST nvmf_discovery 00:08:57.285 ************************************ 00:08:57.285 13:42:37 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:57.285 13:42:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:57.285 13:42:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:57.285 13:42:37 -- common/autotest_common.sh@10 -- # set +x 00:08:57.285 ************************************ 00:08:57.285 START TEST nvmf_referrals 00:08:57.285 ************************************ 00:08:57.285 13:42:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:57.285 * Looking for test storage... 00:08:57.285 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:57.285 13:42:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:57.285 13:42:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:57.285 13:42:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:57.546 13:42:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:57.546 13:42:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:57.546 13:42:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:57.546 13:42:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:57.546 13:42:37 -- scripts/common.sh@335 -- # IFS=.-: 00:08:57.546 13:42:37 -- scripts/common.sh@335 -- # read -ra ver1 00:08:57.546 13:42:37 -- scripts/common.sh@336 -- # IFS=.-: 00:08:57.546 13:42:37 -- scripts/common.sh@336 -- # read -ra ver2 00:08:57.546 13:42:37 -- scripts/common.sh@337 -- # local 'op=<' 00:08:57.546 13:42:37 -- scripts/common.sh@339 -- # ver1_l=2 00:08:57.546 13:42:37 -- scripts/common.sh@340 -- # ver2_l=1 00:08:57.546 13:42:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:57.546 13:42:37 -- scripts/common.sh@343 -- # case "$op" in 00:08:57.546 13:42:37 -- scripts/common.sh@344 -- # : 1 00:08:57.546 13:42:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:57.546 13:42:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:57.546 13:42:37 -- scripts/common.sh@364 -- # decimal 1 00:08:57.546 13:42:37 -- scripts/common.sh@352 -- # local d=1 00:08:57.546 13:42:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:57.546 13:42:37 -- scripts/common.sh@354 -- # echo 1 00:08:57.546 13:42:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:57.546 13:42:37 -- scripts/common.sh@365 -- # decimal 2 00:08:57.546 13:42:37 -- scripts/common.sh@352 -- # local d=2 00:08:57.546 13:42:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:57.546 13:42:37 -- scripts/common.sh@354 -- # echo 2 00:08:57.546 13:42:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:57.546 13:42:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:57.546 13:42:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:57.546 13:42:37 -- scripts/common.sh@367 -- # return 0 00:08:57.546 13:42:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:57.546 13:42:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:57.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.546 --rc genhtml_branch_coverage=1 00:08:57.546 --rc genhtml_function_coverage=1 00:08:57.546 --rc genhtml_legend=1 00:08:57.546 --rc geninfo_all_blocks=1 00:08:57.546 --rc geninfo_unexecuted_blocks=1 00:08:57.546 00:08:57.546 ' 00:08:57.546 13:42:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:57.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.546 --rc genhtml_branch_coverage=1 00:08:57.546 --rc genhtml_function_coverage=1 00:08:57.546 --rc genhtml_legend=1 00:08:57.546 --rc geninfo_all_blocks=1 00:08:57.546 --rc geninfo_unexecuted_blocks=1 00:08:57.546 00:08:57.546 ' 00:08:57.546 13:42:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:57.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.546 --rc genhtml_branch_coverage=1 00:08:57.546 --rc genhtml_function_coverage=1 00:08:57.546 --rc genhtml_legend=1 00:08:57.546 --rc geninfo_all_blocks=1 00:08:57.546 --rc geninfo_unexecuted_blocks=1 00:08:57.546 00:08:57.546 ' 00:08:57.546 13:42:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:57.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.546 --rc genhtml_branch_coverage=1 00:08:57.546 --rc genhtml_function_coverage=1 00:08:57.546 --rc genhtml_legend=1 00:08:57.546 --rc geninfo_all_blocks=1 00:08:57.546 --rc geninfo_unexecuted_blocks=1 00:08:57.546 00:08:57.546 ' 00:08:57.546 13:42:37 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:57.546 13:42:37 -- nvmf/common.sh@7 -- # uname -s 00:08:57.546 13:42:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:57.546 13:42:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:57.546 13:42:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:57.546 13:42:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:57.546 13:42:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:57.546 13:42:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:57.546 13:42:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:57.546 13:42:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:57.546 13:42:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:57.546 13:42:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:57.546 13:42:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.546 13:42:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.546 13:42:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:57.546 13:42:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:57.546 13:42:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:57.546 13:42:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:57.546 13:42:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:57.546 13:42:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:57.546 13:42:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:57.546 13:42:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.546 13:42:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.546 13:42:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.546 13:42:37 -- paths/export.sh@5 -- # export PATH 00:08:57.546 13:42:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.546 13:42:37 -- nvmf/common.sh@46 -- # : 0 00:08:57.546 13:42:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:57.546 13:42:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:57.546 13:42:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:57.546 13:42:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:57.546 13:42:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:57.546 13:42:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:57.546 13:42:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:57.546 13:42:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:57.546 13:42:37 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:57.546 13:42:37 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:57.546 13:42:37 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:57.546 13:42:37 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:57.546 13:42:37 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:57.546 13:42:37 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:57.546 13:42:37 -- target/referrals.sh@37 -- # nvmftestinit 00:08:57.546 13:42:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:57.546 13:42:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:57.546 13:42:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:57.546 13:42:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:57.546 13:42:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:57.546 13:42:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:57.547 13:42:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:57.547 13:42:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.547 13:42:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:57.547 13:42:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:57.547 13:42:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:57.547 13:42:37 -- common/autotest_common.sh@10 -- # set +x 00:08:59.455 13:42:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:59.455 13:42:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:59.455 13:42:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:59.455 13:42:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:59.455 13:42:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:59.455 13:42:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:59.455 13:42:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:59.455 13:42:39 -- nvmf/common.sh@294 -- # net_devs=() 00:08:59.455 13:42:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:59.455 13:42:39 -- nvmf/common.sh@295 -- # e810=() 00:08:59.455 13:42:39 -- nvmf/common.sh@295 -- # local -ga e810 00:08:59.455 13:42:39 -- nvmf/common.sh@296 -- # x722=() 00:08:59.455 13:42:39 -- nvmf/common.sh@296 -- # local -ga x722 00:08:59.455 13:42:39 -- nvmf/common.sh@297 -- # mlx=() 00:08:59.455 13:42:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:59.455 13:42:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:59.455 13:42:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:59.455 13:42:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:59.455 13:42:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.455 13:42:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:59.455 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:59.455 13:42:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.455 13:42:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:59.455 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:59.455 13:42:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.455 13:42:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.455 13:42:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.455 13:42:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:59.455 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:59.455 13:42:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.455 13:42:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.455 13:42:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.455 13:42:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.455 13:42:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:59.455 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:59.455 13:42:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.455 13:42:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:59.455 13:42:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:59.455 13:42:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:59.455 13:42:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:59.455 13:42:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:59.455 13:42:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:59.455 13:42:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:59.455 13:42:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:59.455 13:42:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:59.455 13:42:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:59.455 13:42:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:59.455 13:42:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:59.456 13:42:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:59.456 13:42:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:59.456 13:42:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:59.456 13:42:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:59.715 13:42:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:59.715 13:42:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:59.715 13:42:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:59.715 13:42:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:59.715 13:42:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:59.715 13:42:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:59.715 13:42:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:59.715 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:59.715 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:08:59.715 00:08:59.715 --- 10.0.0.2 ping statistics --- 00:08:59.715 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:59.715 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:08:59.715 13:42:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:59.715 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:59.715 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:08:59.715 00:08:59.715 --- 10.0.0.1 ping statistics --- 00:08:59.715 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:59.715 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:08:59.715 13:42:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:59.715 13:42:39 -- nvmf/common.sh@410 -- # return 0 00:08:59.715 13:42:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:59.715 13:42:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:59.715 13:42:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:59.715 13:42:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:59.715 13:42:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:59.715 13:42:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:59.715 13:42:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:59.715 13:42:39 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:59.715 13:42:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:59.715 13:42:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:59.715 13:42:39 -- common/autotest_common.sh@10 -- # set +x 00:08:59.715 13:42:39 -- nvmf/common.sh@469 -- # nvmfpid=2208275 00:08:59.715 13:42:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:59.715 13:42:39 -- nvmf/common.sh@470 -- # waitforlisten 2208275 00:08:59.715 13:42:39 -- common/autotest_common.sh@829 -- # '[' -z 2208275 ']' 00:08:59.715 13:42:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:59.715 13:42:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:59.715 13:42:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:59.715 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:59.715 13:42:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:59.715 13:42:39 -- common/autotest_common.sh@10 -- # set +x 00:08:59.715 [2024-11-29 13:42:39.927277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:59.715 [2024-11-29 13:42:39.927368] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:59.715 EAL: No free 2048 kB hugepages reported on node 1 00:08:59.973 [2024-11-29 13:42:40.000093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:59.973 [2024-11-29 13:42:40.098603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:59.973 [2024-11-29 13:42:40.098780] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:59.973 [2024-11-29 13:42:40.098807] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:59.973 [2024-11-29 13:42:40.098823] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:59.973 [2024-11-29 13:42:40.098906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:59.973 [2024-11-29 13:42:40.098962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:59.973 [2024-11-29 13:42:40.099014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:59.973 [2024-11-29 13:42:40.099017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:00.911 13:42:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:00.911 13:42:40 -- common/autotest_common.sh@862 -- # return 0 00:09:00.911 13:42:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:00.911 13:42:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:00.911 13:42:40 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 [2024-11-29 13:42:40.934108] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:40 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 [2024-11-29 13:42:40.946328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:40 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:40 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:40 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:40 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:00.911 13:42:40 -- target/referrals.sh@48 -- # jq length 00:09:00.911 13:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:40 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:41 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:00.911 13:42:41 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:00.911 13:42:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:00.911 13:42:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:00.911 13:42:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:00.911 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:41 -- target/referrals.sh@21 -- # sort 00:09:00.911 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:00.911 13:42:41 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:00.911 13:42:41 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:00.911 13:42:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:00.911 13:42:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:00.911 13:42:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:00.911 13:42:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:00.911 13:42:41 -- target/referrals.sh@26 -- # sort 00:09:00.911 13:42:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:00.911 13:42:41 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:00.911 13:42:41 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:00.911 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:00.911 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:00.911 13:42:41 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:00.911 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:00.911 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.171 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.171 13:42:41 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:01.171 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.171 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.171 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.171 13:42:41 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.171 13:42:41 -- target/referrals.sh@56 -- # jq length 00:09:01.171 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.171 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.171 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.171 13:42:41 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:01.171 13:42:41 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:01.171 13:42:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.171 13:42:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.171 13:42:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.171 13:42:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.171 13:42:41 -- target/referrals.sh@26 -- # sort 00:09:01.430 13:42:41 -- target/referrals.sh@26 -- # echo 00:09:01.430 13:42:41 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:01.430 13:42:41 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:01.430 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.430 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.430 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.430 13:42:41 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:01.430 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.430 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.430 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.430 13:42:41 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:01.430 13:42:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:01.430 13:42:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.430 13:42:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:01.430 13:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.430 13:42:41 -- common/autotest_common.sh@10 -- # set +x 00:09:01.430 13:42:41 -- target/referrals.sh@21 -- # sort 00:09:01.430 13:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.430 13:42:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:01.430 13:42:41 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:01.430 13:42:41 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:01.430 13:42:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.430 13:42:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.430 13:42:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.430 13:42:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.430 13:42:41 -- target/referrals.sh@26 -- # sort 00:09:01.430 13:42:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:01.430 13:42:41 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:01.430 13:42:41 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:01.430 13:42:41 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:01.430 13:42:41 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:01.430 13:42:41 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.430 13:42:41 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:01.688 13:42:41 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:01.688 13:42:41 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:01.688 13:42:41 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:01.688 13:42:41 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:01.688 13:42:41 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.688 13:42:41 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:01.947 13:42:42 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:01.947 13:42:42 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:01.947 13:42:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.947 13:42:42 -- common/autotest_common.sh@10 -- # set +x 00:09:01.947 13:42:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.947 13:42:42 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:01.947 13:42:42 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:01.947 13:42:42 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.947 13:42:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.947 13:42:42 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:01.948 13:42:42 -- common/autotest_common.sh@10 -- # set +x 00:09:01.948 13:42:42 -- target/referrals.sh@21 -- # sort 00:09:01.948 13:42:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.948 13:42:42 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:01.948 13:42:42 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:01.948 13:42:42 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:01.948 13:42:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.948 13:42:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.948 13:42:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.948 13:42:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.948 13:42:42 -- target/referrals.sh@26 -- # sort 00:09:02.206 13:42:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:02.206 13:42:42 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:02.206 13:42:42 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:02.206 13:42:42 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:02.206 13:42:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:02.207 13:42:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.207 13:42:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:02.207 13:42:42 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:02.207 13:42:42 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:02.207 13:42:42 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:02.207 13:42:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:02.207 13:42:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.207 13:42:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:02.467 13:42:42 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:02.467 13:42:42 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:02.467 13:42:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 13:42:42 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 13:42:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 13:42:42 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.467 13:42:42 -- target/referrals.sh@82 -- # jq length 00:09:02.467 13:42:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 13:42:42 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 13:42:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 13:42:42 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:02.467 13:42:42 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:02.467 13:42:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.467 13:42:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.467 13:42:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.467 13:42:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.467 13:42:42 -- target/referrals.sh@26 -- # sort 00:09:02.730 13:42:42 -- target/referrals.sh@26 -- # echo 00:09:02.730 13:42:42 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:02.730 13:42:42 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:02.730 13:42:42 -- target/referrals.sh@86 -- # nvmftestfini 00:09:02.730 13:42:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:02.730 13:42:42 -- nvmf/common.sh@116 -- # sync 00:09:02.730 13:42:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:02.730 13:42:42 -- nvmf/common.sh@119 -- # set +e 00:09:02.730 13:42:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:02.730 13:42:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:02.730 rmmod nvme_tcp 00:09:02.730 rmmod nvme_fabrics 00:09:02.730 rmmod nvme_keyring 00:09:02.730 13:42:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:02.730 13:42:42 -- nvmf/common.sh@123 -- # set -e 00:09:02.730 13:42:42 -- nvmf/common.sh@124 -- # return 0 00:09:02.730 13:42:42 -- nvmf/common.sh@477 -- # '[' -n 2208275 ']' 00:09:02.730 13:42:42 -- nvmf/common.sh@478 -- # killprocess 2208275 00:09:02.730 13:42:42 -- common/autotest_common.sh@936 -- # '[' -z 2208275 ']' 00:09:02.730 13:42:42 -- common/autotest_common.sh@940 -- # kill -0 2208275 00:09:02.730 13:42:42 -- common/autotest_common.sh@941 -- # uname 00:09:02.730 13:42:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:02.730 13:42:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2208275 00:09:02.730 13:42:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:02.730 13:42:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:02.730 13:42:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2208275' 00:09:02.730 killing process with pid 2208275 00:09:02.730 13:42:42 -- common/autotest_common.sh@955 -- # kill 2208275 00:09:02.730 13:42:42 -- common/autotest_common.sh@960 -- # wait 2208275 00:09:02.989 13:42:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:02.989 13:42:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:02.989 13:42:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:02.989 13:42:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:02.989 13:42:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:02.989 13:42:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:02.989 13:42:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:02.989 13:42:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.532 13:42:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:05.532 00:09:05.532 real 0m7.726s 00:09:05.532 user 0m13.966s 00:09:05.532 sys 0m2.255s 00:09:05.532 13:42:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:05.532 13:42:45 -- common/autotest_common.sh@10 -- # set +x 00:09:05.532 ************************************ 00:09:05.532 END TEST nvmf_referrals 00:09:05.532 ************************************ 00:09:05.532 13:42:45 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:05.532 13:42:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:05.532 13:42:45 -- common/autotest_common.sh@10 -- # set +x 00:09:05.532 ************************************ 00:09:05.532 START TEST nvmf_connect_disconnect 00:09:05.532 ************************************ 00:09:05.532 13:42:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:05.532 * Looking for test storage... 00:09:05.532 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:05.532 13:42:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:05.532 13:42:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:05.532 13:42:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:05.532 13:42:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:05.532 13:42:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:05.532 13:42:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:05.532 13:42:45 -- scripts/common.sh@335 -- # IFS=.-: 00:09:05.532 13:42:45 -- scripts/common.sh@335 -- # read -ra ver1 00:09:05.532 13:42:45 -- scripts/common.sh@336 -- # IFS=.-: 00:09:05.532 13:42:45 -- scripts/common.sh@336 -- # read -ra ver2 00:09:05.532 13:42:45 -- scripts/common.sh@337 -- # local 'op=<' 00:09:05.532 13:42:45 -- scripts/common.sh@339 -- # ver1_l=2 00:09:05.532 13:42:45 -- scripts/common.sh@340 -- # ver2_l=1 00:09:05.532 13:42:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:05.532 13:42:45 -- scripts/common.sh@343 -- # case "$op" in 00:09:05.532 13:42:45 -- scripts/common.sh@344 -- # : 1 00:09:05.532 13:42:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:05.532 13:42:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:05.532 13:42:45 -- scripts/common.sh@364 -- # decimal 1 00:09:05.532 13:42:45 -- scripts/common.sh@352 -- # local d=1 00:09:05.532 13:42:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:05.532 13:42:45 -- scripts/common.sh@354 -- # echo 1 00:09:05.532 13:42:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:05.532 13:42:45 -- scripts/common.sh@365 -- # decimal 2 00:09:05.532 13:42:45 -- scripts/common.sh@352 -- # local d=2 00:09:05.532 13:42:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:05.532 13:42:45 -- scripts/common.sh@354 -- # echo 2 00:09:05.532 13:42:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:05.532 13:42:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:05.532 13:42:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:05.532 13:42:45 -- scripts/common.sh@367 -- # return 0 00:09:05.532 13:42:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.532 --rc genhtml_branch_coverage=1 00:09:05.532 --rc genhtml_function_coverage=1 00:09:05.532 --rc genhtml_legend=1 00:09:05.532 --rc geninfo_all_blocks=1 00:09:05.532 --rc geninfo_unexecuted_blocks=1 00:09:05.532 00:09:05.532 ' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.532 --rc genhtml_branch_coverage=1 00:09:05.532 --rc genhtml_function_coverage=1 00:09:05.532 --rc genhtml_legend=1 00:09:05.532 --rc geninfo_all_blocks=1 00:09:05.532 --rc geninfo_unexecuted_blocks=1 00:09:05.532 00:09:05.532 ' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.532 --rc genhtml_branch_coverage=1 00:09:05.532 --rc genhtml_function_coverage=1 00:09:05.532 --rc genhtml_legend=1 00:09:05.532 --rc geninfo_all_blocks=1 00:09:05.532 --rc geninfo_unexecuted_blocks=1 00:09:05.532 00:09:05.532 ' 00:09:05.532 13:42:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.532 --rc genhtml_branch_coverage=1 00:09:05.532 --rc genhtml_function_coverage=1 00:09:05.532 --rc genhtml_legend=1 00:09:05.532 --rc geninfo_all_blocks=1 00:09:05.532 --rc geninfo_unexecuted_blocks=1 00:09:05.532 00:09:05.532 ' 00:09:05.532 13:42:45 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:05.532 13:42:45 -- nvmf/common.sh@7 -- # uname -s 00:09:05.532 13:42:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:05.532 13:42:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:05.532 13:42:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:05.532 13:42:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:05.532 13:42:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:05.532 13:42:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:05.532 13:42:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:05.532 13:42:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:05.532 13:42:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:05.532 13:42:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:05.532 13:42:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.532 13:42:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.532 13:42:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:05.532 13:42:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:05.532 13:42:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:05.532 13:42:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:05.532 13:42:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:05.532 13:42:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:05.532 13:42:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:05.532 13:42:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.533 13:42:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.533 13:42:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.533 13:42:45 -- paths/export.sh@5 -- # export PATH 00:09:05.533 13:42:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.533 13:42:45 -- nvmf/common.sh@46 -- # : 0 00:09:05.533 13:42:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:05.533 13:42:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:05.533 13:42:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:05.533 13:42:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:05.533 13:42:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:05.533 13:42:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:05.533 13:42:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:05.533 13:42:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:05.533 13:42:45 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:05.533 13:42:45 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:05.533 13:42:45 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:05.533 13:42:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:05.533 13:42:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:05.533 13:42:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:05.533 13:42:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:05.533 13:42:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:05.533 13:42:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:05.533 13:42:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:05.533 13:42:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.533 13:42:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:05.533 13:42:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:05.533 13:42:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:05.533 13:42:45 -- common/autotest_common.sh@10 -- # set +x 00:09:07.437 13:42:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:07.437 13:42:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:07.437 13:42:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:07.437 13:42:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:07.437 13:42:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:07.437 13:42:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:07.437 13:42:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:07.437 13:42:47 -- nvmf/common.sh@294 -- # net_devs=() 00:09:07.437 13:42:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:07.437 13:42:47 -- nvmf/common.sh@295 -- # e810=() 00:09:07.437 13:42:47 -- nvmf/common.sh@295 -- # local -ga e810 00:09:07.437 13:42:47 -- nvmf/common.sh@296 -- # x722=() 00:09:07.437 13:42:47 -- nvmf/common.sh@296 -- # local -ga x722 00:09:07.437 13:42:47 -- nvmf/common.sh@297 -- # mlx=() 00:09:07.437 13:42:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:07.437 13:42:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:07.437 13:42:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:07.437 13:42:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:07.437 13:42:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:07.437 13:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.437 13:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:07.437 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:07.437 13:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.437 13:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:07.437 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:07.437 13:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:07.437 13:42:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:07.437 13:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.437 13:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.437 13:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.437 13:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.437 13:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:07.437 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:07.437 13:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.437 13:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.437 13:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.438 13:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.438 13:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.438 13:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:07.438 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:07.438 13:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.438 13:42:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:07.438 13:42:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:07.438 13:42:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:07.438 13:42:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:07.438 13:42:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:07.438 13:42:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:07.438 13:42:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:07.438 13:42:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:07.438 13:42:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:07.438 13:42:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:07.438 13:42:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:07.438 13:42:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:07.438 13:42:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:07.438 13:42:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:07.438 13:42:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:07.438 13:42:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:07.438 13:42:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:07.438 13:42:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:07.438 13:42:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:07.438 13:42:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:07.438 13:42:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:07.438 13:42:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:07.438 13:42:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:07.438 13:42:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:07.438 13:42:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:07.438 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:07.438 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:09:07.438 00:09:07.438 --- 10.0.0.2 ping statistics --- 00:09:07.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.438 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:09:07.438 13:42:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:07.438 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:07.438 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:09:07.438 00:09:07.438 --- 10.0.0.1 ping statistics --- 00:09:07.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.438 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:09:07.438 13:42:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:07.438 13:42:47 -- nvmf/common.sh@410 -- # return 0 00:09:07.438 13:42:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:07.438 13:42:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:07.438 13:42:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:07.438 13:42:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:07.438 13:42:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:07.438 13:42:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:07.438 13:42:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:07.438 13:42:47 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:07.438 13:42:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:07.438 13:42:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:07.438 13:42:47 -- common/autotest_common.sh@10 -- # set +x 00:09:07.438 13:42:47 -- nvmf/common.sh@469 -- # nvmfpid=2210727 00:09:07.438 13:42:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:07.438 13:42:47 -- nvmf/common.sh@470 -- # waitforlisten 2210727 00:09:07.438 13:42:47 -- common/autotest_common.sh@829 -- # '[' -z 2210727 ']' 00:09:07.438 13:42:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:07.438 13:42:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:07.438 13:42:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:07.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:07.438 13:42:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:07.438 13:42:47 -- common/autotest_common.sh@10 -- # set +x 00:09:07.438 [2024-11-29 13:42:47.616898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:07.438 [2024-11-29 13:42:47.616990] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:07.438 EAL: No free 2048 kB hugepages reported on node 1 00:09:07.438 [2024-11-29 13:42:47.687822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:07.695 [2024-11-29 13:42:47.780186] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:07.695 [2024-11-29 13:42:47.780368] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:07.695 [2024-11-29 13:42:47.780389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:07.695 [2024-11-29 13:42:47.780412] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:07.695 [2024-11-29 13:42:47.780483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:07.695 [2024-11-29 13:42:47.780540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:07.695 [2024-11-29 13:42:47.780596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:07.695 [2024-11-29 13:42:47.780599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:08.631 13:42:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:08.631 13:42:48 -- common/autotest_common.sh@862 -- # return 0 00:09:08.631 13:42:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:08.631 13:42:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 13:42:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:08.631 13:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 [2024-11-29 13:42:48.646189] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:08.631 13:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:08.631 13:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 13:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:08.631 13:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 13:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:08.631 13:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 13:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:08.631 13:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.631 13:42:48 -- common/autotest_common.sh@10 -- # set +x 00:09:08.631 [2024-11-29 13:42:48.707719] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:08.631 13:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:08.631 13:42:48 -- target/connect_disconnect.sh@34 -- # set +x 00:09:11.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.773 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.288 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.190 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.666 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.656 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.194 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.102 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.810 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.238 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.760 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.610 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.147 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.101 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.004 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.537 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.070 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.976 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.050 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.124 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.574 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.443 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.422 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.392 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.931 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.898 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.977 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.408 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.298 13:46:40 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:00.298 13:46:40 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:00.298 13:46:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:00.298 13:46:40 -- nvmf/common.sh@116 -- # sync 00:13:00.298 13:46:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:00.298 13:46:40 -- nvmf/common.sh@119 -- # set +e 00:13:00.298 13:46:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:00.298 13:46:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:00.298 rmmod nvme_tcp 00:13:00.298 rmmod nvme_fabrics 00:13:00.298 rmmod nvme_keyring 00:13:00.298 13:46:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:00.298 13:46:40 -- nvmf/common.sh@123 -- # set -e 00:13:00.298 13:46:40 -- nvmf/common.sh@124 -- # return 0 00:13:00.298 13:46:40 -- nvmf/common.sh@477 -- # '[' -n 2210727 ']' 00:13:00.298 13:46:40 -- nvmf/common.sh@478 -- # killprocess 2210727 00:13:00.298 13:46:40 -- common/autotest_common.sh@936 -- # '[' -z 2210727 ']' 00:13:00.298 13:46:40 -- common/autotest_common.sh@940 -- # kill -0 2210727 00:13:00.298 13:46:40 -- common/autotest_common.sh@941 -- # uname 00:13:00.298 13:46:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:00.298 13:46:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2210727 00:13:00.298 13:46:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:00.298 13:46:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:00.298 13:46:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2210727' 00:13:00.298 killing process with pid 2210727 00:13:00.298 13:46:40 -- common/autotest_common.sh@955 -- # kill 2210727 00:13:00.298 13:46:40 -- common/autotest_common.sh@960 -- # wait 2210727 00:13:00.557 13:46:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:00.557 13:46:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:00.557 13:46:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:00.557 13:46:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:00.557 13:46:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:00.557 13:46:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:00.557 13:46:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:00.557 13:46:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:02.461 13:46:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:02.461 00:13:02.461 real 3m57.489s 00:13:02.461 user 15m6.181s 00:13:02.461 sys 0m34.365s 00:13:02.461 13:46:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:02.461 13:46:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.461 ************************************ 00:13:02.461 END TEST nvmf_connect_disconnect 00:13:02.461 ************************************ 00:13:02.719 13:46:42 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:02.719 13:46:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:02.719 13:46:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:02.719 13:46:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.719 ************************************ 00:13:02.719 START TEST nvmf_multitarget 00:13:02.719 ************************************ 00:13:02.719 13:46:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:02.719 * Looking for test storage... 00:13:02.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:02.719 13:46:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:02.719 13:46:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:02.719 13:46:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:02.719 13:46:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:02.719 13:46:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:02.719 13:46:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:02.719 13:46:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:02.719 13:46:42 -- scripts/common.sh@335 -- # IFS=.-: 00:13:02.719 13:46:42 -- scripts/common.sh@335 -- # read -ra ver1 00:13:02.719 13:46:42 -- scripts/common.sh@336 -- # IFS=.-: 00:13:02.719 13:46:42 -- scripts/common.sh@336 -- # read -ra ver2 00:13:02.719 13:46:42 -- scripts/common.sh@337 -- # local 'op=<' 00:13:02.719 13:46:42 -- scripts/common.sh@339 -- # ver1_l=2 00:13:02.719 13:46:42 -- scripts/common.sh@340 -- # ver2_l=1 00:13:02.719 13:46:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:02.719 13:46:42 -- scripts/common.sh@343 -- # case "$op" in 00:13:02.719 13:46:42 -- scripts/common.sh@344 -- # : 1 00:13:02.719 13:46:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:02.719 13:46:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:02.719 13:46:42 -- scripts/common.sh@364 -- # decimal 1 00:13:02.719 13:46:42 -- scripts/common.sh@352 -- # local d=1 00:13:02.719 13:46:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:02.719 13:46:42 -- scripts/common.sh@354 -- # echo 1 00:13:02.719 13:46:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:02.719 13:46:42 -- scripts/common.sh@365 -- # decimal 2 00:13:02.719 13:46:42 -- scripts/common.sh@352 -- # local d=2 00:13:02.719 13:46:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:02.719 13:46:42 -- scripts/common.sh@354 -- # echo 2 00:13:02.719 13:46:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:02.719 13:46:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:02.719 13:46:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:02.719 13:46:42 -- scripts/common.sh@367 -- # return 0 00:13:02.719 13:46:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:02.719 13:46:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:02.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.720 --rc genhtml_branch_coverage=1 00:13:02.720 --rc genhtml_function_coverage=1 00:13:02.720 --rc genhtml_legend=1 00:13:02.720 --rc geninfo_all_blocks=1 00:13:02.720 --rc geninfo_unexecuted_blocks=1 00:13:02.720 00:13:02.720 ' 00:13:02.720 13:46:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:02.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.720 --rc genhtml_branch_coverage=1 00:13:02.720 --rc genhtml_function_coverage=1 00:13:02.720 --rc genhtml_legend=1 00:13:02.720 --rc geninfo_all_blocks=1 00:13:02.720 --rc geninfo_unexecuted_blocks=1 00:13:02.720 00:13:02.720 ' 00:13:02.720 13:46:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:02.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.720 --rc genhtml_branch_coverage=1 00:13:02.720 --rc genhtml_function_coverage=1 00:13:02.720 --rc genhtml_legend=1 00:13:02.720 --rc geninfo_all_blocks=1 00:13:02.720 --rc geninfo_unexecuted_blocks=1 00:13:02.720 00:13:02.720 ' 00:13:02.720 13:46:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:02.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:02.720 --rc genhtml_branch_coverage=1 00:13:02.720 --rc genhtml_function_coverage=1 00:13:02.720 --rc genhtml_legend=1 00:13:02.720 --rc geninfo_all_blocks=1 00:13:02.720 --rc geninfo_unexecuted_blocks=1 00:13:02.720 00:13:02.720 ' 00:13:02.720 13:46:42 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:02.720 13:46:42 -- nvmf/common.sh@7 -- # uname -s 00:13:02.720 13:46:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:02.720 13:46:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:02.720 13:46:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:02.720 13:46:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:02.720 13:46:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:02.720 13:46:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:02.720 13:46:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:02.720 13:46:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:02.720 13:46:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:02.720 13:46:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:02.720 13:46:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:02.720 13:46:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:02.720 13:46:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:02.720 13:46:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:02.720 13:46:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:02.720 13:46:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:02.720 13:46:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:02.720 13:46:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:02.720 13:46:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:02.720 13:46:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.720 13:46:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.720 13:46:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.720 13:46:42 -- paths/export.sh@5 -- # export PATH 00:13:02.720 13:46:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:02.720 13:46:42 -- nvmf/common.sh@46 -- # : 0 00:13:02.720 13:46:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:02.720 13:46:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:02.720 13:46:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:02.720 13:46:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:02.720 13:46:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:02.720 13:46:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:02.720 13:46:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:02.720 13:46:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:02.720 13:46:42 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:02.720 13:46:42 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:02.720 13:46:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:02.720 13:46:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:02.720 13:46:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:02.720 13:46:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:02.720 13:46:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:02.720 13:46:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:02.720 13:46:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:02.720 13:46:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:02.720 13:46:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:02.720 13:46:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:02.720 13:46:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:02.720 13:46:42 -- common/autotest_common.sh@10 -- # set +x 00:13:05.251 13:46:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:05.251 13:46:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:05.251 13:46:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:05.251 13:46:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:05.251 13:46:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:05.251 13:46:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:05.251 13:46:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:05.251 13:46:44 -- nvmf/common.sh@294 -- # net_devs=() 00:13:05.251 13:46:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:05.251 13:46:44 -- nvmf/common.sh@295 -- # e810=() 00:13:05.251 13:46:44 -- nvmf/common.sh@295 -- # local -ga e810 00:13:05.251 13:46:44 -- nvmf/common.sh@296 -- # x722=() 00:13:05.251 13:46:44 -- nvmf/common.sh@296 -- # local -ga x722 00:13:05.251 13:46:44 -- nvmf/common.sh@297 -- # mlx=() 00:13:05.251 13:46:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:05.251 13:46:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:05.251 13:46:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:05.251 13:46:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:05.251 13:46:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.251 13:46:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:05.251 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:05.251 13:46:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.251 13:46:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:05.251 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:05.251 13:46:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.251 13:46:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.251 13:46:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.251 13:46:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:05.251 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:05.251 13:46:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.251 13:46:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.251 13:46:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.251 13:46:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.251 13:46:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:05.251 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:05.251 13:46:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.251 13:46:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:05.251 13:46:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:05.251 13:46:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:05.251 13:46:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:05.251 13:46:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:05.251 13:46:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:05.251 13:46:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:05.251 13:46:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:05.251 13:46:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:05.251 13:46:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:05.251 13:46:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:05.251 13:46:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:05.251 13:46:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:05.251 13:46:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:05.251 13:46:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:05.251 13:46:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:05.251 13:46:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:05.251 13:46:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:05.251 13:46:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:05.251 13:46:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:05.251 13:46:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:05.251 13:46:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:05.251 13:46:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:05.251 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:05.251 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.381 ms 00:13:05.251 00:13:05.251 --- 10.0.0.2 ping statistics --- 00:13:05.251 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.251 rtt min/avg/max/mdev = 0.381/0.381/0.381/0.000 ms 00:13:05.251 13:46:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:05.251 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:05.251 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:13:05.251 00:13:05.251 --- 10.0.0.1 ping statistics --- 00:13:05.251 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.251 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:13:05.251 13:46:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:05.251 13:46:45 -- nvmf/common.sh@410 -- # return 0 00:13:05.251 13:46:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:05.251 13:46:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:05.251 13:46:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:05.251 13:46:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:05.251 13:46:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:05.251 13:46:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:05.251 13:46:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:05.251 13:46:45 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:05.251 13:46:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:05.251 13:46:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:05.251 13:46:45 -- common/autotest_common.sh@10 -- # set +x 00:13:05.251 13:46:45 -- nvmf/common.sh@469 -- # nvmfpid=2242768 00:13:05.252 13:46:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:05.252 13:46:45 -- nvmf/common.sh@470 -- # waitforlisten 2242768 00:13:05.252 13:46:45 -- common/autotest_common.sh@829 -- # '[' -z 2242768 ']' 00:13:05.252 13:46:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:05.252 13:46:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:05.252 13:46:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:05.252 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:05.252 13:46:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:05.252 13:46:45 -- common/autotest_common.sh@10 -- # set +x 00:13:05.252 [2024-11-29 13:46:45.174608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:05.252 [2024-11-29 13:46:45.174682] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:05.252 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.252 [2024-11-29 13:46:45.245717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:05.252 [2024-11-29 13:46:45.334172] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:05.252 [2024-11-29 13:46:45.334327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:05.252 [2024-11-29 13:46:45.334353] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:05.252 [2024-11-29 13:46:45.334365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:05.252 [2024-11-29 13:46:45.334458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:05.252 [2024-11-29 13:46:45.334539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:05.252 [2024-11-29 13:46:45.334600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:05.252 [2024-11-29 13:46:45.334602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:06.187 13:46:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:06.187 13:46:46 -- common/autotest_common.sh@862 -- # return 0 00:13:06.187 13:46:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:06.187 13:46:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:06.187 13:46:46 -- common/autotest_common.sh@10 -- # set +x 00:13:06.187 13:46:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:06.187 13:46:46 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:06.187 13:46:46 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:06.187 13:46:46 -- target/multitarget.sh@21 -- # jq length 00:13:06.187 13:46:46 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:06.187 13:46:46 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:06.187 "nvmf_tgt_1" 00:13:06.445 13:46:46 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:06.445 "nvmf_tgt_2" 00:13:06.445 13:46:46 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:06.445 13:46:46 -- target/multitarget.sh@28 -- # jq length 00:13:06.445 13:46:46 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:06.445 13:46:46 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:06.703 true 00:13:06.703 13:46:46 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:06.703 true 00:13:06.703 13:46:46 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:06.703 13:46:46 -- target/multitarget.sh@35 -- # jq length 00:13:06.961 13:46:47 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:06.961 13:46:47 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:06.961 13:46:47 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:06.961 13:46:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:06.961 13:46:47 -- nvmf/common.sh@116 -- # sync 00:13:06.961 13:46:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:06.961 13:46:47 -- nvmf/common.sh@119 -- # set +e 00:13:06.961 13:46:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:06.961 13:46:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:06.961 rmmod nvme_tcp 00:13:06.961 rmmod nvme_fabrics 00:13:06.961 rmmod nvme_keyring 00:13:06.961 13:46:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:06.961 13:46:47 -- nvmf/common.sh@123 -- # set -e 00:13:06.961 13:46:47 -- nvmf/common.sh@124 -- # return 0 00:13:06.961 13:46:47 -- nvmf/common.sh@477 -- # '[' -n 2242768 ']' 00:13:06.961 13:46:47 -- nvmf/common.sh@478 -- # killprocess 2242768 00:13:06.961 13:46:47 -- common/autotest_common.sh@936 -- # '[' -z 2242768 ']' 00:13:06.961 13:46:47 -- common/autotest_common.sh@940 -- # kill -0 2242768 00:13:06.961 13:46:47 -- common/autotest_common.sh@941 -- # uname 00:13:06.961 13:46:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:06.961 13:46:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2242768 00:13:06.961 13:46:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:06.961 13:46:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:06.961 13:46:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2242768' 00:13:06.961 killing process with pid 2242768 00:13:06.961 13:46:47 -- common/autotest_common.sh@955 -- # kill 2242768 00:13:06.961 13:46:47 -- common/autotest_common.sh@960 -- # wait 2242768 00:13:07.220 13:46:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:07.220 13:46:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:07.220 13:46:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:07.220 13:46:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:07.220 13:46:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:07.220 13:46:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.220 13:46:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.220 13:46:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.124 13:46:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.124 00:13:09.124 real 0m6.625s 00:13:09.124 user 0m9.810s 00:13:09.124 sys 0m2.015s 00:13:09.124 13:46:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.124 13:46:49 -- common/autotest_common.sh@10 -- # set +x 00:13:09.124 ************************************ 00:13:09.124 END TEST nvmf_multitarget 00:13:09.124 ************************************ 00:13:09.383 13:46:49 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:09.383 13:46:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.383 13:46:49 -- common/autotest_common.sh@10 -- # set +x 00:13:09.383 ************************************ 00:13:09.383 START TEST nvmf_rpc 00:13:09.383 ************************************ 00:13:09.383 13:46:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:09.383 * Looking for test storage... 00:13:09.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.383 13:46:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:09.383 13:46:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:09.383 13:46:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:09.383 13:46:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:09.383 13:46:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:09.383 13:46:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:09.383 13:46:49 -- scripts/common.sh@335 -- # IFS=.-: 00:13:09.383 13:46:49 -- scripts/common.sh@335 -- # read -ra ver1 00:13:09.383 13:46:49 -- scripts/common.sh@336 -- # IFS=.-: 00:13:09.383 13:46:49 -- scripts/common.sh@336 -- # read -ra ver2 00:13:09.383 13:46:49 -- scripts/common.sh@337 -- # local 'op=<' 00:13:09.383 13:46:49 -- scripts/common.sh@339 -- # ver1_l=2 00:13:09.383 13:46:49 -- scripts/common.sh@340 -- # ver2_l=1 00:13:09.383 13:46:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:09.383 13:46:49 -- scripts/common.sh@343 -- # case "$op" in 00:13:09.383 13:46:49 -- scripts/common.sh@344 -- # : 1 00:13:09.383 13:46:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:09.383 13:46:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:09.383 13:46:49 -- scripts/common.sh@364 -- # decimal 1 00:13:09.383 13:46:49 -- scripts/common.sh@352 -- # local d=1 00:13:09.383 13:46:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:09.383 13:46:49 -- scripts/common.sh@354 -- # echo 1 00:13:09.383 13:46:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:09.383 13:46:49 -- scripts/common.sh@365 -- # decimal 2 00:13:09.383 13:46:49 -- scripts/common.sh@352 -- # local d=2 00:13:09.383 13:46:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:09.383 13:46:49 -- scripts/common.sh@354 -- # echo 2 00:13:09.383 13:46:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:09.383 13:46:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:09.383 13:46:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:09.383 13:46:49 -- scripts/common.sh@367 -- # return 0 00:13:09.383 13:46:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:09.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.383 --rc genhtml_branch_coverage=1 00:13:09.383 --rc genhtml_function_coverage=1 00:13:09.383 --rc genhtml_legend=1 00:13:09.383 --rc geninfo_all_blocks=1 00:13:09.383 --rc geninfo_unexecuted_blocks=1 00:13:09.383 00:13:09.383 ' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:09.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.383 --rc genhtml_branch_coverage=1 00:13:09.383 --rc genhtml_function_coverage=1 00:13:09.383 --rc genhtml_legend=1 00:13:09.383 --rc geninfo_all_blocks=1 00:13:09.383 --rc geninfo_unexecuted_blocks=1 00:13:09.383 00:13:09.383 ' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:09.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.383 --rc genhtml_branch_coverage=1 00:13:09.383 --rc genhtml_function_coverage=1 00:13:09.383 --rc genhtml_legend=1 00:13:09.383 --rc geninfo_all_blocks=1 00:13:09.383 --rc geninfo_unexecuted_blocks=1 00:13:09.383 00:13:09.383 ' 00:13:09.383 13:46:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:09.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.383 --rc genhtml_branch_coverage=1 00:13:09.383 --rc genhtml_function_coverage=1 00:13:09.383 --rc genhtml_legend=1 00:13:09.383 --rc geninfo_all_blocks=1 00:13:09.383 --rc geninfo_unexecuted_blocks=1 00:13:09.383 00:13:09.383 ' 00:13:09.383 13:46:49 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:09.383 13:46:49 -- nvmf/common.sh@7 -- # uname -s 00:13:09.383 13:46:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:09.383 13:46:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:09.383 13:46:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:09.383 13:46:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:09.383 13:46:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:09.383 13:46:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:09.383 13:46:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:09.383 13:46:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:09.383 13:46:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:09.383 13:46:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:09.383 13:46:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.383 13:46:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.383 13:46:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:09.383 13:46:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:09.383 13:46:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:09.383 13:46:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:09.383 13:46:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:09.383 13:46:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:09.383 13:46:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:09.383 13:46:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.383 13:46:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.383 13:46:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.383 13:46:49 -- paths/export.sh@5 -- # export PATH 00:13:09.383 13:46:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.383 13:46:49 -- nvmf/common.sh@46 -- # : 0 00:13:09.384 13:46:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:09.384 13:46:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:09.384 13:46:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:09.384 13:46:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:09.384 13:46:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:09.384 13:46:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:09.384 13:46:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:09.384 13:46:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:09.384 13:46:49 -- target/rpc.sh@11 -- # loops=5 00:13:09.384 13:46:49 -- target/rpc.sh@23 -- # nvmftestinit 00:13:09.384 13:46:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:09.384 13:46:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:09.384 13:46:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:09.384 13:46:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:09.384 13:46:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:09.384 13:46:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.384 13:46:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.384 13:46:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.384 13:46:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:09.384 13:46:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:09.384 13:46:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:09.384 13:46:49 -- common/autotest_common.sh@10 -- # set +x 00:13:12.010 13:46:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:12.010 13:46:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:12.010 13:46:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:12.010 13:46:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:12.010 13:46:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:12.010 13:46:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:12.010 13:46:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:12.010 13:46:51 -- nvmf/common.sh@294 -- # net_devs=() 00:13:12.010 13:46:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:12.010 13:46:51 -- nvmf/common.sh@295 -- # e810=() 00:13:12.010 13:46:51 -- nvmf/common.sh@295 -- # local -ga e810 00:13:12.010 13:46:51 -- nvmf/common.sh@296 -- # x722=() 00:13:12.010 13:46:51 -- nvmf/common.sh@296 -- # local -ga x722 00:13:12.010 13:46:51 -- nvmf/common.sh@297 -- # mlx=() 00:13:12.010 13:46:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:12.010 13:46:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:12.010 13:46:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.010 13:46:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:12.010 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:12.010 13:46:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.010 13:46:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:12.010 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:12.010 13:46:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.010 13:46:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.010 13:46:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.010 13:46:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:12.010 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:12.010 13:46:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.010 13:46:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.010 13:46:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.010 13:46:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:12.010 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:12.010 13:46:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:12.010 13:46:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:12.010 13:46:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:12.010 13:46:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:12.010 13:46:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:12.010 13:46:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:12.010 13:46:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:12.010 13:46:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:12.010 13:46:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:12.010 13:46:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:12.010 13:46:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:12.010 13:46:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:12.010 13:46:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:12.010 13:46:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:12.010 13:46:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:12.010 13:46:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:12.010 13:46:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:12.010 13:46:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:12.010 13:46:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:12.010 13:46:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:12.010 13:46:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:12.010 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:12.010 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.390 ms 00:13:12.010 00:13:12.010 --- 10.0.0.2 ping statistics --- 00:13:12.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.010 rtt min/avg/max/mdev = 0.390/0.390/0.390/0.000 ms 00:13:12.010 13:46:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:12.010 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:12.010 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:13:12.010 00:13:12.010 --- 10.0.0.1 ping statistics --- 00:13:12.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.010 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:13:12.010 13:46:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:12.010 13:46:51 -- nvmf/common.sh@410 -- # return 0 00:13:12.010 13:46:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:12.010 13:46:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:12.010 13:46:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:12.010 13:46:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:12.010 13:46:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:12.010 13:46:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:12.010 13:46:51 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:12.010 13:46:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:12.010 13:46:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:12.010 13:46:51 -- common/autotest_common.sh@10 -- # set +x 00:13:12.010 13:46:51 -- nvmf/common.sh@469 -- # nvmfpid=2245028 00:13:12.010 13:46:51 -- nvmf/common.sh@470 -- # waitforlisten 2245028 00:13:12.010 13:46:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:12.010 13:46:51 -- common/autotest_common.sh@829 -- # '[' -z 2245028 ']' 00:13:12.010 13:46:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:12.010 13:46:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:12.010 13:46:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:12.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:12.010 13:46:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:12.010 13:46:51 -- common/autotest_common.sh@10 -- # set +x 00:13:12.010 [2024-11-29 13:46:51.930590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:12.010 [2024-11-29 13:46:51.930688] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:12.010 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.010 [2024-11-29 13:46:52.012014] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:12.010 [2024-11-29 13:46:52.108275] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.010 [2024-11-29 13:46:52.108455] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.010 [2024-11-29 13:46:52.108476] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.010 [2024-11-29 13:46:52.108490] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.010 [2024-11-29 13:46:52.108548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.010 [2024-11-29 13:46:52.108607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:12.010 [2024-11-29 13:46:52.108663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:12.011 [2024-11-29 13:46:52.108667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:12.947 13:46:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:12.947 13:46:52 -- common/autotest_common.sh@862 -- # return 0 00:13:12.947 13:46:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:12.947 13:46:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:12.947 13:46:52 -- common/autotest_common.sh@10 -- # set +x 00:13:12.947 13:46:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:12.947 13:46:52 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:12.947 13:46:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.947 13:46:52 -- common/autotest_common.sh@10 -- # set +x 00:13:12.947 13:46:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.947 13:46:52 -- target/rpc.sh@26 -- # stats='{ 00:13:12.947 "tick_rate": 2700000000, 00:13:12.947 "poll_groups": [ 00:13:12.947 { 00:13:12.947 "name": "nvmf_tgt_poll_group_0", 00:13:12.947 "admin_qpairs": 0, 00:13:12.947 "io_qpairs": 0, 00:13:12.947 "current_admin_qpairs": 0, 00:13:12.947 "current_io_qpairs": 0, 00:13:12.947 "pending_bdev_io": 0, 00:13:12.947 "completed_nvme_io": 0, 00:13:12.947 "transports": [] 00:13:12.947 }, 00:13:12.947 { 00:13:12.947 "name": "nvmf_tgt_poll_group_1", 00:13:12.947 "admin_qpairs": 0, 00:13:12.947 "io_qpairs": 0, 00:13:12.947 "current_admin_qpairs": 0, 00:13:12.947 "current_io_qpairs": 0, 00:13:12.947 "pending_bdev_io": 0, 00:13:12.947 "completed_nvme_io": 0, 00:13:12.947 "transports": [] 00:13:12.947 }, 00:13:12.947 { 00:13:12.947 "name": "nvmf_tgt_poll_group_2", 00:13:12.947 "admin_qpairs": 0, 00:13:12.947 "io_qpairs": 0, 00:13:12.947 "current_admin_qpairs": 0, 00:13:12.947 "current_io_qpairs": 0, 00:13:12.947 "pending_bdev_io": 0, 00:13:12.947 "completed_nvme_io": 0, 00:13:12.947 "transports": [] 00:13:12.947 }, 00:13:12.947 { 00:13:12.947 "name": "nvmf_tgt_poll_group_3", 00:13:12.947 "admin_qpairs": 0, 00:13:12.948 "io_qpairs": 0, 00:13:12.948 "current_admin_qpairs": 0, 00:13:12.948 "current_io_qpairs": 0, 00:13:12.948 "pending_bdev_io": 0, 00:13:12.948 "completed_nvme_io": 0, 00:13:12.948 "transports": [] 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 }' 00:13:12.948 13:46:52 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:12.948 13:46:52 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:12.948 13:46:52 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:12.948 13:46:52 -- target/rpc.sh@15 -- # wc -l 00:13:12.948 13:46:53 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:12.948 13:46:53 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:12.948 13:46:53 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:12.948 13:46:53 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 [2024-11-29 13:46:53.065598] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@33 -- # stats='{ 00:13:12.948 "tick_rate": 2700000000, 00:13:12.948 "poll_groups": [ 00:13:12.948 { 00:13:12.948 "name": "nvmf_tgt_poll_group_0", 00:13:12.948 "admin_qpairs": 0, 00:13:12.948 "io_qpairs": 0, 00:13:12.948 "current_admin_qpairs": 0, 00:13:12.948 "current_io_qpairs": 0, 00:13:12.948 "pending_bdev_io": 0, 00:13:12.948 "completed_nvme_io": 0, 00:13:12.948 "transports": [ 00:13:12.948 { 00:13:12.948 "trtype": "TCP" 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 }, 00:13:12.948 { 00:13:12.948 "name": "nvmf_tgt_poll_group_1", 00:13:12.948 "admin_qpairs": 0, 00:13:12.948 "io_qpairs": 0, 00:13:12.948 "current_admin_qpairs": 0, 00:13:12.948 "current_io_qpairs": 0, 00:13:12.948 "pending_bdev_io": 0, 00:13:12.948 "completed_nvme_io": 0, 00:13:12.948 "transports": [ 00:13:12.948 { 00:13:12.948 "trtype": "TCP" 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 }, 00:13:12.948 { 00:13:12.948 "name": "nvmf_tgt_poll_group_2", 00:13:12.948 "admin_qpairs": 0, 00:13:12.948 "io_qpairs": 0, 00:13:12.948 "current_admin_qpairs": 0, 00:13:12.948 "current_io_qpairs": 0, 00:13:12.948 "pending_bdev_io": 0, 00:13:12.948 "completed_nvme_io": 0, 00:13:12.948 "transports": [ 00:13:12.948 { 00:13:12.948 "trtype": "TCP" 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 }, 00:13:12.948 { 00:13:12.948 "name": "nvmf_tgt_poll_group_3", 00:13:12.948 "admin_qpairs": 0, 00:13:12.948 "io_qpairs": 0, 00:13:12.948 "current_admin_qpairs": 0, 00:13:12.948 "current_io_qpairs": 0, 00:13:12.948 "pending_bdev_io": 0, 00:13:12.948 "completed_nvme_io": 0, 00:13:12.948 "transports": [ 00:13:12.948 { 00:13:12.948 "trtype": "TCP" 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 } 00:13:12.948 ] 00:13:12.948 }' 00:13:12.948 13:46:53 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:12.948 13:46:53 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:12.948 13:46:53 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:12.948 13:46:53 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:12.948 13:46:53 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:12.948 13:46:53 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:12.948 13:46:53 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:12.948 13:46:53 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:12.948 13:46:53 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 Malloc1 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:12.948 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.948 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:12.948 [2024-11-29 13:46:53.217978] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:12.948 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.948 13:46:53 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:12.948 13:46:53 -- common/autotest_common.sh@650 -- # local es=0 00:13:12.948 13:46:53 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:12.948 13:46:53 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:12.948 13:46:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.948 13:46:53 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:12.948 13:46:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.948 13:46:53 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:12.948 13:46:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.948 13:46:53 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:12.948 13:46:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:12.948 13:46:53 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:13.207 [2024-11-29 13:46:53.240523] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:13.207 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:13.207 could not add new controller: failed to write to nvme-fabrics device 00:13:13.207 13:46:53 -- common/autotest_common.sh@653 -- # es=1 00:13:13.207 13:46:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:13.207 13:46:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:13.207 13:46:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:13.207 13:46:53 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:13.207 13:46:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.207 13:46:53 -- common/autotest_common.sh@10 -- # set +x 00:13:13.207 13:46:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.207 13:46:53 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:13.775 13:46:53 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:13.775 13:46:53 -- common/autotest_common.sh@1187 -- # local i=0 00:13:13.775 13:46:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:13.775 13:46:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:13.775 13:46:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:16.306 13:46:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:16.306 13:46:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:16.306 13:46:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.306 13:46:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:16.306 13:46:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.306 13:46:55 -- common/autotest_common.sh@1197 -- # return 0 00:13:16.306 13:46:55 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:16.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.306 13:46:56 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:16.306 13:46:56 -- common/autotest_common.sh@1208 -- # local i=0 00:13:16.306 13:46:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:16.306 13:46:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.306 13:46:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:16.306 13:46:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.306 13:46:56 -- common/autotest_common.sh@1220 -- # return 0 00:13:16.306 13:46:56 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.306 13:46:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.306 13:46:56 -- common/autotest_common.sh@10 -- # set +x 00:13:16.306 13:46:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.306 13:46:56 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.306 13:46:56 -- common/autotest_common.sh@650 -- # local es=0 00:13:16.306 13:46:56 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.306 13:46:56 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:16.306 13:46:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.306 13:46:56 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:16.306 13:46:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.306 13:46:56 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:16.306 13:46:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.306 13:46:56 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:16.306 13:46:56 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:16.306 13:46:56 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.306 [2024-11-29 13:46:56.077082] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:16.306 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:16.306 could not add new controller: failed to write to nvme-fabrics device 00:13:16.306 13:46:56 -- common/autotest_common.sh@653 -- # es=1 00:13:16.306 13:46:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:16.306 13:46:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:16.306 13:46:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:16.306 13:46:56 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:16.306 13:46:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.306 13:46:56 -- common/autotest_common.sh@10 -- # set +x 00:13:16.306 13:46:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.306 13:46:56 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.566 13:46:56 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:16.566 13:46:56 -- common/autotest_common.sh@1187 -- # local i=0 00:13:16.566 13:46:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:16.566 13:46:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:16.566 13:46:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:19.105 13:46:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:19.105 13:46:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:19.105 13:46:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:19.105 13:46:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:19.105 13:46:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:19.105 13:46:58 -- common/autotest_common.sh@1197 -- # return 0 00:13:19.105 13:46:58 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:19.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.105 13:46:58 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:19.105 13:46:58 -- common/autotest_common.sh@1208 -- # local i=0 00:13:19.105 13:46:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:19.105 13:46:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.105 13:46:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:19.105 13:46:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.105 13:46:58 -- common/autotest_common.sh@1220 -- # return 0 00:13:19.105 13:46:58 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:19.105 13:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.105 13:46:58 -- common/autotest_common.sh@10 -- # set +x 00:13:19.105 13:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.105 13:46:58 -- target/rpc.sh@81 -- # seq 1 5 00:13:19.105 13:46:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:19.105 13:46:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:19.105 13:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.105 13:46:58 -- common/autotest_common.sh@10 -- # set +x 00:13:19.105 13:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.105 13:46:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.105 13:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.105 13:46:58 -- common/autotest_common.sh@10 -- # set +x 00:13:19.105 [2024-11-29 13:46:58.995200] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.105 13:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.105 13:46:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:19.105 13:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.105 13:46:58 -- common/autotest_common.sh@10 -- # set +x 00:13:19.105 13:46:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.105 13:46:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:19.105 13:46:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.105 13:46:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.105 13:46:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.105 13:46:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:19.366 13:46:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:19.366 13:46:59 -- common/autotest_common.sh@1187 -- # local i=0 00:13:19.366 13:46:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:19.366 13:46:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:19.366 13:46:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:21.900 13:47:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:21.900 13:47:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:21.900 13:47:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.900 13:47:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:21.900 13:47:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.900 13:47:01 -- common/autotest_common.sh@1197 -- # return 0 00:13:21.900 13:47:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:21.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.900 13:47:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:21.900 13:47:01 -- common/autotest_common.sh@1208 -- # local i=0 00:13:21.900 13:47:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:21.900 13:47:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.900 13:47:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:21.900 13:47:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.900 13:47:01 -- common/autotest_common.sh@1220 -- # return 0 00:13:21.900 13:47:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:21.900 13:47:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 [2024-11-29 13:47:01.771263] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:21.900 13:47:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.900 13:47:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.900 13:47:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.900 13:47:01 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:22.470 13:47:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:22.470 13:47:02 -- common/autotest_common.sh@1187 -- # local i=0 00:13:22.470 13:47:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:22.470 13:47:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:22.470 13:47:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:24.376 13:47:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:24.376 13:47:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:24.376 13:47:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:24.376 13:47:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:24.376 13:47:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:24.376 13:47:04 -- common/autotest_common.sh@1197 -- # return 0 00:13:24.376 13:47:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:24.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.376 13:47:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:24.376 13:47:04 -- common/autotest_common.sh@1208 -- # local i=0 00:13:24.376 13:47:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:24.376 13:47:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.376 13:47:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:24.376 13:47:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.376 13:47:04 -- common/autotest_common.sh@1220 -- # return 0 00:13:24.376 13:47:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:24.376 13:47:04 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 [2024-11-29 13:47:04.592054] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:24.376 13:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.376 13:47:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.376 13:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.376 13:47:04 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:25.312 13:47:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:25.312 13:47:05 -- common/autotest_common.sh@1187 -- # local i=0 00:13:25.312 13:47:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:25.312 13:47:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:25.312 13:47:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:27.221 13:47:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:27.221 13:47:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:27.221 13:47:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:27.221 13:47:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:27.221 13:47:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:27.221 13:47:07 -- common/autotest_common.sh@1197 -- # return 0 00:13:27.221 13:47:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:27.221 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:27.221 13:47:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:27.221 13:47:07 -- common/autotest_common.sh@1208 -- # local i=0 00:13:27.221 13:47:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:27.221 13:47:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.221 13:47:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:27.221 13:47:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.221 13:47:07 -- common/autotest_common.sh@1220 -- # return 0 00:13:27.221 13:47:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.221 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.221 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.221 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.221 13:47:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:27.221 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.221 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.222 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.222 13:47:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:27.222 13:47:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:27.222 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.222 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.222 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.222 13:47:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:27.222 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.222 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.222 [2024-11-29 13:47:07.413043] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.222 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.222 13:47:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:27.222 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.222 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.222 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.222 13:47:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:27.222 13:47:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.222 13:47:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.222 13:47:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.222 13:47:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.792 13:47:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:27.792 13:47:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:27.792 13:47:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:27.792 13:47:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:27.792 13:47:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:30.333 13:47:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:30.333 13:47:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:30.333 13:47:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:30.333 13:47:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:30.333 13:47:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:30.334 13:47:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:30.334 13:47:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:30.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.334 13:47:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:30.334 13:47:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:30.334 13:47:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:30.334 13:47:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.334 13:47:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:30.334 13:47:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.334 13:47:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:30.334 13:47:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:30.334 13:47:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 [2024-11-29 13:47:10.174196] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:30.334 13:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.334 13:47:10 -- common/autotest_common.sh@10 -- # set +x 00:13:30.334 13:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.334 13:47:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:30.900 13:47:10 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:30.900 13:47:10 -- common/autotest_common.sh@1187 -- # local i=0 00:13:30.900 13:47:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:30.900 13:47:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:30.901 13:47:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:32.809 13:47:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:32.809 13:47:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:32.809 13:47:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:32.809 13:47:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:32.809 13:47:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:32.809 13:47:12 -- common/autotest_common.sh@1197 -- # return 0 00:13:32.809 13:47:12 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:32.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:32.809 13:47:12 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:32.809 13:47:12 -- common/autotest_common.sh@1208 -- # local i=0 00:13:32.809 13:47:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:32.809 13:47:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.809 13:47:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:32.809 13:47:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.809 13:47:12 -- common/autotest_common.sh@1220 -- # return 0 00:13:32.809 13:47:12 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:32.809 13:47:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:12 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:12 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.809 13:47:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:12 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:12 -- target/rpc.sh@99 -- # seq 1 5 00:13:32.809 13:47:12 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.809 13:47:12 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.809 13:47:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:12 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 [2024-11-29 13:47:13.005577] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.809 13:47:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 [2024-11-29 13:47:13.053605] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:32.809 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.809 13:47:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.809 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.809 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.069 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.069 13:47:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.069 13:47:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.069 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.069 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.069 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.069 13:47:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 [2024-11-29 13:47:13.101778] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.070 13:47:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 [2024-11-29 13:47:13.149921] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.070 13:47:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 [2024-11-29 13:47:13.198080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:33.070 13:47:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.070 13:47:13 -- common/autotest_common.sh@10 -- # set +x 00:13:33.070 13:47:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.070 13:47:13 -- target/rpc.sh@110 -- # stats='{ 00:13:33.070 "tick_rate": 2700000000, 00:13:33.070 "poll_groups": [ 00:13:33.070 { 00:13:33.070 "name": "nvmf_tgt_poll_group_0", 00:13:33.070 "admin_qpairs": 2, 00:13:33.070 "io_qpairs": 84, 00:13:33.070 "current_admin_qpairs": 0, 00:13:33.070 "current_io_qpairs": 0, 00:13:33.070 "pending_bdev_io": 0, 00:13:33.070 "completed_nvme_io": 234, 00:13:33.070 "transports": [ 00:13:33.070 { 00:13:33.070 "trtype": "TCP" 00:13:33.070 } 00:13:33.070 ] 00:13:33.070 }, 00:13:33.070 { 00:13:33.070 "name": "nvmf_tgt_poll_group_1", 00:13:33.070 "admin_qpairs": 2, 00:13:33.070 "io_qpairs": 84, 00:13:33.070 "current_admin_qpairs": 0, 00:13:33.070 "current_io_qpairs": 0, 00:13:33.070 "pending_bdev_io": 0, 00:13:33.070 "completed_nvme_io": 184, 00:13:33.070 "transports": [ 00:13:33.070 { 00:13:33.070 "trtype": "TCP" 00:13:33.070 } 00:13:33.070 ] 00:13:33.070 }, 00:13:33.070 { 00:13:33.070 "name": "nvmf_tgt_poll_group_2", 00:13:33.070 "admin_qpairs": 1, 00:13:33.070 "io_qpairs": 84, 00:13:33.070 "current_admin_qpairs": 0, 00:13:33.070 "current_io_qpairs": 0, 00:13:33.070 "pending_bdev_io": 0, 00:13:33.070 "completed_nvme_io": 178, 00:13:33.070 "transports": [ 00:13:33.070 { 00:13:33.070 "trtype": "TCP" 00:13:33.070 } 00:13:33.070 ] 00:13:33.070 }, 00:13:33.070 { 00:13:33.070 "name": "nvmf_tgt_poll_group_3", 00:13:33.070 "admin_qpairs": 2, 00:13:33.070 "io_qpairs": 84, 00:13:33.070 "current_admin_qpairs": 0, 00:13:33.070 "current_io_qpairs": 0, 00:13:33.070 "pending_bdev_io": 0, 00:13:33.070 "completed_nvme_io": 90, 00:13:33.070 "transports": [ 00:13:33.070 { 00:13:33.070 "trtype": "TCP" 00:13:33.070 } 00:13:33.070 ] 00:13:33.070 } 00:13:33.070 ] 00:13:33.070 }' 00:13:33.070 13:47:13 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:33.070 13:47:13 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:33.070 13:47:13 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:33.070 13:47:13 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:33.070 13:47:13 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:33.070 13:47:13 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:33.070 13:47:13 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:33.070 13:47:13 -- target/rpc.sh@123 -- # nvmftestfini 00:13:33.070 13:47:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:33.070 13:47:13 -- nvmf/common.sh@116 -- # sync 00:13:33.070 13:47:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:33.070 13:47:13 -- nvmf/common.sh@119 -- # set +e 00:13:33.070 13:47:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:33.070 13:47:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:33.070 rmmod nvme_tcp 00:13:33.329 rmmod nvme_fabrics 00:13:33.329 rmmod nvme_keyring 00:13:33.329 13:47:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:33.329 13:47:13 -- nvmf/common.sh@123 -- # set -e 00:13:33.329 13:47:13 -- nvmf/common.sh@124 -- # return 0 00:13:33.329 13:47:13 -- nvmf/common.sh@477 -- # '[' -n 2245028 ']' 00:13:33.329 13:47:13 -- nvmf/common.sh@478 -- # killprocess 2245028 00:13:33.329 13:47:13 -- common/autotest_common.sh@936 -- # '[' -z 2245028 ']' 00:13:33.329 13:47:13 -- common/autotest_common.sh@940 -- # kill -0 2245028 00:13:33.329 13:47:13 -- common/autotest_common.sh@941 -- # uname 00:13:33.329 13:47:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:33.329 13:47:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2245028 00:13:33.329 13:47:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:33.329 13:47:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:33.329 13:47:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2245028' 00:13:33.329 killing process with pid 2245028 00:13:33.329 13:47:13 -- common/autotest_common.sh@955 -- # kill 2245028 00:13:33.329 13:47:13 -- common/autotest_common.sh@960 -- # wait 2245028 00:13:33.588 13:47:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:33.588 13:47:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:33.588 13:47:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:33.588 13:47:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:33.588 13:47:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:33.588 13:47:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:33.588 13:47:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:33.588 13:47:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.493 13:47:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:35.493 00:13:35.493 real 0m26.326s 00:13:35.493 user 1m25.917s 00:13:35.493 sys 0m4.280s 00:13:35.493 13:47:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:35.493 13:47:15 -- common/autotest_common.sh@10 -- # set +x 00:13:35.493 ************************************ 00:13:35.493 END TEST nvmf_rpc 00:13:35.493 ************************************ 00:13:35.493 13:47:15 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:35.493 13:47:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:35.493 13:47:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:35.493 13:47:15 -- common/autotest_common.sh@10 -- # set +x 00:13:35.493 ************************************ 00:13:35.493 START TEST nvmf_invalid 00:13:35.493 ************************************ 00:13:35.493 13:47:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:35.753 * Looking for test storage... 00:13:35.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:35.753 13:47:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:35.753 13:47:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:35.753 13:47:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:35.753 13:47:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:35.753 13:47:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:35.753 13:47:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:35.753 13:47:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:35.753 13:47:15 -- scripts/common.sh@335 -- # IFS=.-: 00:13:35.753 13:47:15 -- scripts/common.sh@335 -- # read -ra ver1 00:13:35.753 13:47:15 -- scripts/common.sh@336 -- # IFS=.-: 00:13:35.753 13:47:15 -- scripts/common.sh@336 -- # read -ra ver2 00:13:35.753 13:47:15 -- scripts/common.sh@337 -- # local 'op=<' 00:13:35.753 13:47:15 -- scripts/common.sh@339 -- # ver1_l=2 00:13:35.753 13:47:15 -- scripts/common.sh@340 -- # ver2_l=1 00:13:35.753 13:47:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:35.753 13:47:15 -- scripts/common.sh@343 -- # case "$op" in 00:13:35.753 13:47:15 -- scripts/common.sh@344 -- # : 1 00:13:35.753 13:47:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:35.753 13:47:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:35.753 13:47:15 -- scripts/common.sh@364 -- # decimal 1 00:13:35.753 13:47:15 -- scripts/common.sh@352 -- # local d=1 00:13:35.753 13:47:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:35.753 13:47:15 -- scripts/common.sh@354 -- # echo 1 00:13:35.753 13:47:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:35.753 13:47:15 -- scripts/common.sh@365 -- # decimal 2 00:13:35.753 13:47:15 -- scripts/common.sh@352 -- # local d=2 00:13:35.754 13:47:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:35.754 13:47:15 -- scripts/common.sh@354 -- # echo 2 00:13:35.754 13:47:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:35.754 13:47:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:35.754 13:47:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:35.754 13:47:15 -- scripts/common.sh@367 -- # return 0 00:13:35.754 13:47:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:35.754 13:47:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:35.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.754 --rc genhtml_branch_coverage=1 00:13:35.754 --rc genhtml_function_coverage=1 00:13:35.754 --rc genhtml_legend=1 00:13:35.754 --rc geninfo_all_blocks=1 00:13:35.754 --rc geninfo_unexecuted_blocks=1 00:13:35.754 00:13:35.754 ' 00:13:35.754 13:47:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:35.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.754 --rc genhtml_branch_coverage=1 00:13:35.754 --rc genhtml_function_coverage=1 00:13:35.754 --rc genhtml_legend=1 00:13:35.754 --rc geninfo_all_blocks=1 00:13:35.754 --rc geninfo_unexecuted_blocks=1 00:13:35.754 00:13:35.754 ' 00:13:35.754 13:47:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:35.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.754 --rc genhtml_branch_coverage=1 00:13:35.754 --rc genhtml_function_coverage=1 00:13:35.754 --rc genhtml_legend=1 00:13:35.754 --rc geninfo_all_blocks=1 00:13:35.754 --rc geninfo_unexecuted_blocks=1 00:13:35.754 00:13:35.754 ' 00:13:35.754 13:47:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:35.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.754 --rc genhtml_branch_coverage=1 00:13:35.754 --rc genhtml_function_coverage=1 00:13:35.754 --rc genhtml_legend=1 00:13:35.754 --rc geninfo_all_blocks=1 00:13:35.754 --rc geninfo_unexecuted_blocks=1 00:13:35.754 00:13:35.754 ' 00:13:35.754 13:47:15 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:35.754 13:47:15 -- nvmf/common.sh@7 -- # uname -s 00:13:35.754 13:47:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:35.754 13:47:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:35.754 13:47:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:35.754 13:47:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:35.754 13:47:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:35.754 13:47:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:35.754 13:47:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:35.754 13:47:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:35.754 13:47:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:35.754 13:47:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:35.754 13:47:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:35.754 13:47:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:35.754 13:47:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:35.754 13:47:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:35.754 13:47:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:35.754 13:47:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:35.754 13:47:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:35.754 13:47:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:35.754 13:47:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:35.754 13:47:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.754 13:47:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.754 13:47:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.754 13:47:15 -- paths/export.sh@5 -- # export PATH 00:13:35.754 13:47:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.754 13:47:15 -- nvmf/common.sh@46 -- # : 0 00:13:35.754 13:47:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:35.754 13:47:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:35.754 13:47:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:35.754 13:47:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:35.754 13:47:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:35.754 13:47:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:35.754 13:47:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:35.754 13:47:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:35.754 13:47:15 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:35.754 13:47:15 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:35.754 13:47:15 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:35.754 13:47:15 -- target/invalid.sh@14 -- # target=foobar 00:13:35.754 13:47:15 -- target/invalid.sh@16 -- # RANDOM=0 00:13:35.754 13:47:15 -- target/invalid.sh@34 -- # nvmftestinit 00:13:35.754 13:47:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:35.754 13:47:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:35.754 13:47:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:35.754 13:47:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:35.754 13:47:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:35.754 13:47:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.754 13:47:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.754 13:47:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.754 13:47:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:35.754 13:47:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:35.754 13:47:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:35.754 13:47:15 -- common/autotest_common.sh@10 -- # set +x 00:13:37.662 13:47:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:37.662 13:47:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:37.662 13:47:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:37.662 13:47:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:37.662 13:47:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:37.662 13:47:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:37.662 13:47:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:37.662 13:47:17 -- nvmf/common.sh@294 -- # net_devs=() 00:13:37.662 13:47:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:37.662 13:47:17 -- nvmf/common.sh@295 -- # e810=() 00:13:37.662 13:47:17 -- nvmf/common.sh@295 -- # local -ga e810 00:13:37.662 13:47:17 -- nvmf/common.sh@296 -- # x722=() 00:13:37.662 13:47:17 -- nvmf/common.sh@296 -- # local -ga x722 00:13:37.662 13:47:17 -- nvmf/common.sh@297 -- # mlx=() 00:13:37.662 13:47:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:37.662 13:47:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:37.662 13:47:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:37.662 13:47:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:37.662 13:47:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:37.662 13:47:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:37.662 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:37.662 13:47:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:37.662 13:47:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:37.662 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:37.662 13:47:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:37.662 13:47:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.662 13:47:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.662 13:47:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:37.662 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:37.662 13:47:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.662 13:47:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:37.662 13:47:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.662 13:47:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.662 13:47:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:37.662 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:37.662 13:47:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.662 13:47:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:37.662 13:47:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:37.662 13:47:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:37.662 13:47:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:37.662 13:47:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:37.662 13:47:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:37.662 13:47:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:37.662 13:47:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:37.662 13:47:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:37.662 13:47:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:37.662 13:47:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:37.662 13:47:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:37.662 13:47:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:37.662 13:47:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:37.920 13:47:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:37.920 13:47:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:37.920 13:47:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:37.920 13:47:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:37.920 13:47:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:37.920 13:47:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:37.920 13:47:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:37.920 13:47:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:37.920 13:47:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:37.920 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:37.920 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:13:37.920 00:13:37.920 --- 10.0.0.2 ping statistics --- 00:13:37.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.920 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:13:37.920 13:47:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:37.920 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:37.920 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:13:37.920 00:13:37.920 --- 10.0.0.1 ping statistics --- 00:13:37.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.920 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:13:37.920 13:47:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:37.920 13:47:18 -- nvmf/common.sh@410 -- # return 0 00:13:37.920 13:47:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:37.920 13:47:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:37.920 13:47:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:37.920 13:47:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:37.921 13:47:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:37.921 13:47:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:37.921 13:47:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:37.921 13:47:18 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:37.921 13:47:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:37.921 13:47:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:37.921 13:47:18 -- common/autotest_common.sh@10 -- # set +x 00:13:37.921 13:47:18 -- nvmf/common.sh@469 -- # nvmfpid=2249747 00:13:37.921 13:47:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:37.921 13:47:18 -- nvmf/common.sh@470 -- # waitforlisten 2249747 00:13:37.921 13:47:18 -- common/autotest_common.sh@829 -- # '[' -z 2249747 ']' 00:13:37.921 13:47:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:37.921 13:47:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:37.921 13:47:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:37.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:37.921 13:47:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:37.921 13:47:18 -- common/autotest_common.sh@10 -- # set +x 00:13:37.921 [2024-11-29 13:47:18.147644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:37.921 [2024-11-29 13:47:18.147737] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:37.921 EAL: No free 2048 kB hugepages reported on node 1 00:13:38.180 [2024-11-29 13:47:18.220271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:38.180 [2024-11-29 13:47:18.310302] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:38.180 [2024-11-29 13:47:18.310480] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:38.180 [2024-11-29 13:47:18.310500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:38.180 [2024-11-29 13:47:18.310513] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:38.180 [2024-11-29 13:47:18.310567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:38.180 [2024-11-29 13:47:18.310626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:38.180 [2024-11-29 13:47:18.310677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:38.180 [2024-11-29 13:47:18.310679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:39.115 13:47:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:39.115 13:47:19 -- common/autotest_common.sh@862 -- # return 0 00:13:39.115 13:47:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:39.115 13:47:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:39.115 13:47:19 -- common/autotest_common.sh@10 -- # set +x 00:13:39.116 13:47:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:39.116 13:47:19 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:39.116 13:47:19 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode6794 00:13:39.373 [2024-11-29 13:47:19.430984] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:39.373 13:47:19 -- target/invalid.sh@40 -- # out='request: 00:13:39.373 { 00:13:39.373 "nqn": "nqn.2016-06.io.spdk:cnode6794", 00:13:39.373 "tgt_name": "foobar", 00:13:39.373 "method": "nvmf_create_subsystem", 00:13:39.373 "req_id": 1 00:13:39.373 } 00:13:39.373 Got JSON-RPC error response 00:13:39.373 response: 00:13:39.373 { 00:13:39.373 "code": -32603, 00:13:39.373 "message": "Unable to find target foobar" 00:13:39.373 }' 00:13:39.373 13:47:19 -- target/invalid.sh@41 -- # [[ request: 00:13:39.373 { 00:13:39.373 "nqn": "nqn.2016-06.io.spdk:cnode6794", 00:13:39.373 "tgt_name": "foobar", 00:13:39.373 "method": "nvmf_create_subsystem", 00:13:39.373 "req_id": 1 00:13:39.373 } 00:13:39.373 Got JSON-RPC error response 00:13:39.373 response: 00:13:39.373 { 00:13:39.373 "code": -32603, 00:13:39.373 "message": "Unable to find target foobar" 00:13:39.373 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:39.373 13:47:19 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:39.374 13:47:19 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode8045 00:13:39.632 [2024-11-29 13:47:19.683841] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8045: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:39.632 13:47:19 -- target/invalid.sh@45 -- # out='request: 00:13:39.632 { 00:13:39.632 "nqn": "nqn.2016-06.io.spdk:cnode8045", 00:13:39.632 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:39.632 "method": "nvmf_create_subsystem", 00:13:39.632 "req_id": 1 00:13:39.632 } 00:13:39.632 Got JSON-RPC error response 00:13:39.632 response: 00:13:39.632 { 00:13:39.632 "code": -32602, 00:13:39.632 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:39.632 }' 00:13:39.632 13:47:19 -- target/invalid.sh@46 -- # [[ request: 00:13:39.632 { 00:13:39.632 "nqn": "nqn.2016-06.io.spdk:cnode8045", 00:13:39.632 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:39.632 "method": "nvmf_create_subsystem", 00:13:39.632 "req_id": 1 00:13:39.632 } 00:13:39.632 Got JSON-RPC error response 00:13:39.632 response: 00:13:39.632 { 00:13:39.632 "code": -32602, 00:13:39.632 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:39.632 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:39.632 13:47:19 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:39.632 13:47:19 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode2800 00:13:39.890 [2024-11-29 13:47:19.928609] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2800: invalid model number 'SPDK_Controller' 00:13:39.890 13:47:19 -- target/invalid.sh@50 -- # out='request: 00:13:39.890 { 00:13:39.890 "nqn": "nqn.2016-06.io.spdk:cnode2800", 00:13:39.890 "model_number": "SPDK_Controller\u001f", 00:13:39.890 "method": "nvmf_create_subsystem", 00:13:39.890 "req_id": 1 00:13:39.890 } 00:13:39.890 Got JSON-RPC error response 00:13:39.890 response: 00:13:39.890 { 00:13:39.890 "code": -32602, 00:13:39.890 "message": "Invalid MN SPDK_Controller\u001f" 00:13:39.890 }' 00:13:39.890 13:47:19 -- target/invalid.sh@51 -- # [[ request: 00:13:39.890 { 00:13:39.890 "nqn": "nqn.2016-06.io.spdk:cnode2800", 00:13:39.890 "model_number": "SPDK_Controller\u001f", 00:13:39.890 "method": "nvmf_create_subsystem", 00:13:39.890 "req_id": 1 00:13:39.890 } 00:13:39.890 Got JSON-RPC error response 00:13:39.890 response: 00:13:39.890 { 00:13:39.890 "code": -32602, 00:13:39.890 "message": "Invalid MN SPDK_Controller\u001f" 00:13:39.890 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:39.890 13:47:19 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:39.890 13:47:19 -- target/invalid.sh@19 -- # local length=21 ll 00:13:39.890 13:47:19 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:39.890 13:47:19 -- target/invalid.sh@21 -- # local chars 00:13:39.890 13:47:19 -- target/invalid.sh@22 -- # local string 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 89 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=Y 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 37 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=% 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 36 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+='$' 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 90 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=Z 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 33 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+='!' 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 100 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=d 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 108 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=l 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 40 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+='(' 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 65 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=A 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 90 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=Z 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 115 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=s 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # printf %x 65 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:39.890 13:47:19 -- target/invalid.sh@25 -- # string+=A 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.890 13:47:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 53 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=5 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 72 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=H 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 34 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+='"' 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 33 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+='!' 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 86 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=V 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 120 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=x 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 88 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=X 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 114 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=r 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # printf %x 101 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:39.891 13:47:20 -- target/invalid.sh@25 -- # string+=e 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:39.891 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:39.891 13:47:20 -- target/invalid.sh@28 -- # [[ Y == \- ]] 00:13:39.891 13:47:20 -- target/invalid.sh@31 -- # echo 'Y%$Z!dl(AZsA5H"!VxXre' 00:13:39.891 13:47:20 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'Y%$Z!dl(AZsA5H"!VxXre' nqn.2016-06.io.spdk:cnode14336 00:13:40.149 [2024-11-29 13:47:20.265788] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14336: invalid serial number 'Y%$Z!dl(AZsA5H"!VxXre' 00:13:40.150 13:47:20 -- target/invalid.sh@54 -- # out='request: 00:13:40.150 { 00:13:40.150 "nqn": "nqn.2016-06.io.spdk:cnode14336", 00:13:40.150 "serial_number": "Y%$Z!dl(AZsA5H\"!VxXre", 00:13:40.150 "method": "nvmf_create_subsystem", 00:13:40.150 "req_id": 1 00:13:40.150 } 00:13:40.150 Got JSON-RPC error response 00:13:40.150 response: 00:13:40.150 { 00:13:40.150 "code": -32602, 00:13:40.150 "message": "Invalid SN Y%$Z!dl(AZsA5H\"!VxXre" 00:13:40.150 }' 00:13:40.150 13:47:20 -- target/invalid.sh@55 -- # [[ request: 00:13:40.150 { 00:13:40.150 "nqn": "nqn.2016-06.io.spdk:cnode14336", 00:13:40.150 "serial_number": "Y%$Z!dl(AZsA5H\"!VxXre", 00:13:40.150 "method": "nvmf_create_subsystem", 00:13:40.150 "req_id": 1 00:13:40.150 } 00:13:40.150 Got JSON-RPC error response 00:13:40.150 response: 00:13:40.150 { 00:13:40.150 "code": -32602, 00:13:40.150 "message": "Invalid SN Y%$Z!dl(AZsA5H\"!VxXre" 00:13:40.150 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:40.150 13:47:20 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:40.150 13:47:20 -- target/invalid.sh@19 -- # local length=41 ll 00:13:40.150 13:47:20 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:40.150 13:47:20 -- target/invalid.sh@21 -- # local chars 00:13:40.150 13:47:20 -- target/invalid.sh@22 -- # local string 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 87 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=W 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 68 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=D 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 38 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+='&' 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 90 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=Z 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 54 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=6 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 104 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=h 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 110 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=n 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 52 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x34' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=4 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 79 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=O 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 72 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=H 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 73 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=I 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 65 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=A 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 76 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=L 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 105 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=i 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 90 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=Z 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 87 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=W 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 112 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=p 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 53 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=5 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 106 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=j 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 102 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=f 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 47 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=/ 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 43 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=+ 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 71 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=G 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 82 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=R 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 99 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=c 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 90 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=Z 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 103 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=g 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # printf %x 85 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:40.150 13:47:20 -- target/invalid.sh@25 -- # string+=U 00:13:40.150 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 54 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=6 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 85 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=U 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 116 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=t 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 88 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=X 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 73 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=I 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 92 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+='\' 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 68 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=D 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 103 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=g 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 102 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # string+=f 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.151 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.151 13:47:20 -- target/invalid.sh@25 -- # printf %x 125 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # string+='}' 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # printf %x 80 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # string+=P 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # printf %x 119 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # string+=w 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # printf %x 55 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:40.412 13:47:20 -- target/invalid.sh@25 -- # string+=7 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.412 13:47:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.412 13:47:20 -- target/invalid.sh@28 -- # [[ W == \- ]] 00:13:40.412 13:47:20 -- target/invalid.sh@31 -- # echo 'WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\Dgf}Pw7' 00:13:40.412 13:47:20 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\Dgf}Pw7' nqn.2016-06.io.spdk:cnode14935 00:13:40.412 [2024-11-29 13:47:20.675140] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14935: invalid model number 'WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\Dgf}Pw7' 00:13:40.670 13:47:20 -- target/invalid.sh@58 -- # out='request: 00:13:40.670 { 00:13:40.670 "nqn": "nqn.2016-06.io.spdk:cnode14935", 00:13:40.670 "model_number": "WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\\Dgf}Pw7", 00:13:40.670 "method": "nvmf_create_subsystem", 00:13:40.670 "req_id": 1 00:13:40.670 } 00:13:40.670 Got JSON-RPC error response 00:13:40.670 response: 00:13:40.670 { 00:13:40.670 "code": -32602, 00:13:40.670 "message": "Invalid MN WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\\Dgf}Pw7" 00:13:40.670 }' 00:13:40.670 13:47:20 -- target/invalid.sh@59 -- # [[ request: 00:13:40.670 { 00:13:40.670 "nqn": "nqn.2016-06.io.spdk:cnode14935", 00:13:40.670 "model_number": "WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\\Dgf}Pw7", 00:13:40.670 "method": "nvmf_create_subsystem", 00:13:40.670 "req_id": 1 00:13:40.670 } 00:13:40.670 Got JSON-RPC error response 00:13:40.670 response: 00:13:40.670 { 00:13:40.670 "code": -32602, 00:13:40.670 "message": "Invalid MN WD&Z6hn4OHIALiZWp5jf/+GRcZgU6UtXI\\Dgf}Pw7" 00:13:40.670 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:40.670 13:47:20 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:40.670 [2024-11-29 13:47:20.936057] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:40.930 13:47:20 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:40.930 13:47:21 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:41.189 13:47:21 -- target/invalid.sh@67 -- # echo '' 00:13:41.189 13:47:21 -- target/invalid.sh@67 -- # head -n 1 00:13:41.189 13:47:21 -- target/invalid.sh@67 -- # IP= 00:13:41.189 13:47:21 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:41.189 [2024-11-29 13:47:21.445845] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:41.189 13:47:21 -- target/invalid.sh@69 -- # out='request: 00:13:41.189 { 00:13:41.189 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:41.189 "listen_address": { 00:13:41.189 "trtype": "tcp", 00:13:41.189 "traddr": "", 00:13:41.189 "trsvcid": "4421" 00:13:41.189 }, 00:13:41.189 "method": "nvmf_subsystem_remove_listener", 00:13:41.189 "req_id": 1 00:13:41.190 } 00:13:41.190 Got JSON-RPC error response 00:13:41.190 response: 00:13:41.190 { 00:13:41.190 "code": -32602, 00:13:41.190 "message": "Invalid parameters" 00:13:41.190 }' 00:13:41.190 13:47:21 -- target/invalid.sh@70 -- # [[ request: 00:13:41.190 { 00:13:41.190 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:41.190 "listen_address": { 00:13:41.190 "trtype": "tcp", 00:13:41.190 "traddr": "", 00:13:41.190 "trsvcid": "4421" 00:13:41.190 }, 00:13:41.190 "method": "nvmf_subsystem_remove_listener", 00:13:41.190 "req_id": 1 00:13:41.190 } 00:13:41.190 Got JSON-RPC error response 00:13:41.190 response: 00:13:41.190 { 00:13:41.190 "code": -32602, 00:13:41.190 "message": "Invalid parameters" 00:13:41.190 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:41.190 13:47:21 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6921 -i 0 00:13:41.449 [2024-11-29 13:47:21.714791] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6921: invalid cntlid range [0-65519] 00:13:41.707 13:47:21 -- target/invalid.sh@73 -- # out='request: 00:13:41.707 { 00:13:41.707 "nqn": "nqn.2016-06.io.spdk:cnode6921", 00:13:41.707 "min_cntlid": 0, 00:13:41.707 "method": "nvmf_create_subsystem", 00:13:41.707 "req_id": 1 00:13:41.707 } 00:13:41.707 Got JSON-RPC error response 00:13:41.707 response: 00:13:41.707 { 00:13:41.707 "code": -32602, 00:13:41.707 "message": "Invalid cntlid range [0-65519]" 00:13:41.707 }' 00:13:41.707 13:47:21 -- target/invalid.sh@74 -- # [[ request: 00:13:41.707 { 00:13:41.707 "nqn": "nqn.2016-06.io.spdk:cnode6921", 00:13:41.707 "min_cntlid": 0, 00:13:41.707 "method": "nvmf_create_subsystem", 00:13:41.707 "req_id": 1 00:13:41.707 } 00:13:41.707 Got JSON-RPC error response 00:13:41.707 response: 00:13:41.707 { 00:13:41.707 "code": -32602, 00:13:41.707 "message": "Invalid cntlid range [0-65519]" 00:13:41.707 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:41.708 13:47:21 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1134 -i 65520 00:13:41.708 [2024-11-29 13:47:21.959625] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1134: invalid cntlid range [65520-65519] 00:13:41.708 13:47:21 -- target/invalid.sh@75 -- # out='request: 00:13:41.708 { 00:13:41.708 "nqn": "nqn.2016-06.io.spdk:cnode1134", 00:13:41.708 "min_cntlid": 65520, 00:13:41.708 "method": "nvmf_create_subsystem", 00:13:41.708 "req_id": 1 00:13:41.708 } 00:13:41.708 Got JSON-RPC error response 00:13:41.708 response: 00:13:41.708 { 00:13:41.708 "code": -32602, 00:13:41.708 "message": "Invalid cntlid range [65520-65519]" 00:13:41.708 }' 00:13:41.708 13:47:21 -- target/invalid.sh@76 -- # [[ request: 00:13:41.708 { 00:13:41.708 "nqn": "nqn.2016-06.io.spdk:cnode1134", 00:13:41.708 "min_cntlid": 65520, 00:13:41.708 "method": "nvmf_create_subsystem", 00:13:41.708 "req_id": 1 00:13:41.708 } 00:13:41.708 Got JSON-RPC error response 00:13:41.708 response: 00:13:41.708 { 00:13:41.708 "code": -32602, 00:13:41.708 "message": "Invalid cntlid range [65520-65519]" 00:13:41.708 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:41.708 13:47:21 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10414 -I 0 00:13:41.965 [2024-11-29 13:47:22.216543] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10414: invalid cntlid range [1-0] 00:13:41.966 13:47:22 -- target/invalid.sh@77 -- # out='request: 00:13:41.966 { 00:13:41.966 "nqn": "nqn.2016-06.io.spdk:cnode10414", 00:13:41.966 "max_cntlid": 0, 00:13:41.966 "method": "nvmf_create_subsystem", 00:13:41.966 "req_id": 1 00:13:41.966 } 00:13:41.966 Got JSON-RPC error response 00:13:41.966 response: 00:13:41.966 { 00:13:41.966 "code": -32602, 00:13:41.966 "message": "Invalid cntlid range [1-0]" 00:13:41.966 }' 00:13:41.966 13:47:22 -- target/invalid.sh@78 -- # [[ request: 00:13:41.966 { 00:13:41.966 "nqn": "nqn.2016-06.io.spdk:cnode10414", 00:13:41.966 "max_cntlid": 0, 00:13:41.966 "method": "nvmf_create_subsystem", 00:13:41.966 "req_id": 1 00:13:41.966 } 00:13:41.966 Got JSON-RPC error response 00:13:41.966 response: 00:13:41.966 { 00:13:41.966 "code": -32602, 00:13:41.966 "message": "Invalid cntlid range [1-0]" 00:13:41.966 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:41.966 13:47:22 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22030 -I 65520 00:13:42.224 [2024-11-29 13:47:22.473405] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22030: invalid cntlid range [1-65520] 00:13:42.224 13:47:22 -- target/invalid.sh@79 -- # out='request: 00:13:42.224 { 00:13:42.224 "nqn": "nqn.2016-06.io.spdk:cnode22030", 00:13:42.224 "max_cntlid": 65520, 00:13:42.224 "method": "nvmf_create_subsystem", 00:13:42.224 "req_id": 1 00:13:42.224 } 00:13:42.224 Got JSON-RPC error response 00:13:42.224 response: 00:13:42.224 { 00:13:42.224 "code": -32602, 00:13:42.224 "message": "Invalid cntlid range [1-65520]" 00:13:42.224 }' 00:13:42.224 13:47:22 -- target/invalid.sh@80 -- # [[ request: 00:13:42.224 { 00:13:42.224 "nqn": "nqn.2016-06.io.spdk:cnode22030", 00:13:42.224 "max_cntlid": 65520, 00:13:42.224 "method": "nvmf_create_subsystem", 00:13:42.224 "req_id": 1 00:13:42.224 } 00:13:42.224 Got JSON-RPC error response 00:13:42.224 response: 00:13:42.224 { 00:13:42.224 "code": -32602, 00:13:42.224 "message": "Invalid cntlid range [1-65520]" 00:13:42.224 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:42.224 13:47:22 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22410 -i 6 -I 5 00:13:42.482 [2024-11-29 13:47:22.738313] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22410: invalid cntlid range [6-5] 00:13:42.482 13:47:22 -- target/invalid.sh@83 -- # out='request: 00:13:42.482 { 00:13:42.482 "nqn": "nqn.2016-06.io.spdk:cnode22410", 00:13:42.482 "min_cntlid": 6, 00:13:42.482 "max_cntlid": 5, 00:13:42.482 "method": "nvmf_create_subsystem", 00:13:42.482 "req_id": 1 00:13:42.482 } 00:13:42.482 Got JSON-RPC error response 00:13:42.482 response: 00:13:42.482 { 00:13:42.482 "code": -32602, 00:13:42.482 "message": "Invalid cntlid range [6-5]" 00:13:42.482 }' 00:13:42.482 13:47:22 -- target/invalid.sh@84 -- # [[ request: 00:13:42.482 { 00:13:42.482 "nqn": "nqn.2016-06.io.spdk:cnode22410", 00:13:42.482 "min_cntlid": 6, 00:13:42.482 "max_cntlid": 5, 00:13:42.482 "method": "nvmf_create_subsystem", 00:13:42.482 "req_id": 1 00:13:42.482 } 00:13:42.482 Got JSON-RPC error response 00:13:42.482 response: 00:13:42.482 { 00:13:42.482 "code": -32602, 00:13:42.482 "message": "Invalid cntlid range [6-5]" 00:13:42.482 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:42.482 13:47:22 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:42.743 13:47:22 -- target/invalid.sh@87 -- # out='request: 00:13:42.743 { 00:13:42.743 "name": "foobar", 00:13:42.743 "method": "nvmf_delete_target", 00:13:42.743 "req_id": 1 00:13:42.743 } 00:13:42.743 Got JSON-RPC error response 00:13:42.743 response: 00:13:42.743 { 00:13:42.743 "code": -32602, 00:13:42.743 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:42.743 }' 00:13:42.743 13:47:22 -- target/invalid.sh@88 -- # [[ request: 00:13:42.743 { 00:13:42.743 "name": "foobar", 00:13:42.743 "method": "nvmf_delete_target", 00:13:42.743 "req_id": 1 00:13:42.743 } 00:13:42.743 Got JSON-RPC error response 00:13:42.743 response: 00:13:42.743 { 00:13:42.743 "code": -32602, 00:13:42.743 "message": "The specified target doesn't exist, cannot delete it." 00:13:42.743 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:42.743 13:47:22 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:42.743 13:47:22 -- target/invalid.sh@91 -- # nvmftestfini 00:13:42.743 13:47:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:42.743 13:47:22 -- nvmf/common.sh@116 -- # sync 00:13:42.743 13:47:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:42.743 13:47:22 -- nvmf/common.sh@119 -- # set +e 00:13:42.743 13:47:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:42.743 13:47:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:42.743 rmmod nvme_tcp 00:13:42.743 rmmod nvme_fabrics 00:13:42.743 rmmod nvme_keyring 00:13:42.743 13:47:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:42.743 13:47:22 -- nvmf/common.sh@123 -- # set -e 00:13:42.743 13:47:22 -- nvmf/common.sh@124 -- # return 0 00:13:42.743 13:47:22 -- nvmf/common.sh@477 -- # '[' -n 2249747 ']' 00:13:42.743 13:47:22 -- nvmf/common.sh@478 -- # killprocess 2249747 00:13:42.743 13:47:22 -- common/autotest_common.sh@936 -- # '[' -z 2249747 ']' 00:13:42.743 13:47:22 -- common/autotest_common.sh@940 -- # kill -0 2249747 00:13:42.743 13:47:22 -- common/autotest_common.sh@941 -- # uname 00:13:42.743 13:47:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:42.743 13:47:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2249747 00:13:42.743 13:47:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:42.743 13:47:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:42.743 13:47:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2249747' 00:13:42.743 killing process with pid 2249747 00:13:42.743 13:47:22 -- common/autotest_common.sh@955 -- # kill 2249747 00:13:42.743 13:47:22 -- common/autotest_common.sh@960 -- # wait 2249747 00:13:43.004 13:47:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:43.004 13:47:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:43.004 13:47:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:43.004 13:47:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:43.004 13:47:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:43.004 13:47:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.004 13:47:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.004 13:47:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.537 13:47:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:45.537 00:13:45.537 real 0m9.478s 00:13:45.537 user 0m23.505s 00:13:45.537 sys 0m2.496s 00:13:45.537 13:47:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:45.537 13:47:25 -- common/autotest_common.sh@10 -- # set +x 00:13:45.537 ************************************ 00:13:45.537 END TEST nvmf_invalid 00:13:45.537 ************************************ 00:13:45.537 13:47:25 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:45.537 13:47:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:45.537 13:47:25 -- common/autotest_common.sh@10 -- # set +x 00:13:45.537 ************************************ 00:13:45.537 START TEST nvmf_abort 00:13:45.537 ************************************ 00:13:45.537 13:47:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:45.537 * Looking for test storage... 00:13:45.537 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:45.537 13:47:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:45.537 13:47:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:45.537 13:47:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:45.537 13:47:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:45.537 13:47:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:45.537 13:47:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:45.537 13:47:25 -- scripts/common.sh@335 -- # IFS=.-: 00:13:45.537 13:47:25 -- scripts/common.sh@335 -- # read -ra ver1 00:13:45.537 13:47:25 -- scripts/common.sh@336 -- # IFS=.-: 00:13:45.537 13:47:25 -- scripts/common.sh@336 -- # read -ra ver2 00:13:45.537 13:47:25 -- scripts/common.sh@337 -- # local 'op=<' 00:13:45.537 13:47:25 -- scripts/common.sh@339 -- # ver1_l=2 00:13:45.537 13:47:25 -- scripts/common.sh@340 -- # ver2_l=1 00:13:45.537 13:47:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:45.537 13:47:25 -- scripts/common.sh@343 -- # case "$op" in 00:13:45.537 13:47:25 -- scripts/common.sh@344 -- # : 1 00:13:45.537 13:47:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:45.537 13:47:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:45.537 13:47:25 -- scripts/common.sh@364 -- # decimal 1 00:13:45.537 13:47:25 -- scripts/common.sh@352 -- # local d=1 00:13:45.537 13:47:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:45.537 13:47:25 -- scripts/common.sh@354 -- # echo 1 00:13:45.537 13:47:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:45.537 13:47:25 -- scripts/common.sh@365 -- # decimal 2 00:13:45.537 13:47:25 -- scripts/common.sh@352 -- # local d=2 00:13:45.537 13:47:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:45.537 13:47:25 -- scripts/common.sh@354 -- # echo 2 00:13:45.537 13:47:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:45.537 13:47:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:45.537 13:47:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:45.537 13:47:25 -- scripts/common.sh@367 -- # return 0 00:13:45.537 13:47:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:45.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.537 --rc genhtml_branch_coverage=1 00:13:45.537 --rc genhtml_function_coverage=1 00:13:45.537 --rc genhtml_legend=1 00:13:45.537 --rc geninfo_all_blocks=1 00:13:45.537 --rc geninfo_unexecuted_blocks=1 00:13:45.537 00:13:45.537 ' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:45.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.537 --rc genhtml_branch_coverage=1 00:13:45.537 --rc genhtml_function_coverage=1 00:13:45.537 --rc genhtml_legend=1 00:13:45.537 --rc geninfo_all_blocks=1 00:13:45.537 --rc geninfo_unexecuted_blocks=1 00:13:45.537 00:13:45.537 ' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:45.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.537 --rc genhtml_branch_coverage=1 00:13:45.537 --rc genhtml_function_coverage=1 00:13:45.537 --rc genhtml_legend=1 00:13:45.537 --rc geninfo_all_blocks=1 00:13:45.537 --rc geninfo_unexecuted_blocks=1 00:13:45.537 00:13:45.537 ' 00:13:45.537 13:47:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:45.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.537 --rc genhtml_branch_coverage=1 00:13:45.537 --rc genhtml_function_coverage=1 00:13:45.537 --rc genhtml_legend=1 00:13:45.537 --rc geninfo_all_blocks=1 00:13:45.537 --rc geninfo_unexecuted_blocks=1 00:13:45.537 00:13:45.537 ' 00:13:45.537 13:47:25 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:45.537 13:47:25 -- nvmf/common.sh@7 -- # uname -s 00:13:45.537 13:47:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:45.537 13:47:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:45.537 13:47:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:45.537 13:47:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:45.537 13:47:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:45.537 13:47:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:45.537 13:47:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:45.537 13:47:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:45.537 13:47:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:45.537 13:47:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:45.537 13:47:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.537 13:47:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.537 13:47:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:45.537 13:47:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:45.537 13:47:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:45.537 13:47:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:45.537 13:47:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:45.537 13:47:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:45.537 13:47:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:45.537 13:47:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.537 13:47:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.537 13:47:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.537 13:47:25 -- paths/export.sh@5 -- # export PATH 00:13:45.537 13:47:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.538 13:47:25 -- nvmf/common.sh@46 -- # : 0 00:13:45.538 13:47:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:45.538 13:47:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:45.538 13:47:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:45.538 13:47:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:45.538 13:47:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:45.538 13:47:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:45.538 13:47:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:45.538 13:47:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:45.538 13:47:25 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:45.538 13:47:25 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:45.538 13:47:25 -- target/abort.sh@14 -- # nvmftestinit 00:13:45.538 13:47:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:45.538 13:47:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:45.538 13:47:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:45.538 13:47:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:45.538 13:47:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:45.538 13:47:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:45.538 13:47:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:45.538 13:47:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.538 13:47:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:45.538 13:47:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:45.538 13:47:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:45.538 13:47:25 -- common/autotest_common.sh@10 -- # set +x 00:13:47.484 13:47:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:47.484 13:47:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:47.484 13:47:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:47.484 13:47:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:47.484 13:47:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:47.484 13:47:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:47.484 13:47:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:47.484 13:47:27 -- nvmf/common.sh@294 -- # net_devs=() 00:13:47.484 13:47:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:47.484 13:47:27 -- nvmf/common.sh@295 -- # e810=() 00:13:47.484 13:47:27 -- nvmf/common.sh@295 -- # local -ga e810 00:13:47.484 13:47:27 -- nvmf/common.sh@296 -- # x722=() 00:13:47.484 13:47:27 -- nvmf/common.sh@296 -- # local -ga x722 00:13:47.484 13:47:27 -- nvmf/common.sh@297 -- # mlx=() 00:13:47.484 13:47:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:47.484 13:47:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:47.484 13:47:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:47.484 13:47:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:47.484 13:47:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:47.484 13:47:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:47.484 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:47.484 13:47:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:47.484 13:47:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:47.484 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:47.484 13:47:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:47.484 13:47:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:47.484 13:47:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:47.484 13:47:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:47.484 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:47.484 13:47:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:47.484 13:47:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:47.484 13:47:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:47.484 13:47:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:47.484 13:47:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:47.484 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:47.484 13:47:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:47.484 13:47:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:47.484 13:47:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:47.484 13:47:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:47.484 13:47:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:47.484 13:47:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:47.484 13:47:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:47.484 13:47:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:47.484 13:47:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:47.484 13:47:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:47.484 13:47:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:47.484 13:47:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:47.484 13:47:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:47.484 13:47:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:47.484 13:47:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:47.485 13:47:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:47.485 13:47:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:47.485 13:47:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:47.485 13:47:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:47.485 13:47:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:47.485 13:47:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:47.485 13:47:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:47.485 13:47:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:47.485 13:47:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:47.485 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:47.485 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:13:47.485 00:13:47.485 --- 10.0.0.2 ping statistics --- 00:13:47.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:47.485 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:13:47.485 13:47:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:47.485 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:47.485 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:13:47.485 00:13:47.485 --- 10.0.0.1 ping statistics --- 00:13:47.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:47.485 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:13:47.485 13:47:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:47.485 13:47:27 -- nvmf/common.sh@410 -- # return 0 00:13:47.485 13:47:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:47.485 13:47:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:47.485 13:47:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:47.485 13:47:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:47.485 13:47:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:47.485 13:47:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:47.485 13:47:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:47.485 13:47:27 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:47.485 13:47:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:47.485 13:47:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:47.485 13:47:27 -- common/autotest_common.sh@10 -- # set +x 00:13:47.485 13:47:27 -- nvmf/common.sh@469 -- # nvmfpid=2252539 00:13:47.485 13:47:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:47.485 13:47:27 -- nvmf/common.sh@470 -- # waitforlisten 2252539 00:13:47.485 13:47:27 -- common/autotest_common.sh@829 -- # '[' -z 2252539 ']' 00:13:47.485 13:47:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:47.485 13:47:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:47.485 13:47:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:47.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:47.485 13:47:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:47.485 13:47:27 -- common/autotest_common.sh@10 -- # set +x 00:13:47.485 [2024-11-29 13:47:27.622918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:47.485 [2024-11-29 13:47:27.623012] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:47.485 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.485 [2024-11-29 13:47:27.700932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:47.741 [2024-11-29 13:47:27.795411] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:47.741 [2024-11-29 13:47:27.795558] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:47.741 [2024-11-29 13:47:27.795578] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:47.741 [2024-11-29 13:47:27.795593] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:47.741 [2024-11-29 13:47:27.795645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:47.741 [2024-11-29 13:47:27.799416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:47.741 [2024-11-29 13:47:27.799430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:48.675 13:47:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:48.675 13:47:28 -- common/autotest_common.sh@862 -- # return 0 00:13:48.675 13:47:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:48.675 13:47:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 13:47:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:48.675 13:47:28 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 [2024-11-29 13:47:28.707044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 Malloc0 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 Delay0 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 [2024-11-29 13:47:28.783640] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:48.675 13:47:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.675 13:47:28 -- common/autotest_common.sh@10 -- # set +x 00:13:48.675 13:47:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.675 13:47:28 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:48.675 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.675 [2024-11-29 13:47:28.848146] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:51.215 Initializing NVMe Controllers 00:13:51.215 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:51.215 controller IO queue size 128 less than required 00:13:51.215 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:51.215 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:51.215 Initialization complete. Launching workers. 00:13:51.215 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34392 00:13:51.215 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34453, failed to submit 62 00:13:51.215 success 34392, unsuccess 61, failed 0 00:13:51.215 13:47:30 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:51.215 13:47:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.215 13:47:30 -- common/autotest_common.sh@10 -- # set +x 00:13:51.215 13:47:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.215 13:47:30 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:51.215 13:47:30 -- target/abort.sh@38 -- # nvmftestfini 00:13:51.215 13:47:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:51.215 13:47:30 -- nvmf/common.sh@116 -- # sync 00:13:51.215 13:47:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:51.215 13:47:30 -- nvmf/common.sh@119 -- # set +e 00:13:51.215 13:47:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:51.215 13:47:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:51.215 rmmod nvme_tcp 00:13:51.215 rmmod nvme_fabrics 00:13:51.215 rmmod nvme_keyring 00:13:51.215 13:47:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.215 13:47:30 -- nvmf/common.sh@123 -- # set -e 00:13:51.215 13:47:30 -- nvmf/common.sh@124 -- # return 0 00:13:51.215 13:47:30 -- nvmf/common.sh@477 -- # '[' -n 2252539 ']' 00:13:51.215 13:47:30 -- nvmf/common.sh@478 -- # killprocess 2252539 00:13:51.215 13:47:30 -- common/autotest_common.sh@936 -- # '[' -z 2252539 ']' 00:13:51.215 13:47:30 -- common/autotest_common.sh@940 -- # kill -0 2252539 00:13:51.215 13:47:30 -- common/autotest_common.sh@941 -- # uname 00:13:51.215 13:47:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.215 13:47:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2252539 00:13:51.215 13:47:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:51.215 13:47:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:51.215 13:47:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2252539' 00:13:51.215 killing process with pid 2252539 00:13:51.215 13:47:31 -- common/autotest_common.sh@955 -- # kill 2252539 00:13:51.215 13:47:31 -- common/autotest_common.sh@960 -- # wait 2252539 00:13:51.215 13:47:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.215 13:47:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.215 13:47:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.215 13:47:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.215 13:47:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.215 13:47:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.215 13:47:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.215 13:47:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.123 13:47:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.123 00:13:53.123 real 0m8.033s 00:13:53.123 user 0m12.906s 00:13:53.123 sys 0m2.563s 00:13:53.123 13:47:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.123 13:47:33 -- common/autotest_common.sh@10 -- # set +x 00:13:53.123 ************************************ 00:13:53.123 END TEST nvmf_abort 00:13:53.123 ************************************ 00:13:53.123 13:47:33 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:53.123 13:47:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.123 13:47:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.123 13:47:33 -- common/autotest_common.sh@10 -- # set +x 00:13:53.123 ************************************ 00:13:53.123 START TEST nvmf_ns_hotplug_stress 00:13:53.123 ************************************ 00:13:53.123 13:47:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:53.123 * Looking for test storage... 00:13:53.123 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.123 13:47:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:53.123 13:47:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:53.123 13:47:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.384 13:47:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.384 13:47:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.384 13:47:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.384 13:47:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.384 13:47:33 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.384 13:47:33 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.384 13:47:33 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.384 13:47:33 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.384 13:47:33 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.384 13:47:33 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.384 13:47:33 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.384 13:47:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.384 13:47:33 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.384 13:47:33 -- scripts/common.sh@344 -- # : 1 00:13:53.384 13:47:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.384 13:47:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.384 13:47:33 -- scripts/common.sh@364 -- # decimal 1 00:13:53.384 13:47:33 -- scripts/common.sh@352 -- # local d=1 00:13:53.384 13:47:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.384 13:47:33 -- scripts/common.sh@354 -- # echo 1 00:13:53.384 13:47:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.384 13:47:33 -- scripts/common.sh@365 -- # decimal 2 00:13:53.384 13:47:33 -- scripts/common.sh@352 -- # local d=2 00:13:53.384 13:47:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.384 13:47:33 -- scripts/common.sh@354 -- # echo 2 00:13:53.384 13:47:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.384 13:47:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.384 13:47:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.384 13:47:33 -- scripts/common.sh@367 -- # return 0 00:13:53.384 13:47:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.384 13:47:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.384 --rc genhtml_branch_coverage=1 00:13:53.384 --rc genhtml_function_coverage=1 00:13:53.384 --rc genhtml_legend=1 00:13:53.384 --rc geninfo_all_blocks=1 00:13:53.384 --rc geninfo_unexecuted_blocks=1 00:13:53.384 00:13:53.384 ' 00:13:53.384 13:47:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.384 --rc genhtml_branch_coverage=1 00:13:53.384 --rc genhtml_function_coverage=1 00:13:53.384 --rc genhtml_legend=1 00:13:53.384 --rc geninfo_all_blocks=1 00:13:53.384 --rc geninfo_unexecuted_blocks=1 00:13:53.384 00:13:53.384 ' 00:13:53.384 13:47:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.384 --rc genhtml_branch_coverage=1 00:13:53.384 --rc genhtml_function_coverage=1 00:13:53.384 --rc genhtml_legend=1 00:13:53.384 --rc geninfo_all_blocks=1 00:13:53.384 --rc geninfo_unexecuted_blocks=1 00:13:53.384 00:13:53.384 ' 00:13:53.384 13:47:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.384 --rc genhtml_branch_coverage=1 00:13:53.384 --rc genhtml_function_coverage=1 00:13:53.384 --rc genhtml_legend=1 00:13:53.384 --rc geninfo_all_blocks=1 00:13:53.384 --rc geninfo_unexecuted_blocks=1 00:13:53.384 00:13:53.384 ' 00:13:53.384 13:47:33 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.384 13:47:33 -- nvmf/common.sh@7 -- # uname -s 00:13:53.384 13:47:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.384 13:47:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.384 13:47:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.384 13:47:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.384 13:47:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.384 13:47:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.384 13:47:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.384 13:47:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.384 13:47:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.384 13:47:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.384 13:47:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.384 13:47:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.384 13:47:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.384 13:47:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.384 13:47:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.384 13:47:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.384 13:47:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.384 13:47:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.384 13:47:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.384 13:47:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.384 13:47:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.385 13:47:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.385 13:47:33 -- paths/export.sh@5 -- # export PATH 00:13:53.385 13:47:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.385 13:47:33 -- nvmf/common.sh@46 -- # : 0 00:13:53.385 13:47:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.385 13:47:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.385 13:47:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.385 13:47:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.385 13:47:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.385 13:47:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.385 13:47:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.385 13:47:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.385 13:47:33 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:53.385 13:47:33 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:53.385 13:47:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.385 13:47:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.385 13:47:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.385 13:47:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.385 13:47:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.385 13:47:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.385 13:47:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.385 13:47:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.385 13:47:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.385 13:47:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.385 13:47:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.385 13:47:33 -- common/autotest_common.sh@10 -- # set +x 00:13:55.292 13:47:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.292 13:47:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.292 13:47:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.292 13:47:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.292 13:47:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.292 13:47:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.292 13:47:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.292 13:47:35 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.292 13:47:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.292 13:47:35 -- nvmf/common.sh@295 -- # e810=() 00:13:55.292 13:47:35 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.292 13:47:35 -- nvmf/common.sh@296 -- # x722=() 00:13:55.292 13:47:35 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.292 13:47:35 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.292 13:47:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.292 13:47:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.292 13:47:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.292 13:47:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.292 13:47:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.292 13:47:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.292 13:47:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.292 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.292 13:47:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.292 13:47:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.292 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.292 13:47:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.292 13:47:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.292 13:47:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.292 13:47:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.292 13:47:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.292 13:47:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.292 13:47:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.292 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.292 13:47:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.292 13:47:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.292 13:47:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.292 13:47:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.292 13:47:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.292 13:47:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.292 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.292 13:47:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.293 13:47:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.293 13:47:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.293 13:47:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.293 13:47:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.293 13:47:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.293 13:47:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.293 13:47:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.293 13:47:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.293 13:47:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.293 13:47:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.293 13:47:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.293 13:47:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.293 13:47:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.293 13:47:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.293 13:47:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.293 13:47:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.293 13:47:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.293 13:47:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.293 13:47:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.293 13:47:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.293 13:47:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.293 13:47:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.554 13:47:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.554 13:47:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.554 13:47:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.554 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.554 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.408 ms 00:13:55.554 00:13:55.554 --- 10.0.0.2 ping statistics --- 00:13:55.554 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.554 rtt min/avg/max/mdev = 0.408/0.408/0.408/0.000 ms 00:13:55.554 13:47:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.554 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.554 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:13:55.554 00:13:55.554 --- 10.0.0.1 ping statistics --- 00:13:55.554 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.554 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:13:55.554 13:47:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.554 13:47:35 -- nvmf/common.sh@410 -- # return 0 00:13:55.554 13:47:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.554 13:47:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.554 13:47:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.554 13:47:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.554 13:47:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.554 13:47:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.554 13:47:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.554 13:47:35 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:55.554 13:47:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.554 13:47:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.554 13:47:35 -- common/autotest_common.sh@10 -- # set +x 00:13:55.554 13:47:35 -- nvmf/common.sh@469 -- # nvmfpid=2254924 00:13:55.554 13:47:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:55.554 13:47:35 -- nvmf/common.sh@470 -- # waitforlisten 2254924 00:13:55.554 13:47:35 -- common/autotest_common.sh@829 -- # '[' -z 2254924 ']' 00:13:55.554 13:47:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.554 13:47:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.554 13:47:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.554 13:47:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.554 13:47:35 -- common/autotest_common.sh@10 -- # set +x 00:13:55.554 [2024-11-29 13:47:35.688055] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.554 [2024-11-29 13:47:35.688148] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.554 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.554 [2024-11-29 13:47:35.765946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:55.814 [2024-11-29 13:47:35.863052] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.814 [2024-11-29 13:47:35.863236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.814 [2024-11-29 13:47:35.863257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.814 [2024-11-29 13:47:35.863272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.814 [2024-11-29 13:47:35.863357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.814 [2024-11-29 13:47:35.865416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.814 [2024-11-29 13:47:35.865430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.748 13:47:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:56.749 13:47:36 -- common/autotest_common.sh@862 -- # return 0 00:13:56.749 13:47:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.749 13:47:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:56.749 13:47:36 -- common/autotest_common.sh@10 -- # set +x 00:13:56.749 13:47:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.749 13:47:36 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:56.749 13:47:36 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:56.749 [2024-11-29 13:47:37.003368] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.749 13:47:37 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:57.055 13:47:37 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:57.313 [2024-11-29 13:47:37.574425] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:57.313 13:47:37 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:57.572 13:47:37 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:57.832 Malloc0 00:13:57.832 13:47:38 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.090 Delay0 00:13:58.090 13:47:38 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.350 13:47:38 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:58.607 NULL1 00:13:58.607 13:47:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:58.865 13:47:39 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2255369 00:13:58.865 13:47:39 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:58.865 13:47:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:13:58.865 13:47:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.122 EAL: No free 2048 kB hugepages reported on node 1 00:13:59.122 13:47:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.379 13:47:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:59.379 13:47:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:59.637 true 00:13:59.637 13:47:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:13:59.637 13:47:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.896 13:47:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.154 13:47:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:00.154 13:47:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:00.410 true 00:14:00.410 13:47:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:00.410 13:47:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.667 13:47:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.924 13:47:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:00.924 13:47:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:01.181 true 00:14:01.181 13:47:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:01.181 13:47:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.559 Read completed with error (sct=0, sc=11) 00:14:02.559 13:47:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.559 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.559 13:47:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:02.559 13:47:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:02.816 true 00:14:03.076 13:47:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:03.076 13:47:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.076 13:47:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.335 13:47:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:03.335 13:47:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:03.593 true 00:14:03.593 13:47:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:03.593 13:47:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.527 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:04.527 13:47:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.785 13:47:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:04.785 13:47:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:05.043 true 00:14:05.043 13:47:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:05.043 13:47:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.300 13:47:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.557 13:47:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:05.557 13:47:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:05.815 true 00:14:05.815 13:47:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:05.815 13:47:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.751 13:47:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.751 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.008 13:47:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:07.009 13:47:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:07.267 true 00:14:07.267 13:47:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:07.267 13:47:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.524 13:47:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.782 13:47:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:07.782 13:47:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:08.040 true 00:14:08.040 13:47:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:08.041 13:47:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.298 13:47:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.559 13:47:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:08.559 13:47:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:08.559 true 00:14:08.818 13:47:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:08.818 13:47:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.755 13:47:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.013 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.013 13:47:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:10.013 13:47:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:10.270 true 00:14:10.270 13:47:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:10.270 13:47:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.528 13:47:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.787 13:47:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:10.787 13:47:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:11.044 true 00:14:11.044 13:47:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:11.044 13:47:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.978 13:47:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.235 13:47:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:12.235 13:47:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:12.493 true 00:14:12.493 13:47:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:12.493 13:47:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.750 13:47:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.008 13:47:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:13.008 13:47:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:13.266 true 00:14:13.266 13:47:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:13.266 13:47:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.197 13:47:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.455 13:47:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:14.455 13:47:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:14.712 true 00:14:14.712 13:47:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:14.712 13:47:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.975 13:47:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.234 13:47:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:15.234 13:47:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:15.492 true 00:14:15.492 13:47:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:15.492 13:47:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.057 13:47:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.315 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.315 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.573 13:47:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:16.573 13:47:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:16.573 true 00:14:16.830 13:47:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:16.830 13:47:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.088 13:47:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.088 13:47:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:17.088 13:47:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:17.345 true 00:14:17.345 13:47:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:17.345 13:47:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.330 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:18.330 13:47:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.624 13:47:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:18.624 13:47:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:18.882 true 00:14:18.882 13:47:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:18.882 13:47:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.139 13:47:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.397 13:47:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:19.397 13:47:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:19.655 true 00:14:19.655 13:47:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:19.655 13:47:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.590 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.590 13:48:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.590 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.590 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.848 13:48:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:20.848 13:48:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:21.106 true 00:14:21.106 13:48:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:21.106 13:48:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.363 13:48:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.620 13:48:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:21.620 13:48:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:21.878 true 00:14:21.878 13:48:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:21.878 13:48:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.810 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.810 13:48:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.810 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.810 13:48:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:22.810 13:48:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:23.067 true 00:14:23.067 13:48:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:23.067 13:48:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.323 13:48:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.580 13:48:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:23.580 13:48:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:23.837 true 00:14:23.837 13:48:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:23.837 13:48:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.771 13:48:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.027 13:48:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:25.027 13:48:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:25.284 true 00:14:25.284 13:48:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:25.284 13:48:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.541 13:48:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.799 13:48:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:25.799 13:48:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:26.056 true 00:14:26.056 13:48:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:26.056 13:48:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.988 13:48:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.988 13:48:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:26.988 13:48:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:27.244 true 00:14:27.244 13:48:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:27.244 13:48:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.500 13:48:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.064 13:48:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:28.064 13:48:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:28.064 true 00:14:28.064 13:48:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:28.064 13:48:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.321 13:48:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.578 13:48:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:28.578 13:48:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:28.835 true 00:14:28.835 13:48:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:28.835 13:48:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.208 Initializing NVMe Controllers 00:14:30.208 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:30.208 Controller IO queue size 128, less than required. 00:14:30.208 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:30.208 Controller IO queue size 128, less than required. 00:14:30.208 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:30.208 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:30.208 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:30.208 Initialization complete. Launching workers. 00:14:30.208 ======================================================== 00:14:30.208 Latency(us) 00:14:30.208 Device Information : IOPS MiB/s Average min max 00:14:30.208 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 540.87 0.26 112934.65 2447.20 1111325.80 00:14:30.208 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10821.83 5.28 11793.33 1626.86 460076.94 00:14:30.208 ======================================================== 00:14:30.208 Total : 11362.70 5.55 16607.68 1626.86 1111325.80 00:14:30.208 00:14:30.208 13:48:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.208 13:48:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:14:30.208 13:48:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:14:30.465 true 00:14:30.465 13:48:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2255369 00:14:30.465 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2255369) - No such process 00:14:30.465 13:48:10 -- target/ns_hotplug_stress.sh@53 -- # wait 2255369 00:14:30.465 13:48:10 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.724 13:48:10 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.981 13:48:11 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:30.981 13:48:11 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:30.981 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:30.981 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:30.981 13:48:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:31.239 null0 00:14:31.239 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.239 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.239 13:48:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:31.497 null1 00:14:31.497 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.497 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.497 13:48:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:31.755 null2 00:14:31.755 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.755 13:48:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.755 13:48:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:32.013 null3 00:14:32.013 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.013 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.013 13:48:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:32.271 null4 00:14:32.271 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.271 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.271 13:48:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:32.528 null5 00:14:32.528 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.528 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.528 13:48:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:32.785 null6 00:14:32.785 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.785 13:48:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.785 13:48:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:33.043 null7 00:14:33.043 13:48:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.043 13:48:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.043 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@66 -- # wait 2260237 2260239 2260242 2260245 2260248 2260252 2260255 2260258 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.044 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.303 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.561 13:48:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.820 13:48:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.086 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.087 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.345 13:48:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.604 13:48:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.864 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.121 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.121 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.122 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.380 13:48:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.639 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.898 13:48:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.156 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.415 13:48:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.674 13:48:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.932 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.191 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.449 13:48:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.708 13:48:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.966 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.967 13:48:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.225 13:48:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:38.484 13:48:18 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:38.484 13:48:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:38.484 13:48:18 -- nvmf/common.sh@116 -- # sync 00:14:38.484 13:48:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:38.484 13:48:18 -- nvmf/common.sh@119 -- # set +e 00:14:38.484 13:48:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:38.484 13:48:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:38.484 rmmod nvme_tcp 00:14:38.484 rmmod nvme_fabrics 00:14:38.742 rmmod nvme_keyring 00:14:38.742 13:48:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:38.742 13:48:18 -- nvmf/common.sh@123 -- # set -e 00:14:38.742 13:48:18 -- nvmf/common.sh@124 -- # return 0 00:14:38.742 13:48:18 -- nvmf/common.sh@477 -- # '[' -n 2254924 ']' 00:14:38.742 13:48:18 -- nvmf/common.sh@478 -- # killprocess 2254924 00:14:38.742 13:48:18 -- common/autotest_common.sh@936 -- # '[' -z 2254924 ']' 00:14:38.742 13:48:18 -- common/autotest_common.sh@940 -- # kill -0 2254924 00:14:38.742 13:48:18 -- common/autotest_common.sh@941 -- # uname 00:14:38.742 13:48:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:38.742 13:48:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2254924 00:14:38.742 13:48:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:38.742 13:48:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:38.742 13:48:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2254924' 00:14:38.742 killing process with pid 2254924 00:14:38.742 13:48:18 -- common/autotest_common.sh@955 -- # kill 2254924 00:14:38.742 13:48:18 -- common/autotest_common.sh@960 -- # wait 2254924 00:14:39.001 13:48:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:39.001 13:48:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:39.001 13:48:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:39.001 13:48:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:39.001 13:48:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:39.001 13:48:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:39.001 13:48:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:39.001 13:48:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.912 13:48:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:40.912 00:14:40.912 real 0m47.765s 00:14:40.912 user 3m36.810s 00:14:40.912 sys 0m16.336s 00:14:40.912 13:48:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:40.912 13:48:21 -- common/autotest_common.sh@10 -- # set +x 00:14:40.912 ************************************ 00:14:40.912 END TEST nvmf_ns_hotplug_stress 00:14:40.912 ************************************ 00:14:40.912 13:48:21 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:40.912 13:48:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:40.912 13:48:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:40.912 13:48:21 -- common/autotest_common.sh@10 -- # set +x 00:14:40.913 ************************************ 00:14:40.913 START TEST nvmf_connect_stress 00:14:40.913 ************************************ 00:14:40.913 13:48:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:40.913 * Looking for test storage... 00:14:40.913 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:40.913 13:48:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:40.913 13:48:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:40.913 13:48:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:41.172 13:48:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:41.172 13:48:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:41.172 13:48:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:41.172 13:48:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:41.172 13:48:21 -- scripts/common.sh@335 -- # IFS=.-: 00:14:41.172 13:48:21 -- scripts/common.sh@335 -- # read -ra ver1 00:14:41.172 13:48:21 -- scripts/common.sh@336 -- # IFS=.-: 00:14:41.172 13:48:21 -- scripts/common.sh@336 -- # read -ra ver2 00:14:41.172 13:48:21 -- scripts/common.sh@337 -- # local 'op=<' 00:14:41.172 13:48:21 -- scripts/common.sh@339 -- # ver1_l=2 00:14:41.172 13:48:21 -- scripts/common.sh@340 -- # ver2_l=1 00:14:41.172 13:48:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:41.172 13:48:21 -- scripts/common.sh@343 -- # case "$op" in 00:14:41.172 13:48:21 -- scripts/common.sh@344 -- # : 1 00:14:41.172 13:48:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:41.172 13:48:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:41.172 13:48:21 -- scripts/common.sh@364 -- # decimal 1 00:14:41.172 13:48:21 -- scripts/common.sh@352 -- # local d=1 00:14:41.172 13:48:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:41.172 13:48:21 -- scripts/common.sh@354 -- # echo 1 00:14:41.172 13:48:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:41.172 13:48:21 -- scripts/common.sh@365 -- # decimal 2 00:14:41.172 13:48:21 -- scripts/common.sh@352 -- # local d=2 00:14:41.172 13:48:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:41.172 13:48:21 -- scripts/common.sh@354 -- # echo 2 00:14:41.172 13:48:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:41.172 13:48:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:41.172 13:48:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:41.172 13:48:21 -- scripts/common.sh@367 -- # return 0 00:14:41.172 13:48:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:41.172 13:48:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:41.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.172 --rc genhtml_branch_coverage=1 00:14:41.172 --rc genhtml_function_coverage=1 00:14:41.172 --rc genhtml_legend=1 00:14:41.172 --rc geninfo_all_blocks=1 00:14:41.172 --rc geninfo_unexecuted_blocks=1 00:14:41.172 00:14:41.172 ' 00:14:41.172 13:48:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:41.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.172 --rc genhtml_branch_coverage=1 00:14:41.172 --rc genhtml_function_coverage=1 00:14:41.172 --rc genhtml_legend=1 00:14:41.172 --rc geninfo_all_blocks=1 00:14:41.172 --rc geninfo_unexecuted_blocks=1 00:14:41.172 00:14:41.172 ' 00:14:41.172 13:48:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:41.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.172 --rc genhtml_branch_coverage=1 00:14:41.172 --rc genhtml_function_coverage=1 00:14:41.172 --rc genhtml_legend=1 00:14:41.172 --rc geninfo_all_blocks=1 00:14:41.172 --rc geninfo_unexecuted_blocks=1 00:14:41.172 00:14:41.172 ' 00:14:41.172 13:48:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:41.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.172 --rc genhtml_branch_coverage=1 00:14:41.172 --rc genhtml_function_coverage=1 00:14:41.172 --rc genhtml_legend=1 00:14:41.172 --rc geninfo_all_blocks=1 00:14:41.172 --rc geninfo_unexecuted_blocks=1 00:14:41.172 00:14:41.172 ' 00:14:41.172 13:48:21 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:41.172 13:48:21 -- nvmf/common.sh@7 -- # uname -s 00:14:41.172 13:48:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:41.172 13:48:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:41.172 13:48:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:41.172 13:48:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:41.172 13:48:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:41.173 13:48:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:41.173 13:48:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:41.173 13:48:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:41.173 13:48:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:41.173 13:48:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:41.173 13:48:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.173 13:48:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.173 13:48:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:41.173 13:48:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:41.173 13:48:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:41.173 13:48:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:41.173 13:48:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:41.173 13:48:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:41.173 13:48:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:41.173 13:48:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.173 13:48:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.173 13:48:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.173 13:48:21 -- paths/export.sh@5 -- # export PATH 00:14:41.173 13:48:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.173 13:48:21 -- nvmf/common.sh@46 -- # : 0 00:14:41.173 13:48:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:41.173 13:48:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:41.173 13:48:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:41.173 13:48:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:41.173 13:48:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:41.173 13:48:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:41.173 13:48:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:41.173 13:48:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:41.173 13:48:21 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:41.173 13:48:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:41.173 13:48:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:41.173 13:48:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:41.173 13:48:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:41.173 13:48:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:41.173 13:48:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.173 13:48:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.173 13:48:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.173 13:48:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:41.173 13:48:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:41.173 13:48:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:41.173 13:48:21 -- common/autotest_common.sh@10 -- # set +x 00:14:43.706 13:48:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:43.706 13:48:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:43.706 13:48:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:43.706 13:48:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:43.706 13:48:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:43.706 13:48:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:43.706 13:48:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:43.706 13:48:23 -- nvmf/common.sh@294 -- # net_devs=() 00:14:43.706 13:48:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:43.706 13:48:23 -- nvmf/common.sh@295 -- # e810=() 00:14:43.706 13:48:23 -- nvmf/common.sh@295 -- # local -ga e810 00:14:43.706 13:48:23 -- nvmf/common.sh@296 -- # x722=() 00:14:43.706 13:48:23 -- nvmf/common.sh@296 -- # local -ga x722 00:14:43.706 13:48:23 -- nvmf/common.sh@297 -- # mlx=() 00:14:43.706 13:48:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:43.706 13:48:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:43.706 13:48:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.706 13:48:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:43.706 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:43.706 13:48:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.706 13:48:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:43.706 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:43.706 13:48:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.706 13:48:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.706 13:48:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.706 13:48:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:43.706 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:43.706 13:48:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.706 13:48:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.706 13:48:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.706 13:48:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:43.706 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:43.706 13:48:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:43.706 13:48:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:43.706 13:48:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:43.706 13:48:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:43.706 13:48:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:43.706 13:48:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:43.706 13:48:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:43.706 13:48:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:43.706 13:48:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:43.706 13:48:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:43.706 13:48:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:43.706 13:48:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:43.706 13:48:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:43.706 13:48:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:43.706 13:48:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:43.706 13:48:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:43.706 13:48:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:43.706 13:48:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:43.706 13:48:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:43.706 13:48:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:43.706 13:48:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:43.706 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:43.706 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:14:43.706 00:14:43.706 --- 10.0.0.2 ping statistics --- 00:14:43.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.706 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:14:43.706 13:48:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:43.706 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:43.706 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:14:43.706 00:14:43.706 --- 10.0.0.1 ping statistics --- 00:14:43.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.706 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:14:43.706 13:48:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:43.706 13:48:23 -- nvmf/common.sh@410 -- # return 0 00:14:43.706 13:48:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:43.706 13:48:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:43.706 13:48:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:43.706 13:48:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:43.706 13:48:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:43.706 13:48:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:43.706 13:48:23 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:43.706 13:48:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:43.706 13:48:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:43.706 13:48:23 -- common/autotest_common.sh@10 -- # set +x 00:14:43.706 13:48:23 -- nvmf/common.sh@469 -- # nvmfpid=2263100 00:14:43.706 13:48:23 -- nvmf/common.sh@470 -- # waitforlisten 2263100 00:14:43.706 13:48:23 -- common/autotest_common.sh@829 -- # '[' -z 2263100 ']' 00:14:43.706 13:48:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:43.706 13:48:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:43.706 13:48:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:43.706 13:48:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:43.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:43.706 13:48:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:43.706 13:48:23 -- common/autotest_common.sh@10 -- # set +x 00:14:43.706 [2024-11-29 13:48:23.576138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:43.706 [2024-11-29 13:48:23.576219] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:43.706 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.706 [2024-11-29 13:48:23.645629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:43.706 [2024-11-29 13:48:23.734346] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:43.706 [2024-11-29 13:48:23.734532] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:43.706 [2024-11-29 13:48:23.734554] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:43.706 [2024-11-29 13:48:23.734569] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:43.707 [2024-11-29 13:48:23.734682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:43.707 [2024-11-29 13:48:23.734776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:43.707 [2024-11-29 13:48:23.734779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:44.273 13:48:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:44.273 13:48:24 -- common/autotest_common.sh@862 -- # return 0 00:14:44.273 13:48:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:44.273 13:48:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:44.273 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.531 13:48:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:44.531 13:48:24 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:44.531 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.531 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.531 [2024-11-29 13:48:24.579404] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:44.531 13:48:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.531 13:48:24 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:44.531 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.531 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.531 13:48:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.531 13:48:24 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:44.531 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.531 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.531 [2024-11-29 13:48:24.604542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:44.531 13:48:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.531 13:48:24 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:44.531 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.531 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.531 NULL1 00:14:44.531 13:48:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.531 13:48:24 -- target/connect_stress.sh@21 -- # PERF_PID=2263260 00:14:44.531 13:48:24 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:44.531 13:48:24 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:44.531 13:48:24 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.531 13:48:24 -- target/connect_stress.sh@28 -- # cat 00:14:44.531 13:48:24 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:44.531 13:48:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.531 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.531 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:44.789 13:48:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.789 13:48:24 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:44.789 13:48:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.789 13:48:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.789 13:48:24 -- common/autotest_common.sh@10 -- # set +x 00:14:45.046 13:48:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.046 13:48:25 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:45.046 13:48:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.046 13:48:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.046 13:48:25 -- common/autotest_common.sh@10 -- # set +x 00:14:45.610 13:48:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.610 13:48:25 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:45.610 13:48:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.610 13:48:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.610 13:48:25 -- common/autotest_common.sh@10 -- # set +x 00:14:45.868 13:48:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.868 13:48:25 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:45.868 13:48:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.868 13:48:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.868 13:48:25 -- common/autotest_common.sh@10 -- # set +x 00:14:46.126 13:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.126 13:48:26 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:46.126 13:48:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.126 13:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.126 13:48:26 -- common/autotest_common.sh@10 -- # set +x 00:14:46.385 13:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.385 13:48:26 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:46.385 13:48:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.385 13:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.385 13:48:26 -- common/autotest_common.sh@10 -- # set +x 00:14:46.642 13:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.642 13:48:26 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:46.642 13:48:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.642 13:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.642 13:48:26 -- common/autotest_common.sh@10 -- # set +x 00:14:47.208 13:48:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.208 13:48:27 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:47.208 13:48:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.208 13:48:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.208 13:48:27 -- common/autotest_common.sh@10 -- # set +x 00:14:47.467 13:48:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.467 13:48:27 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:47.467 13:48:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.467 13:48:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.467 13:48:27 -- common/autotest_common.sh@10 -- # set +x 00:14:47.728 13:48:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.728 13:48:27 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:47.728 13:48:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.728 13:48:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.728 13:48:27 -- common/autotest_common.sh@10 -- # set +x 00:14:48.014 13:48:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.014 13:48:28 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:48.014 13:48:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.014 13:48:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.014 13:48:28 -- common/autotest_common.sh@10 -- # set +x 00:14:48.296 13:48:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.296 13:48:28 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:48.296 13:48:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.296 13:48:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.296 13:48:28 -- common/autotest_common.sh@10 -- # set +x 00:14:48.863 13:48:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.863 13:48:28 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:48.863 13:48:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.863 13:48:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.863 13:48:28 -- common/autotest_common.sh@10 -- # set +x 00:14:49.123 13:48:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.123 13:48:29 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:49.123 13:48:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.123 13:48:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.123 13:48:29 -- common/autotest_common.sh@10 -- # set +x 00:14:49.381 13:48:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.382 13:48:29 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:49.382 13:48:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.382 13:48:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.382 13:48:29 -- common/autotest_common.sh@10 -- # set +x 00:14:49.640 13:48:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.640 13:48:29 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:49.640 13:48:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.640 13:48:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.640 13:48:29 -- common/autotest_common.sh@10 -- # set +x 00:14:49.899 13:48:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.899 13:48:30 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:49.899 13:48:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.899 13:48:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.899 13:48:30 -- common/autotest_common.sh@10 -- # set +x 00:14:50.468 13:48:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.468 13:48:30 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:50.468 13:48:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.468 13:48:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.468 13:48:30 -- common/autotest_common.sh@10 -- # set +x 00:14:50.727 13:48:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.727 13:48:30 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:50.727 13:48:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.727 13:48:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.727 13:48:30 -- common/autotest_common.sh@10 -- # set +x 00:14:50.985 13:48:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.985 13:48:31 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:50.985 13:48:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.985 13:48:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.985 13:48:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.245 13:48:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.245 13:48:31 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:51.245 13:48:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.245 13:48:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.245 13:48:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.505 13:48:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.505 13:48:31 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:51.505 13:48:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.505 13:48:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.505 13:48:31 -- common/autotest_common.sh@10 -- # set +x 00:14:52.077 13:48:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.077 13:48:32 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:52.077 13:48:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.077 13:48:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.077 13:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:52.336 13:48:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.336 13:48:32 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:52.336 13:48:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.336 13:48:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.336 13:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:52.596 13:48:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.596 13:48:32 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:52.596 13:48:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.596 13:48:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.596 13:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:52.856 13:48:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.856 13:48:33 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:52.856 13:48:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.856 13:48:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.856 13:48:33 -- common/autotest_common.sh@10 -- # set +x 00:14:53.114 13:48:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.115 13:48:33 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:53.115 13:48:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.115 13:48:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.115 13:48:33 -- common/autotest_common.sh@10 -- # set +x 00:14:53.683 13:48:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.683 13:48:33 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:53.683 13:48:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.683 13:48:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.683 13:48:33 -- common/autotest_common.sh@10 -- # set +x 00:14:53.942 13:48:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.942 13:48:33 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:53.942 13:48:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.942 13:48:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.942 13:48:33 -- common/autotest_common.sh@10 -- # set +x 00:14:54.200 13:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.200 13:48:34 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:54.200 13:48:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.200 13:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.200 13:48:34 -- common/autotest_common.sh@10 -- # set +x 00:14:54.458 13:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.458 13:48:34 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:54.458 13:48:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.458 13:48:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.458 13:48:34 -- common/autotest_common.sh@10 -- # set +x 00:14:54.458 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:54.717 13:48:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.717 13:48:34 -- target/connect_stress.sh@34 -- # kill -0 2263260 00:14:54.717 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2263260) - No such process 00:14:54.717 13:48:34 -- target/connect_stress.sh@38 -- # wait 2263260 00:14:54.717 13:48:34 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:54.717 13:48:34 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:54.717 13:48:34 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:54.717 13:48:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:54.717 13:48:34 -- nvmf/common.sh@116 -- # sync 00:14:54.717 13:48:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:54.717 13:48:34 -- nvmf/common.sh@119 -- # set +e 00:14:54.717 13:48:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:54.717 13:48:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:54.717 rmmod nvme_tcp 00:14:54.717 rmmod nvme_fabrics 00:14:54.717 rmmod nvme_keyring 00:14:54.717 13:48:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:54.976 13:48:35 -- nvmf/common.sh@123 -- # set -e 00:14:54.976 13:48:35 -- nvmf/common.sh@124 -- # return 0 00:14:54.976 13:48:35 -- nvmf/common.sh@477 -- # '[' -n 2263100 ']' 00:14:54.976 13:48:35 -- nvmf/common.sh@478 -- # killprocess 2263100 00:14:54.976 13:48:35 -- common/autotest_common.sh@936 -- # '[' -z 2263100 ']' 00:14:54.976 13:48:35 -- common/autotest_common.sh@940 -- # kill -0 2263100 00:14:54.976 13:48:35 -- common/autotest_common.sh@941 -- # uname 00:14:54.976 13:48:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:54.976 13:48:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2263100 00:14:54.976 13:48:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:54.976 13:48:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:54.976 13:48:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2263100' 00:14:54.976 killing process with pid 2263100 00:14:54.976 13:48:35 -- common/autotest_common.sh@955 -- # kill 2263100 00:14:54.976 13:48:35 -- common/autotest_common.sh@960 -- # wait 2263100 00:14:55.237 13:48:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:55.237 13:48:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:55.237 13:48:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:55.237 13:48:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:55.237 13:48:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:55.237 13:48:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.237 13:48:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.237 13:48:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.151 13:48:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:57.151 00:14:57.151 real 0m16.172s 00:14:57.151 user 0m40.893s 00:14:57.151 sys 0m5.900s 00:14:57.151 13:48:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:57.151 13:48:37 -- common/autotest_common.sh@10 -- # set +x 00:14:57.151 ************************************ 00:14:57.151 END TEST nvmf_connect_stress 00:14:57.151 ************************************ 00:14:57.151 13:48:37 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:57.151 13:48:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.151 13:48:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.151 13:48:37 -- common/autotest_common.sh@10 -- # set +x 00:14:57.151 ************************************ 00:14:57.151 START TEST nvmf_fused_ordering 00:14:57.151 ************************************ 00:14:57.151 13:48:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:57.151 * Looking for test storage... 00:14:57.151 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.151 13:48:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.151 13:48:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.151 13:48:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.411 13:48:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.411 13:48:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.411 13:48:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.411 13:48:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.411 13:48:37 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.411 13:48:37 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.411 13:48:37 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.411 13:48:37 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.412 13:48:37 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.412 13:48:37 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.412 13:48:37 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.412 13:48:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.412 13:48:37 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.412 13:48:37 -- scripts/common.sh@344 -- # : 1 00:14:57.412 13:48:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.412 13:48:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.412 13:48:37 -- scripts/common.sh@364 -- # decimal 1 00:14:57.412 13:48:37 -- scripts/common.sh@352 -- # local d=1 00:14:57.412 13:48:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.412 13:48:37 -- scripts/common.sh@354 -- # echo 1 00:14:57.412 13:48:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.412 13:48:37 -- scripts/common.sh@365 -- # decimal 2 00:14:57.412 13:48:37 -- scripts/common.sh@352 -- # local d=2 00:14:57.412 13:48:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.412 13:48:37 -- scripts/common.sh@354 -- # echo 2 00:14:57.412 13:48:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.412 13:48:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.412 13:48:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.412 13:48:37 -- scripts/common.sh@367 -- # return 0 00:14:57.412 13:48:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.412 13:48:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.412 --rc genhtml_branch_coverage=1 00:14:57.412 --rc genhtml_function_coverage=1 00:14:57.412 --rc genhtml_legend=1 00:14:57.412 --rc geninfo_all_blocks=1 00:14:57.412 --rc geninfo_unexecuted_blocks=1 00:14:57.412 00:14:57.412 ' 00:14:57.412 13:48:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.412 --rc genhtml_branch_coverage=1 00:14:57.412 --rc genhtml_function_coverage=1 00:14:57.412 --rc genhtml_legend=1 00:14:57.412 --rc geninfo_all_blocks=1 00:14:57.412 --rc geninfo_unexecuted_blocks=1 00:14:57.412 00:14:57.412 ' 00:14:57.412 13:48:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.412 --rc genhtml_branch_coverage=1 00:14:57.412 --rc genhtml_function_coverage=1 00:14:57.412 --rc genhtml_legend=1 00:14:57.412 --rc geninfo_all_blocks=1 00:14:57.412 --rc geninfo_unexecuted_blocks=1 00:14:57.412 00:14:57.412 ' 00:14:57.412 13:48:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.412 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.412 --rc genhtml_branch_coverage=1 00:14:57.412 --rc genhtml_function_coverage=1 00:14:57.412 --rc genhtml_legend=1 00:14:57.412 --rc geninfo_all_blocks=1 00:14:57.412 --rc geninfo_unexecuted_blocks=1 00:14:57.412 00:14:57.412 ' 00:14:57.412 13:48:37 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.412 13:48:37 -- nvmf/common.sh@7 -- # uname -s 00:14:57.412 13:48:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.412 13:48:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.412 13:48:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.412 13:48:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.412 13:48:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.412 13:48:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.412 13:48:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.412 13:48:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.412 13:48:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.412 13:48:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.412 13:48:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.412 13:48:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.412 13:48:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.412 13:48:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.412 13:48:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.412 13:48:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.412 13:48:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.412 13:48:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.412 13:48:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.412 13:48:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.412 13:48:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.412 13:48:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.412 13:48:37 -- paths/export.sh@5 -- # export PATH 00:14:57.412 13:48:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.412 13:48:37 -- nvmf/common.sh@46 -- # : 0 00:14:57.412 13:48:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.412 13:48:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.412 13:48:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.412 13:48:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.412 13:48:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.412 13:48:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.412 13:48:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.412 13:48:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.412 13:48:37 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:57.412 13:48:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:57.412 13:48:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:57.412 13:48:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:57.412 13:48:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:57.412 13:48:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:57.412 13:48:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.412 13:48:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.412 13:48:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.412 13:48:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:57.412 13:48:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:57.412 13:48:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:57.412 13:48:37 -- common/autotest_common.sh@10 -- # set +x 00:14:59.320 13:48:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.320 13:48:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.320 13:48:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.320 13:48:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.320 13:48:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.320 13:48:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.320 13:48:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.320 13:48:39 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.320 13:48:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.320 13:48:39 -- nvmf/common.sh@295 -- # e810=() 00:14:59.320 13:48:39 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.320 13:48:39 -- nvmf/common.sh@296 -- # x722=() 00:14:59.320 13:48:39 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.320 13:48:39 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.320 13:48:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.320 13:48:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.320 13:48:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.320 13:48:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.320 13:48:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.320 13:48:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:59.320 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:59.320 13:48:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.320 13:48:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:59.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:59.320 13:48:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.320 13:48:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.320 13:48:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.320 13:48:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:59.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:59.320 13:48:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.320 13:48:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.320 13:48:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.320 13:48:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.320 13:48:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:59.320 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:59.320 13:48:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.320 13:48:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.320 13:48:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.320 13:48:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.320 13:48:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.320 13:48:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.320 13:48:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.320 13:48:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.320 13:48:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.320 13:48:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.321 13:48:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.321 13:48:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.321 13:48:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.321 13:48:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.321 13:48:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.321 13:48:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.321 13:48:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.321 13:48:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.321 13:48:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.321 13:48:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.321 13:48:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:59.321 13:48:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:59.321 13:48:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:59.321 13:48:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:59.321 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.321 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:14:59.321 00:14:59.321 --- 10.0.0.2 ping statistics --- 00:14:59.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.321 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:14:59.321 13:48:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:59.321 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.321 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:14:59.321 00:14:59.321 --- 10.0.0.1 ping statistics --- 00:14:59.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.321 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:14:59.321 13:48:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.321 13:48:39 -- nvmf/common.sh@410 -- # return 0 00:14:59.321 13:48:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:59.321 13:48:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.321 13:48:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:59.321 13:48:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:59.321 13:48:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.321 13:48:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:59.321 13:48:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:59.321 13:48:39 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:59.321 13:48:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:59.321 13:48:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:59.321 13:48:39 -- common/autotest_common.sh@10 -- # set +x 00:14:59.321 13:48:39 -- nvmf/common.sh@469 -- # nvmfpid=2266456 00:14:59.321 13:48:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:59.321 13:48:39 -- nvmf/common.sh@470 -- # waitforlisten 2266456 00:14:59.321 13:48:39 -- common/autotest_common.sh@829 -- # '[' -z 2266456 ']' 00:14:59.321 13:48:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.321 13:48:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.321 13:48:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.321 13:48:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.321 13:48:39 -- common/autotest_common.sh@10 -- # set +x 00:14:59.321 [2024-11-29 13:48:39.578081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.321 [2024-11-29 13:48:39.578148] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.581 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.581 [2024-11-29 13:48:39.642880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:59.581 [2024-11-29 13:48:39.732001] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:59.581 [2024-11-29 13:48:39.732163] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.581 [2024-11-29 13:48:39.732180] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.581 [2024-11-29 13:48:39.732193] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.581 [2024-11-29 13:48:39.732221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.518 13:48:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:00.518 13:48:40 -- common/autotest_common.sh@862 -- # return 0 00:15:00.518 13:48:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:00.518 13:48:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 13:48:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.518 13:48:40 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 [2024-11-29 13:48:40.594323] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 [2024-11-29 13:48:40.610514] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 NULL1 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:00.518 13:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.518 13:48:40 -- common/autotest_common.sh@10 -- # set +x 00:15:00.518 13:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.518 13:48:40 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:00.518 [2024-11-29 13:48:40.655784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:00.518 [2024-11-29 13:48:40.655825] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2266609 ] 00:15:00.518 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.085 Attached to nqn.2016-06.io.spdk:cnode1 00:15:01.085 Namespace ID: 1 size: 1GB 00:15:01.085 fused_ordering(0) 00:15:01.085 fused_ordering(1) 00:15:01.085 fused_ordering(2) 00:15:01.085 fused_ordering(3) 00:15:01.085 fused_ordering(4) 00:15:01.085 fused_ordering(5) 00:15:01.085 fused_ordering(6) 00:15:01.085 fused_ordering(7) 00:15:01.085 fused_ordering(8) 00:15:01.085 fused_ordering(9) 00:15:01.085 fused_ordering(10) 00:15:01.085 fused_ordering(11) 00:15:01.085 fused_ordering(12) 00:15:01.085 fused_ordering(13) 00:15:01.085 fused_ordering(14) 00:15:01.085 fused_ordering(15) 00:15:01.085 fused_ordering(16) 00:15:01.085 fused_ordering(17) 00:15:01.085 fused_ordering(18) 00:15:01.085 fused_ordering(19) 00:15:01.085 fused_ordering(20) 00:15:01.085 fused_ordering(21) 00:15:01.085 fused_ordering(22) 00:15:01.085 fused_ordering(23) 00:15:01.085 fused_ordering(24) 00:15:01.085 fused_ordering(25) 00:15:01.085 fused_ordering(26) 00:15:01.085 fused_ordering(27) 00:15:01.085 fused_ordering(28) 00:15:01.085 fused_ordering(29) 00:15:01.085 fused_ordering(30) 00:15:01.085 fused_ordering(31) 00:15:01.085 fused_ordering(32) 00:15:01.085 fused_ordering(33) 00:15:01.085 fused_ordering(34) 00:15:01.085 fused_ordering(35) 00:15:01.085 fused_ordering(36) 00:15:01.085 fused_ordering(37) 00:15:01.085 fused_ordering(38) 00:15:01.085 fused_ordering(39) 00:15:01.085 fused_ordering(40) 00:15:01.085 fused_ordering(41) 00:15:01.085 fused_ordering(42) 00:15:01.085 fused_ordering(43) 00:15:01.085 fused_ordering(44) 00:15:01.085 fused_ordering(45) 00:15:01.085 fused_ordering(46) 00:15:01.085 fused_ordering(47) 00:15:01.085 fused_ordering(48) 00:15:01.085 fused_ordering(49) 00:15:01.085 fused_ordering(50) 00:15:01.085 fused_ordering(51) 00:15:01.085 fused_ordering(52) 00:15:01.085 fused_ordering(53) 00:15:01.085 fused_ordering(54) 00:15:01.085 fused_ordering(55) 00:15:01.085 fused_ordering(56) 00:15:01.085 fused_ordering(57) 00:15:01.085 fused_ordering(58) 00:15:01.085 fused_ordering(59) 00:15:01.085 fused_ordering(60) 00:15:01.085 fused_ordering(61) 00:15:01.085 fused_ordering(62) 00:15:01.085 fused_ordering(63) 00:15:01.085 fused_ordering(64) 00:15:01.085 fused_ordering(65) 00:15:01.085 fused_ordering(66) 00:15:01.085 fused_ordering(67) 00:15:01.085 fused_ordering(68) 00:15:01.085 fused_ordering(69) 00:15:01.085 fused_ordering(70) 00:15:01.085 fused_ordering(71) 00:15:01.085 fused_ordering(72) 00:15:01.085 fused_ordering(73) 00:15:01.085 fused_ordering(74) 00:15:01.085 fused_ordering(75) 00:15:01.085 fused_ordering(76) 00:15:01.085 fused_ordering(77) 00:15:01.085 fused_ordering(78) 00:15:01.085 fused_ordering(79) 00:15:01.085 fused_ordering(80) 00:15:01.085 fused_ordering(81) 00:15:01.085 fused_ordering(82) 00:15:01.085 fused_ordering(83) 00:15:01.085 fused_ordering(84) 00:15:01.085 fused_ordering(85) 00:15:01.085 fused_ordering(86) 00:15:01.085 fused_ordering(87) 00:15:01.085 fused_ordering(88) 00:15:01.085 fused_ordering(89) 00:15:01.085 fused_ordering(90) 00:15:01.085 fused_ordering(91) 00:15:01.085 fused_ordering(92) 00:15:01.085 fused_ordering(93) 00:15:01.085 fused_ordering(94) 00:15:01.085 fused_ordering(95) 00:15:01.085 fused_ordering(96) 00:15:01.085 fused_ordering(97) 00:15:01.085 fused_ordering(98) 00:15:01.085 fused_ordering(99) 00:15:01.085 fused_ordering(100) 00:15:01.085 fused_ordering(101) 00:15:01.085 fused_ordering(102) 00:15:01.085 fused_ordering(103) 00:15:01.085 fused_ordering(104) 00:15:01.085 fused_ordering(105) 00:15:01.085 fused_ordering(106) 00:15:01.085 fused_ordering(107) 00:15:01.085 fused_ordering(108) 00:15:01.085 fused_ordering(109) 00:15:01.085 fused_ordering(110) 00:15:01.085 fused_ordering(111) 00:15:01.085 fused_ordering(112) 00:15:01.085 fused_ordering(113) 00:15:01.085 fused_ordering(114) 00:15:01.085 fused_ordering(115) 00:15:01.085 fused_ordering(116) 00:15:01.085 fused_ordering(117) 00:15:01.085 fused_ordering(118) 00:15:01.085 fused_ordering(119) 00:15:01.085 fused_ordering(120) 00:15:01.085 fused_ordering(121) 00:15:01.085 fused_ordering(122) 00:15:01.085 fused_ordering(123) 00:15:01.085 fused_ordering(124) 00:15:01.085 fused_ordering(125) 00:15:01.085 fused_ordering(126) 00:15:01.085 fused_ordering(127) 00:15:01.085 fused_ordering(128) 00:15:01.085 fused_ordering(129) 00:15:01.085 fused_ordering(130) 00:15:01.085 fused_ordering(131) 00:15:01.085 fused_ordering(132) 00:15:01.085 fused_ordering(133) 00:15:01.085 fused_ordering(134) 00:15:01.085 fused_ordering(135) 00:15:01.085 fused_ordering(136) 00:15:01.085 fused_ordering(137) 00:15:01.085 fused_ordering(138) 00:15:01.085 fused_ordering(139) 00:15:01.085 fused_ordering(140) 00:15:01.085 fused_ordering(141) 00:15:01.085 fused_ordering(142) 00:15:01.085 fused_ordering(143) 00:15:01.085 fused_ordering(144) 00:15:01.085 fused_ordering(145) 00:15:01.085 fused_ordering(146) 00:15:01.085 fused_ordering(147) 00:15:01.085 fused_ordering(148) 00:15:01.085 fused_ordering(149) 00:15:01.085 fused_ordering(150) 00:15:01.085 fused_ordering(151) 00:15:01.085 fused_ordering(152) 00:15:01.085 fused_ordering(153) 00:15:01.085 fused_ordering(154) 00:15:01.085 fused_ordering(155) 00:15:01.085 fused_ordering(156) 00:15:01.085 fused_ordering(157) 00:15:01.085 fused_ordering(158) 00:15:01.085 fused_ordering(159) 00:15:01.085 fused_ordering(160) 00:15:01.085 fused_ordering(161) 00:15:01.085 fused_ordering(162) 00:15:01.085 fused_ordering(163) 00:15:01.085 fused_ordering(164) 00:15:01.085 fused_ordering(165) 00:15:01.085 fused_ordering(166) 00:15:01.085 fused_ordering(167) 00:15:01.085 fused_ordering(168) 00:15:01.085 fused_ordering(169) 00:15:01.085 fused_ordering(170) 00:15:01.085 fused_ordering(171) 00:15:01.085 fused_ordering(172) 00:15:01.085 fused_ordering(173) 00:15:01.085 fused_ordering(174) 00:15:01.085 fused_ordering(175) 00:15:01.085 fused_ordering(176) 00:15:01.085 fused_ordering(177) 00:15:01.085 fused_ordering(178) 00:15:01.085 fused_ordering(179) 00:15:01.085 fused_ordering(180) 00:15:01.085 fused_ordering(181) 00:15:01.085 fused_ordering(182) 00:15:01.085 fused_ordering(183) 00:15:01.085 fused_ordering(184) 00:15:01.085 fused_ordering(185) 00:15:01.085 fused_ordering(186) 00:15:01.085 fused_ordering(187) 00:15:01.085 fused_ordering(188) 00:15:01.085 fused_ordering(189) 00:15:01.085 fused_ordering(190) 00:15:01.085 fused_ordering(191) 00:15:01.085 fused_ordering(192) 00:15:01.085 fused_ordering(193) 00:15:01.085 fused_ordering(194) 00:15:01.085 fused_ordering(195) 00:15:01.085 fused_ordering(196) 00:15:01.085 fused_ordering(197) 00:15:01.085 fused_ordering(198) 00:15:01.085 fused_ordering(199) 00:15:01.085 fused_ordering(200) 00:15:01.085 fused_ordering(201) 00:15:01.085 fused_ordering(202) 00:15:01.085 fused_ordering(203) 00:15:01.085 fused_ordering(204) 00:15:01.085 fused_ordering(205) 00:15:01.345 fused_ordering(206) 00:15:01.345 fused_ordering(207) 00:15:01.345 fused_ordering(208) 00:15:01.345 fused_ordering(209) 00:15:01.345 fused_ordering(210) 00:15:01.345 fused_ordering(211) 00:15:01.345 fused_ordering(212) 00:15:01.345 fused_ordering(213) 00:15:01.345 fused_ordering(214) 00:15:01.345 fused_ordering(215) 00:15:01.345 fused_ordering(216) 00:15:01.345 fused_ordering(217) 00:15:01.345 fused_ordering(218) 00:15:01.345 fused_ordering(219) 00:15:01.345 fused_ordering(220) 00:15:01.345 fused_ordering(221) 00:15:01.345 fused_ordering(222) 00:15:01.345 fused_ordering(223) 00:15:01.345 fused_ordering(224) 00:15:01.345 fused_ordering(225) 00:15:01.345 fused_ordering(226) 00:15:01.345 fused_ordering(227) 00:15:01.345 fused_ordering(228) 00:15:01.345 fused_ordering(229) 00:15:01.345 fused_ordering(230) 00:15:01.345 fused_ordering(231) 00:15:01.345 fused_ordering(232) 00:15:01.345 fused_ordering(233) 00:15:01.345 fused_ordering(234) 00:15:01.345 fused_ordering(235) 00:15:01.345 fused_ordering(236) 00:15:01.345 fused_ordering(237) 00:15:01.345 fused_ordering(238) 00:15:01.345 fused_ordering(239) 00:15:01.345 fused_ordering(240) 00:15:01.345 fused_ordering(241) 00:15:01.345 fused_ordering(242) 00:15:01.345 fused_ordering(243) 00:15:01.345 fused_ordering(244) 00:15:01.345 fused_ordering(245) 00:15:01.345 fused_ordering(246) 00:15:01.345 fused_ordering(247) 00:15:01.345 fused_ordering(248) 00:15:01.345 fused_ordering(249) 00:15:01.345 fused_ordering(250) 00:15:01.345 fused_ordering(251) 00:15:01.345 fused_ordering(252) 00:15:01.345 fused_ordering(253) 00:15:01.345 fused_ordering(254) 00:15:01.345 fused_ordering(255) 00:15:01.345 fused_ordering(256) 00:15:01.345 fused_ordering(257) 00:15:01.345 fused_ordering(258) 00:15:01.345 fused_ordering(259) 00:15:01.345 fused_ordering(260) 00:15:01.345 fused_ordering(261) 00:15:01.345 fused_ordering(262) 00:15:01.345 fused_ordering(263) 00:15:01.345 fused_ordering(264) 00:15:01.345 fused_ordering(265) 00:15:01.345 fused_ordering(266) 00:15:01.345 fused_ordering(267) 00:15:01.345 fused_ordering(268) 00:15:01.345 fused_ordering(269) 00:15:01.345 fused_ordering(270) 00:15:01.345 fused_ordering(271) 00:15:01.345 fused_ordering(272) 00:15:01.345 fused_ordering(273) 00:15:01.345 fused_ordering(274) 00:15:01.345 fused_ordering(275) 00:15:01.345 fused_ordering(276) 00:15:01.345 fused_ordering(277) 00:15:01.345 fused_ordering(278) 00:15:01.345 fused_ordering(279) 00:15:01.345 fused_ordering(280) 00:15:01.345 fused_ordering(281) 00:15:01.345 fused_ordering(282) 00:15:01.345 fused_ordering(283) 00:15:01.345 fused_ordering(284) 00:15:01.345 fused_ordering(285) 00:15:01.345 fused_ordering(286) 00:15:01.345 fused_ordering(287) 00:15:01.345 fused_ordering(288) 00:15:01.345 fused_ordering(289) 00:15:01.345 fused_ordering(290) 00:15:01.345 fused_ordering(291) 00:15:01.345 fused_ordering(292) 00:15:01.345 fused_ordering(293) 00:15:01.345 fused_ordering(294) 00:15:01.345 fused_ordering(295) 00:15:01.345 fused_ordering(296) 00:15:01.345 fused_ordering(297) 00:15:01.345 fused_ordering(298) 00:15:01.345 fused_ordering(299) 00:15:01.345 fused_ordering(300) 00:15:01.345 fused_ordering(301) 00:15:01.345 fused_ordering(302) 00:15:01.345 fused_ordering(303) 00:15:01.345 fused_ordering(304) 00:15:01.345 fused_ordering(305) 00:15:01.345 fused_ordering(306) 00:15:01.345 fused_ordering(307) 00:15:01.345 fused_ordering(308) 00:15:01.345 fused_ordering(309) 00:15:01.345 fused_ordering(310) 00:15:01.345 fused_ordering(311) 00:15:01.345 fused_ordering(312) 00:15:01.345 fused_ordering(313) 00:15:01.345 fused_ordering(314) 00:15:01.345 fused_ordering(315) 00:15:01.345 fused_ordering(316) 00:15:01.345 fused_ordering(317) 00:15:01.345 fused_ordering(318) 00:15:01.345 fused_ordering(319) 00:15:01.345 fused_ordering(320) 00:15:01.345 fused_ordering(321) 00:15:01.345 fused_ordering(322) 00:15:01.345 fused_ordering(323) 00:15:01.345 fused_ordering(324) 00:15:01.345 fused_ordering(325) 00:15:01.345 fused_ordering(326) 00:15:01.345 fused_ordering(327) 00:15:01.345 fused_ordering(328) 00:15:01.345 fused_ordering(329) 00:15:01.345 fused_ordering(330) 00:15:01.345 fused_ordering(331) 00:15:01.345 fused_ordering(332) 00:15:01.345 fused_ordering(333) 00:15:01.345 fused_ordering(334) 00:15:01.345 fused_ordering(335) 00:15:01.345 fused_ordering(336) 00:15:01.345 fused_ordering(337) 00:15:01.345 fused_ordering(338) 00:15:01.345 fused_ordering(339) 00:15:01.345 fused_ordering(340) 00:15:01.345 fused_ordering(341) 00:15:01.345 fused_ordering(342) 00:15:01.345 fused_ordering(343) 00:15:01.345 fused_ordering(344) 00:15:01.345 fused_ordering(345) 00:15:01.345 fused_ordering(346) 00:15:01.345 fused_ordering(347) 00:15:01.345 fused_ordering(348) 00:15:01.345 fused_ordering(349) 00:15:01.345 fused_ordering(350) 00:15:01.345 fused_ordering(351) 00:15:01.345 fused_ordering(352) 00:15:01.345 fused_ordering(353) 00:15:01.345 fused_ordering(354) 00:15:01.345 fused_ordering(355) 00:15:01.345 fused_ordering(356) 00:15:01.345 fused_ordering(357) 00:15:01.345 fused_ordering(358) 00:15:01.345 fused_ordering(359) 00:15:01.345 fused_ordering(360) 00:15:01.345 fused_ordering(361) 00:15:01.345 fused_ordering(362) 00:15:01.345 fused_ordering(363) 00:15:01.345 fused_ordering(364) 00:15:01.345 fused_ordering(365) 00:15:01.345 fused_ordering(366) 00:15:01.345 fused_ordering(367) 00:15:01.345 fused_ordering(368) 00:15:01.345 fused_ordering(369) 00:15:01.345 fused_ordering(370) 00:15:01.345 fused_ordering(371) 00:15:01.345 fused_ordering(372) 00:15:01.345 fused_ordering(373) 00:15:01.345 fused_ordering(374) 00:15:01.345 fused_ordering(375) 00:15:01.345 fused_ordering(376) 00:15:01.345 fused_ordering(377) 00:15:01.345 fused_ordering(378) 00:15:01.345 fused_ordering(379) 00:15:01.345 fused_ordering(380) 00:15:01.345 fused_ordering(381) 00:15:01.345 fused_ordering(382) 00:15:01.345 fused_ordering(383) 00:15:01.345 fused_ordering(384) 00:15:01.345 fused_ordering(385) 00:15:01.345 fused_ordering(386) 00:15:01.345 fused_ordering(387) 00:15:01.345 fused_ordering(388) 00:15:01.345 fused_ordering(389) 00:15:01.345 fused_ordering(390) 00:15:01.345 fused_ordering(391) 00:15:01.345 fused_ordering(392) 00:15:01.345 fused_ordering(393) 00:15:01.345 fused_ordering(394) 00:15:01.345 fused_ordering(395) 00:15:01.345 fused_ordering(396) 00:15:01.345 fused_ordering(397) 00:15:01.345 fused_ordering(398) 00:15:01.345 fused_ordering(399) 00:15:01.345 fused_ordering(400) 00:15:01.345 fused_ordering(401) 00:15:01.345 fused_ordering(402) 00:15:01.345 fused_ordering(403) 00:15:01.345 fused_ordering(404) 00:15:01.345 fused_ordering(405) 00:15:01.345 fused_ordering(406) 00:15:01.345 fused_ordering(407) 00:15:01.345 fused_ordering(408) 00:15:01.345 fused_ordering(409) 00:15:01.345 fused_ordering(410) 00:15:01.914 fused_ordering(411) 00:15:01.914 fused_ordering(412) 00:15:01.914 fused_ordering(413) 00:15:01.914 fused_ordering(414) 00:15:01.914 fused_ordering(415) 00:15:01.914 fused_ordering(416) 00:15:01.914 fused_ordering(417) 00:15:01.914 fused_ordering(418) 00:15:01.914 fused_ordering(419) 00:15:01.914 fused_ordering(420) 00:15:01.914 fused_ordering(421) 00:15:01.914 fused_ordering(422) 00:15:01.914 fused_ordering(423) 00:15:01.914 fused_ordering(424) 00:15:01.914 fused_ordering(425) 00:15:01.914 fused_ordering(426) 00:15:01.914 fused_ordering(427) 00:15:01.914 fused_ordering(428) 00:15:01.914 fused_ordering(429) 00:15:01.914 fused_ordering(430) 00:15:01.914 fused_ordering(431) 00:15:01.914 fused_ordering(432) 00:15:01.914 fused_ordering(433) 00:15:01.914 fused_ordering(434) 00:15:01.914 fused_ordering(435) 00:15:01.914 fused_ordering(436) 00:15:01.914 fused_ordering(437) 00:15:01.914 fused_ordering(438) 00:15:01.914 fused_ordering(439) 00:15:01.914 fused_ordering(440) 00:15:01.914 fused_ordering(441) 00:15:01.914 fused_ordering(442) 00:15:01.914 fused_ordering(443) 00:15:01.914 fused_ordering(444) 00:15:01.914 fused_ordering(445) 00:15:01.914 fused_ordering(446) 00:15:01.914 fused_ordering(447) 00:15:01.914 fused_ordering(448) 00:15:01.914 fused_ordering(449) 00:15:01.914 fused_ordering(450) 00:15:01.914 fused_ordering(451) 00:15:01.914 fused_ordering(452) 00:15:01.914 fused_ordering(453) 00:15:01.914 fused_ordering(454) 00:15:01.914 fused_ordering(455) 00:15:01.914 fused_ordering(456) 00:15:01.914 fused_ordering(457) 00:15:01.914 fused_ordering(458) 00:15:01.914 fused_ordering(459) 00:15:01.914 fused_ordering(460) 00:15:01.914 fused_ordering(461) 00:15:01.914 fused_ordering(462) 00:15:01.914 fused_ordering(463) 00:15:01.914 fused_ordering(464) 00:15:01.914 fused_ordering(465) 00:15:01.914 fused_ordering(466) 00:15:01.914 fused_ordering(467) 00:15:01.914 fused_ordering(468) 00:15:01.914 fused_ordering(469) 00:15:01.914 fused_ordering(470) 00:15:01.914 fused_ordering(471) 00:15:01.914 fused_ordering(472) 00:15:01.914 fused_ordering(473) 00:15:01.914 fused_ordering(474) 00:15:01.914 fused_ordering(475) 00:15:01.914 fused_ordering(476) 00:15:01.914 fused_ordering(477) 00:15:01.914 fused_ordering(478) 00:15:01.914 fused_ordering(479) 00:15:01.914 fused_ordering(480) 00:15:01.914 fused_ordering(481) 00:15:01.914 fused_ordering(482) 00:15:01.914 fused_ordering(483) 00:15:01.914 fused_ordering(484) 00:15:01.914 fused_ordering(485) 00:15:01.914 fused_ordering(486) 00:15:01.914 fused_ordering(487) 00:15:01.914 fused_ordering(488) 00:15:01.914 fused_ordering(489) 00:15:01.914 fused_ordering(490) 00:15:01.914 fused_ordering(491) 00:15:01.914 fused_ordering(492) 00:15:01.914 fused_ordering(493) 00:15:01.914 fused_ordering(494) 00:15:01.914 fused_ordering(495) 00:15:01.914 fused_ordering(496) 00:15:01.914 fused_ordering(497) 00:15:01.914 fused_ordering(498) 00:15:01.914 fused_ordering(499) 00:15:01.914 fused_ordering(500) 00:15:01.914 fused_ordering(501) 00:15:01.914 fused_ordering(502) 00:15:01.914 fused_ordering(503) 00:15:01.914 fused_ordering(504) 00:15:01.914 fused_ordering(505) 00:15:01.914 fused_ordering(506) 00:15:01.914 fused_ordering(507) 00:15:01.914 fused_ordering(508) 00:15:01.914 fused_ordering(509) 00:15:01.914 fused_ordering(510) 00:15:01.914 fused_ordering(511) 00:15:01.914 fused_ordering(512) 00:15:01.914 fused_ordering(513) 00:15:01.914 fused_ordering(514) 00:15:01.914 fused_ordering(515) 00:15:01.914 fused_ordering(516) 00:15:01.914 fused_ordering(517) 00:15:01.914 fused_ordering(518) 00:15:01.914 fused_ordering(519) 00:15:01.914 fused_ordering(520) 00:15:01.914 fused_ordering(521) 00:15:01.914 fused_ordering(522) 00:15:01.914 fused_ordering(523) 00:15:01.914 fused_ordering(524) 00:15:01.914 fused_ordering(525) 00:15:01.914 fused_ordering(526) 00:15:01.914 fused_ordering(527) 00:15:01.914 fused_ordering(528) 00:15:01.914 fused_ordering(529) 00:15:01.914 fused_ordering(530) 00:15:01.914 fused_ordering(531) 00:15:01.914 fused_ordering(532) 00:15:01.914 fused_ordering(533) 00:15:01.914 fused_ordering(534) 00:15:01.914 fused_ordering(535) 00:15:01.914 fused_ordering(536) 00:15:01.914 fused_ordering(537) 00:15:01.914 fused_ordering(538) 00:15:01.914 fused_ordering(539) 00:15:01.914 fused_ordering(540) 00:15:01.914 fused_ordering(541) 00:15:01.914 fused_ordering(542) 00:15:01.914 fused_ordering(543) 00:15:01.914 fused_ordering(544) 00:15:01.914 fused_ordering(545) 00:15:01.914 fused_ordering(546) 00:15:01.914 fused_ordering(547) 00:15:01.914 fused_ordering(548) 00:15:01.914 fused_ordering(549) 00:15:01.914 fused_ordering(550) 00:15:01.914 fused_ordering(551) 00:15:01.914 fused_ordering(552) 00:15:01.914 fused_ordering(553) 00:15:01.914 fused_ordering(554) 00:15:01.914 fused_ordering(555) 00:15:01.914 fused_ordering(556) 00:15:01.914 fused_ordering(557) 00:15:01.914 fused_ordering(558) 00:15:01.914 fused_ordering(559) 00:15:01.914 fused_ordering(560) 00:15:01.914 fused_ordering(561) 00:15:01.914 fused_ordering(562) 00:15:01.914 fused_ordering(563) 00:15:01.914 fused_ordering(564) 00:15:01.914 fused_ordering(565) 00:15:01.914 fused_ordering(566) 00:15:01.914 fused_ordering(567) 00:15:01.914 fused_ordering(568) 00:15:01.914 fused_ordering(569) 00:15:01.914 fused_ordering(570) 00:15:01.914 fused_ordering(571) 00:15:01.914 fused_ordering(572) 00:15:01.914 fused_ordering(573) 00:15:01.914 fused_ordering(574) 00:15:01.914 fused_ordering(575) 00:15:01.914 fused_ordering(576) 00:15:01.914 fused_ordering(577) 00:15:01.914 fused_ordering(578) 00:15:01.914 fused_ordering(579) 00:15:01.914 fused_ordering(580) 00:15:01.914 fused_ordering(581) 00:15:01.914 fused_ordering(582) 00:15:01.914 fused_ordering(583) 00:15:01.914 fused_ordering(584) 00:15:01.914 fused_ordering(585) 00:15:01.914 fused_ordering(586) 00:15:01.914 fused_ordering(587) 00:15:01.914 fused_ordering(588) 00:15:01.914 fused_ordering(589) 00:15:01.914 fused_ordering(590) 00:15:01.914 fused_ordering(591) 00:15:01.914 fused_ordering(592) 00:15:01.914 fused_ordering(593) 00:15:01.914 fused_ordering(594) 00:15:01.914 fused_ordering(595) 00:15:01.914 fused_ordering(596) 00:15:01.914 fused_ordering(597) 00:15:01.914 fused_ordering(598) 00:15:01.914 fused_ordering(599) 00:15:01.914 fused_ordering(600) 00:15:01.914 fused_ordering(601) 00:15:01.914 fused_ordering(602) 00:15:01.914 fused_ordering(603) 00:15:01.914 fused_ordering(604) 00:15:01.914 fused_ordering(605) 00:15:01.914 fused_ordering(606) 00:15:01.914 fused_ordering(607) 00:15:01.914 fused_ordering(608) 00:15:01.914 fused_ordering(609) 00:15:01.914 fused_ordering(610) 00:15:01.914 fused_ordering(611) 00:15:01.914 fused_ordering(612) 00:15:01.914 fused_ordering(613) 00:15:01.914 fused_ordering(614) 00:15:01.914 fused_ordering(615) 00:15:02.482 fused_ordering(616) 00:15:02.482 fused_ordering(617) 00:15:02.482 fused_ordering(618) 00:15:02.482 fused_ordering(619) 00:15:02.482 fused_ordering(620) 00:15:02.482 fused_ordering(621) 00:15:02.482 fused_ordering(622) 00:15:02.482 fused_ordering(623) 00:15:02.482 fused_ordering(624) 00:15:02.482 fused_ordering(625) 00:15:02.482 fused_ordering(626) 00:15:02.482 fused_ordering(627) 00:15:02.482 fused_ordering(628) 00:15:02.482 fused_ordering(629) 00:15:02.482 fused_ordering(630) 00:15:02.482 fused_ordering(631) 00:15:02.482 fused_ordering(632) 00:15:02.482 fused_ordering(633) 00:15:02.482 fused_ordering(634) 00:15:02.482 fused_ordering(635) 00:15:02.482 fused_ordering(636) 00:15:02.482 fused_ordering(637) 00:15:02.482 fused_ordering(638) 00:15:02.482 fused_ordering(639) 00:15:02.482 fused_ordering(640) 00:15:02.482 fused_ordering(641) 00:15:02.482 fused_ordering(642) 00:15:02.482 fused_ordering(643) 00:15:02.482 fused_ordering(644) 00:15:02.482 fused_ordering(645) 00:15:02.482 fused_ordering(646) 00:15:02.482 fused_ordering(647) 00:15:02.482 fused_ordering(648) 00:15:02.482 fused_ordering(649) 00:15:02.482 fused_ordering(650) 00:15:02.482 fused_ordering(651) 00:15:02.482 fused_ordering(652) 00:15:02.482 fused_ordering(653) 00:15:02.482 fused_ordering(654) 00:15:02.482 fused_ordering(655) 00:15:02.482 fused_ordering(656) 00:15:02.482 fused_ordering(657) 00:15:02.482 fused_ordering(658) 00:15:02.482 fused_ordering(659) 00:15:02.482 fused_ordering(660) 00:15:02.482 fused_ordering(661) 00:15:02.482 fused_ordering(662) 00:15:02.482 fused_ordering(663) 00:15:02.482 fused_ordering(664) 00:15:02.482 fused_ordering(665) 00:15:02.482 fused_ordering(666) 00:15:02.482 fused_ordering(667) 00:15:02.482 fused_ordering(668) 00:15:02.482 fused_ordering(669) 00:15:02.482 fused_ordering(670) 00:15:02.482 fused_ordering(671) 00:15:02.482 fused_ordering(672) 00:15:02.482 fused_ordering(673) 00:15:02.482 fused_ordering(674) 00:15:02.482 fused_ordering(675) 00:15:02.482 fused_ordering(676) 00:15:02.482 fused_ordering(677) 00:15:02.482 fused_ordering(678) 00:15:02.482 fused_ordering(679) 00:15:02.482 fused_ordering(680) 00:15:02.482 fused_ordering(681) 00:15:02.482 fused_ordering(682) 00:15:02.482 fused_ordering(683) 00:15:02.482 fused_ordering(684) 00:15:02.482 fused_ordering(685) 00:15:02.482 fused_ordering(686) 00:15:02.482 fused_ordering(687) 00:15:02.482 fused_ordering(688) 00:15:02.482 fused_ordering(689) 00:15:02.482 fused_ordering(690) 00:15:02.482 fused_ordering(691) 00:15:02.482 fused_ordering(692) 00:15:02.482 fused_ordering(693) 00:15:02.482 fused_ordering(694) 00:15:02.482 fused_ordering(695) 00:15:02.482 fused_ordering(696) 00:15:02.482 fused_ordering(697) 00:15:02.482 fused_ordering(698) 00:15:02.482 fused_ordering(699) 00:15:02.482 fused_ordering(700) 00:15:02.482 fused_ordering(701) 00:15:02.482 fused_ordering(702) 00:15:02.482 fused_ordering(703) 00:15:02.482 fused_ordering(704) 00:15:02.482 fused_ordering(705) 00:15:02.482 fused_ordering(706) 00:15:02.482 fused_ordering(707) 00:15:02.482 fused_ordering(708) 00:15:02.482 fused_ordering(709) 00:15:02.482 fused_ordering(710) 00:15:02.482 fused_ordering(711) 00:15:02.482 fused_ordering(712) 00:15:02.482 fused_ordering(713) 00:15:02.482 fused_ordering(714) 00:15:02.482 fused_ordering(715) 00:15:02.482 fused_ordering(716) 00:15:02.482 fused_ordering(717) 00:15:02.482 fused_ordering(718) 00:15:02.482 fused_ordering(719) 00:15:02.482 fused_ordering(720) 00:15:02.482 fused_ordering(721) 00:15:02.482 fused_ordering(722) 00:15:02.482 fused_ordering(723) 00:15:02.482 fused_ordering(724) 00:15:02.482 fused_ordering(725) 00:15:02.482 fused_ordering(726) 00:15:02.482 fused_ordering(727) 00:15:02.482 fused_ordering(728) 00:15:02.482 fused_ordering(729) 00:15:02.482 fused_ordering(730) 00:15:02.482 fused_ordering(731) 00:15:02.482 fused_ordering(732) 00:15:02.482 fused_ordering(733) 00:15:02.482 fused_ordering(734) 00:15:02.482 fused_ordering(735) 00:15:02.482 fused_ordering(736) 00:15:02.482 fused_ordering(737) 00:15:02.482 fused_ordering(738) 00:15:02.482 fused_ordering(739) 00:15:02.482 fused_ordering(740) 00:15:02.482 fused_ordering(741) 00:15:02.482 fused_ordering(742) 00:15:02.482 fused_ordering(743) 00:15:02.482 fused_ordering(744) 00:15:02.482 fused_ordering(745) 00:15:02.482 fused_ordering(746) 00:15:02.482 fused_ordering(747) 00:15:02.482 fused_ordering(748) 00:15:02.482 fused_ordering(749) 00:15:02.482 fused_ordering(750) 00:15:02.482 fused_ordering(751) 00:15:02.482 fused_ordering(752) 00:15:02.482 fused_ordering(753) 00:15:02.482 fused_ordering(754) 00:15:02.482 fused_ordering(755) 00:15:02.482 fused_ordering(756) 00:15:02.482 fused_ordering(757) 00:15:02.482 fused_ordering(758) 00:15:02.482 fused_ordering(759) 00:15:02.482 fused_ordering(760) 00:15:02.482 fused_ordering(761) 00:15:02.482 fused_ordering(762) 00:15:02.482 fused_ordering(763) 00:15:02.482 fused_ordering(764) 00:15:02.482 fused_ordering(765) 00:15:02.482 fused_ordering(766) 00:15:02.482 fused_ordering(767) 00:15:02.482 fused_ordering(768) 00:15:02.482 fused_ordering(769) 00:15:02.482 fused_ordering(770) 00:15:02.482 fused_ordering(771) 00:15:02.482 fused_ordering(772) 00:15:02.482 fused_ordering(773) 00:15:02.482 fused_ordering(774) 00:15:02.482 fused_ordering(775) 00:15:02.482 fused_ordering(776) 00:15:02.482 fused_ordering(777) 00:15:02.482 fused_ordering(778) 00:15:02.482 fused_ordering(779) 00:15:02.482 fused_ordering(780) 00:15:02.482 fused_ordering(781) 00:15:02.482 fused_ordering(782) 00:15:02.482 fused_ordering(783) 00:15:02.482 fused_ordering(784) 00:15:02.482 fused_ordering(785) 00:15:02.482 fused_ordering(786) 00:15:02.482 fused_ordering(787) 00:15:02.482 fused_ordering(788) 00:15:02.482 fused_ordering(789) 00:15:02.482 fused_ordering(790) 00:15:02.482 fused_ordering(791) 00:15:02.482 fused_ordering(792) 00:15:02.482 fused_ordering(793) 00:15:02.482 fused_ordering(794) 00:15:02.482 fused_ordering(795) 00:15:02.482 fused_ordering(796) 00:15:02.482 fused_ordering(797) 00:15:02.482 fused_ordering(798) 00:15:02.482 fused_ordering(799) 00:15:02.482 fused_ordering(800) 00:15:02.482 fused_ordering(801) 00:15:02.482 fused_ordering(802) 00:15:02.482 fused_ordering(803) 00:15:02.482 fused_ordering(804) 00:15:02.482 fused_ordering(805) 00:15:02.482 fused_ordering(806) 00:15:02.482 fused_ordering(807) 00:15:02.482 fused_ordering(808) 00:15:02.482 fused_ordering(809) 00:15:02.482 fused_ordering(810) 00:15:02.482 fused_ordering(811) 00:15:02.482 fused_ordering(812) 00:15:02.482 fused_ordering(813) 00:15:02.482 fused_ordering(814) 00:15:02.482 fused_ordering(815) 00:15:02.482 fused_ordering(816) 00:15:02.482 fused_ordering(817) 00:15:02.482 fused_ordering(818) 00:15:02.482 fused_ordering(819) 00:15:02.482 fused_ordering(820) 00:15:03.053 fused_ordering(821) 00:15:03.053 fused_ordering(822) 00:15:03.053 fused_ordering(823) 00:15:03.053 fused_ordering(824) 00:15:03.053 fused_ordering(825) 00:15:03.053 fused_ordering(826) 00:15:03.053 fused_ordering(827) 00:15:03.053 fused_ordering(828) 00:15:03.053 fused_ordering(829) 00:15:03.053 fused_ordering(830) 00:15:03.053 fused_ordering(831) 00:15:03.053 fused_ordering(832) 00:15:03.053 fused_ordering(833) 00:15:03.053 fused_ordering(834) 00:15:03.053 fused_ordering(835) 00:15:03.053 fused_ordering(836) 00:15:03.053 fused_ordering(837) 00:15:03.053 fused_ordering(838) 00:15:03.053 fused_ordering(839) 00:15:03.053 fused_ordering(840) 00:15:03.053 fused_ordering(841) 00:15:03.053 fused_ordering(842) 00:15:03.053 fused_ordering(843) 00:15:03.053 fused_ordering(844) 00:15:03.053 fused_ordering(845) 00:15:03.053 fused_ordering(846) 00:15:03.053 fused_ordering(847) 00:15:03.053 fused_ordering(848) 00:15:03.053 fused_ordering(849) 00:15:03.053 fused_ordering(850) 00:15:03.053 fused_ordering(851) 00:15:03.053 fused_ordering(852) 00:15:03.053 fused_ordering(853) 00:15:03.053 fused_ordering(854) 00:15:03.053 fused_ordering(855) 00:15:03.053 fused_ordering(856) 00:15:03.053 fused_ordering(857) 00:15:03.053 fused_ordering(858) 00:15:03.053 fused_ordering(859) 00:15:03.053 fused_ordering(860) 00:15:03.053 fused_ordering(861) 00:15:03.053 fused_ordering(862) 00:15:03.053 fused_ordering(863) 00:15:03.053 fused_ordering(864) 00:15:03.053 fused_ordering(865) 00:15:03.053 fused_ordering(866) 00:15:03.053 fused_ordering(867) 00:15:03.053 fused_ordering(868) 00:15:03.053 fused_ordering(869) 00:15:03.053 fused_ordering(870) 00:15:03.053 fused_ordering(871) 00:15:03.053 fused_ordering(872) 00:15:03.053 fused_ordering(873) 00:15:03.053 fused_ordering(874) 00:15:03.053 fused_ordering(875) 00:15:03.053 fused_ordering(876) 00:15:03.053 fused_ordering(877) 00:15:03.053 fused_ordering(878) 00:15:03.053 fused_ordering(879) 00:15:03.053 fused_ordering(880) 00:15:03.053 fused_ordering(881) 00:15:03.053 fused_ordering(882) 00:15:03.053 fused_ordering(883) 00:15:03.053 fused_ordering(884) 00:15:03.053 fused_ordering(885) 00:15:03.053 fused_ordering(886) 00:15:03.053 fused_ordering(887) 00:15:03.053 fused_ordering(888) 00:15:03.053 fused_ordering(889) 00:15:03.053 fused_ordering(890) 00:15:03.053 fused_ordering(891) 00:15:03.053 fused_ordering(892) 00:15:03.053 fused_ordering(893) 00:15:03.053 fused_ordering(894) 00:15:03.053 fused_ordering(895) 00:15:03.053 fused_ordering(896) 00:15:03.053 fused_ordering(897) 00:15:03.053 fused_ordering(898) 00:15:03.053 fused_ordering(899) 00:15:03.053 fused_ordering(900) 00:15:03.053 fused_ordering(901) 00:15:03.053 fused_ordering(902) 00:15:03.053 fused_ordering(903) 00:15:03.053 fused_ordering(904) 00:15:03.053 fused_ordering(905) 00:15:03.053 fused_ordering(906) 00:15:03.053 fused_ordering(907) 00:15:03.053 fused_ordering(908) 00:15:03.053 fused_ordering(909) 00:15:03.053 fused_ordering(910) 00:15:03.053 fused_ordering(911) 00:15:03.053 fused_ordering(912) 00:15:03.053 fused_ordering(913) 00:15:03.053 fused_ordering(914) 00:15:03.053 fused_ordering(915) 00:15:03.053 fused_ordering(916) 00:15:03.053 fused_ordering(917) 00:15:03.053 fused_ordering(918) 00:15:03.053 fused_ordering(919) 00:15:03.053 fused_ordering(920) 00:15:03.053 fused_ordering(921) 00:15:03.053 fused_ordering(922) 00:15:03.053 fused_ordering(923) 00:15:03.053 fused_ordering(924) 00:15:03.053 fused_ordering(925) 00:15:03.053 fused_ordering(926) 00:15:03.053 fused_ordering(927) 00:15:03.053 fused_ordering(928) 00:15:03.053 fused_ordering(929) 00:15:03.053 fused_ordering(930) 00:15:03.053 fused_ordering(931) 00:15:03.053 fused_ordering(932) 00:15:03.053 fused_ordering(933) 00:15:03.053 fused_ordering(934) 00:15:03.053 fused_ordering(935) 00:15:03.053 fused_ordering(936) 00:15:03.053 fused_ordering(937) 00:15:03.053 fused_ordering(938) 00:15:03.053 fused_ordering(939) 00:15:03.053 fused_ordering(940) 00:15:03.053 fused_ordering(941) 00:15:03.053 fused_ordering(942) 00:15:03.053 fused_ordering(943) 00:15:03.053 fused_ordering(944) 00:15:03.053 fused_ordering(945) 00:15:03.053 fused_ordering(946) 00:15:03.053 fused_ordering(947) 00:15:03.053 fused_ordering(948) 00:15:03.053 fused_ordering(949) 00:15:03.053 fused_ordering(950) 00:15:03.053 fused_ordering(951) 00:15:03.053 fused_ordering(952) 00:15:03.053 fused_ordering(953) 00:15:03.053 fused_ordering(954) 00:15:03.053 fused_ordering(955) 00:15:03.053 fused_ordering(956) 00:15:03.053 fused_ordering(957) 00:15:03.053 fused_ordering(958) 00:15:03.053 fused_ordering(959) 00:15:03.053 fused_ordering(960) 00:15:03.053 fused_ordering(961) 00:15:03.053 fused_ordering(962) 00:15:03.053 fused_ordering(963) 00:15:03.053 fused_ordering(964) 00:15:03.053 fused_ordering(965) 00:15:03.053 fused_ordering(966) 00:15:03.053 fused_ordering(967) 00:15:03.053 fused_ordering(968) 00:15:03.053 fused_ordering(969) 00:15:03.053 fused_ordering(970) 00:15:03.053 fused_ordering(971) 00:15:03.053 fused_ordering(972) 00:15:03.053 fused_ordering(973) 00:15:03.053 fused_ordering(974) 00:15:03.053 fused_ordering(975) 00:15:03.053 fused_ordering(976) 00:15:03.053 fused_ordering(977) 00:15:03.053 fused_ordering(978) 00:15:03.053 fused_ordering(979) 00:15:03.053 fused_ordering(980) 00:15:03.053 fused_ordering(981) 00:15:03.053 fused_ordering(982) 00:15:03.053 fused_ordering(983) 00:15:03.053 fused_ordering(984) 00:15:03.053 fused_ordering(985) 00:15:03.053 fused_ordering(986) 00:15:03.053 fused_ordering(987) 00:15:03.053 fused_ordering(988) 00:15:03.053 fused_ordering(989) 00:15:03.053 fused_ordering(990) 00:15:03.053 fused_ordering(991) 00:15:03.053 fused_ordering(992) 00:15:03.053 fused_ordering(993) 00:15:03.053 fused_ordering(994) 00:15:03.053 fused_ordering(995) 00:15:03.053 fused_ordering(996) 00:15:03.053 fused_ordering(997) 00:15:03.053 fused_ordering(998) 00:15:03.053 fused_ordering(999) 00:15:03.053 fused_ordering(1000) 00:15:03.053 fused_ordering(1001) 00:15:03.053 fused_ordering(1002) 00:15:03.053 fused_ordering(1003) 00:15:03.053 fused_ordering(1004) 00:15:03.053 fused_ordering(1005) 00:15:03.053 fused_ordering(1006) 00:15:03.053 fused_ordering(1007) 00:15:03.053 fused_ordering(1008) 00:15:03.053 fused_ordering(1009) 00:15:03.053 fused_ordering(1010) 00:15:03.053 fused_ordering(1011) 00:15:03.053 fused_ordering(1012) 00:15:03.053 fused_ordering(1013) 00:15:03.053 fused_ordering(1014) 00:15:03.053 fused_ordering(1015) 00:15:03.053 fused_ordering(1016) 00:15:03.053 fused_ordering(1017) 00:15:03.053 fused_ordering(1018) 00:15:03.053 fused_ordering(1019) 00:15:03.053 fused_ordering(1020) 00:15:03.053 fused_ordering(1021) 00:15:03.053 fused_ordering(1022) 00:15:03.054 fused_ordering(1023) 00:15:03.054 13:48:43 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:03.054 13:48:43 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:03.054 13:48:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:03.054 13:48:43 -- nvmf/common.sh@116 -- # sync 00:15:03.054 13:48:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:03.054 13:48:43 -- nvmf/common.sh@119 -- # set +e 00:15:03.054 13:48:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:03.054 13:48:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:03.054 rmmod nvme_tcp 00:15:03.054 rmmod nvme_fabrics 00:15:03.054 rmmod nvme_keyring 00:15:03.054 13:48:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:03.054 13:48:43 -- nvmf/common.sh@123 -- # set -e 00:15:03.054 13:48:43 -- nvmf/common.sh@124 -- # return 0 00:15:03.054 13:48:43 -- nvmf/common.sh@477 -- # '[' -n 2266456 ']' 00:15:03.054 13:48:43 -- nvmf/common.sh@478 -- # killprocess 2266456 00:15:03.054 13:48:43 -- common/autotest_common.sh@936 -- # '[' -z 2266456 ']' 00:15:03.054 13:48:43 -- common/autotest_common.sh@940 -- # kill -0 2266456 00:15:03.054 13:48:43 -- common/autotest_common.sh@941 -- # uname 00:15:03.054 13:48:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.054 13:48:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2266456 00:15:03.312 13:48:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:03.312 13:48:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:03.312 13:48:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2266456' 00:15:03.312 killing process with pid 2266456 00:15:03.312 13:48:43 -- common/autotest_common.sh@955 -- # kill 2266456 00:15:03.312 13:48:43 -- common/autotest_common.sh@960 -- # wait 2266456 00:15:03.312 13:48:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:03.312 13:48:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:03.312 13:48:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:03.312 13:48:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:03.312 13:48:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:03.312 13:48:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:03.312 13:48:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:03.312 13:48:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.848 13:48:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:05.848 00:15:05.849 real 0m8.296s 00:15:05.849 user 0m6.159s 00:15:05.849 sys 0m3.310s 00:15:05.849 13:48:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:05.849 13:48:45 -- common/autotest_common.sh@10 -- # set +x 00:15:05.849 ************************************ 00:15:05.849 END TEST nvmf_fused_ordering 00:15:05.849 ************************************ 00:15:05.849 13:48:45 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:05.849 13:48:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:05.849 13:48:45 -- common/autotest_common.sh@10 -- # set +x 00:15:05.849 ************************************ 00:15:05.849 START TEST nvmf_delete_subsystem 00:15:05.849 ************************************ 00:15:05.849 13:48:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:05.849 * Looking for test storage... 00:15:05.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:05.849 13:48:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:05.849 13:48:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:05.849 13:48:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:05.849 13:48:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:05.849 13:48:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:05.849 13:48:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:05.849 13:48:45 -- scripts/common.sh@335 -- # IFS=.-: 00:15:05.849 13:48:45 -- scripts/common.sh@335 -- # read -ra ver1 00:15:05.849 13:48:45 -- scripts/common.sh@336 -- # IFS=.-: 00:15:05.849 13:48:45 -- scripts/common.sh@336 -- # read -ra ver2 00:15:05.849 13:48:45 -- scripts/common.sh@337 -- # local 'op=<' 00:15:05.849 13:48:45 -- scripts/common.sh@339 -- # ver1_l=2 00:15:05.849 13:48:45 -- scripts/common.sh@340 -- # ver2_l=1 00:15:05.849 13:48:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:05.849 13:48:45 -- scripts/common.sh@343 -- # case "$op" in 00:15:05.849 13:48:45 -- scripts/common.sh@344 -- # : 1 00:15:05.849 13:48:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:05.849 13:48:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:05.849 13:48:45 -- scripts/common.sh@364 -- # decimal 1 00:15:05.849 13:48:45 -- scripts/common.sh@352 -- # local d=1 00:15:05.849 13:48:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:05.849 13:48:45 -- scripts/common.sh@354 -- # echo 1 00:15:05.849 13:48:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:05.849 13:48:45 -- scripts/common.sh@365 -- # decimal 2 00:15:05.849 13:48:45 -- scripts/common.sh@352 -- # local d=2 00:15:05.849 13:48:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:05.849 13:48:45 -- scripts/common.sh@354 -- # echo 2 00:15:05.849 13:48:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:05.849 13:48:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:05.849 13:48:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:05.849 13:48:45 -- scripts/common.sh@367 -- # return 0 00:15:05.849 13:48:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:05.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.849 --rc genhtml_branch_coverage=1 00:15:05.849 --rc genhtml_function_coverage=1 00:15:05.849 --rc genhtml_legend=1 00:15:05.849 --rc geninfo_all_blocks=1 00:15:05.849 --rc geninfo_unexecuted_blocks=1 00:15:05.849 00:15:05.849 ' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:05.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.849 --rc genhtml_branch_coverage=1 00:15:05.849 --rc genhtml_function_coverage=1 00:15:05.849 --rc genhtml_legend=1 00:15:05.849 --rc geninfo_all_blocks=1 00:15:05.849 --rc geninfo_unexecuted_blocks=1 00:15:05.849 00:15:05.849 ' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:05.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.849 --rc genhtml_branch_coverage=1 00:15:05.849 --rc genhtml_function_coverage=1 00:15:05.849 --rc genhtml_legend=1 00:15:05.849 --rc geninfo_all_blocks=1 00:15:05.849 --rc geninfo_unexecuted_blocks=1 00:15:05.849 00:15:05.849 ' 00:15:05.849 13:48:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:05.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.849 --rc genhtml_branch_coverage=1 00:15:05.849 --rc genhtml_function_coverage=1 00:15:05.849 --rc genhtml_legend=1 00:15:05.849 --rc geninfo_all_blocks=1 00:15:05.849 --rc geninfo_unexecuted_blocks=1 00:15:05.849 00:15:05.849 ' 00:15:05.849 13:48:45 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:05.849 13:48:45 -- nvmf/common.sh@7 -- # uname -s 00:15:05.849 13:48:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:05.849 13:48:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:05.849 13:48:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:05.849 13:48:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:05.849 13:48:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:05.849 13:48:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:05.849 13:48:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:05.849 13:48:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:05.849 13:48:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:05.849 13:48:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:05.849 13:48:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:05.849 13:48:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:05.849 13:48:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:05.849 13:48:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:05.849 13:48:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:05.849 13:48:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:05.849 13:48:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:05.849 13:48:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:05.849 13:48:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:05.849 13:48:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.849 13:48:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.849 13:48:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.849 13:48:45 -- paths/export.sh@5 -- # export PATH 00:15:05.849 13:48:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.849 13:48:45 -- nvmf/common.sh@46 -- # : 0 00:15:05.849 13:48:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:05.849 13:48:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:05.849 13:48:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:05.849 13:48:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:05.849 13:48:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:05.849 13:48:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:05.849 13:48:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:05.849 13:48:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:05.849 13:48:45 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:05.849 13:48:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:05.849 13:48:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:05.849 13:48:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:05.849 13:48:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:05.849 13:48:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:05.849 13:48:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:05.849 13:48:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:05.849 13:48:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.849 13:48:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:05.849 13:48:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:05.849 13:48:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:05.849 13:48:45 -- common/autotest_common.sh@10 -- # set +x 00:15:07.761 13:48:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:07.761 13:48:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:07.761 13:48:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:07.761 13:48:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:07.761 13:48:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:07.761 13:48:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:07.761 13:48:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:07.761 13:48:47 -- nvmf/common.sh@294 -- # net_devs=() 00:15:07.761 13:48:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:07.761 13:48:47 -- nvmf/common.sh@295 -- # e810=() 00:15:07.761 13:48:47 -- nvmf/common.sh@295 -- # local -ga e810 00:15:07.761 13:48:47 -- nvmf/common.sh@296 -- # x722=() 00:15:07.761 13:48:47 -- nvmf/common.sh@296 -- # local -ga x722 00:15:07.761 13:48:47 -- nvmf/common.sh@297 -- # mlx=() 00:15:07.761 13:48:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:07.761 13:48:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:07.761 13:48:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:07.761 13:48:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:07.761 13:48:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:07.761 13:48:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:07.761 13:48:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:07.761 13:48:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:07.761 13:48:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:07.762 13:48:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:07.762 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:07.762 13:48:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:07.762 13:48:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:07.762 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:07.762 13:48:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:07.762 13:48:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:07.762 13:48:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:07.762 13:48:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:07.762 13:48:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:07.762 13:48:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:07.762 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:07.762 13:48:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:07.762 13:48:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:07.762 13:48:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:07.762 13:48:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:07.762 13:48:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:07.762 13:48:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:07.762 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:07.762 13:48:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:07.762 13:48:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:07.762 13:48:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:07.762 13:48:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:07.762 13:48:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:07.762 13:48:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:07.762 13:48:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:07.762 13:48:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:07.762 13:48:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:07.762 13:48:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:07.762 13:48:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:07.762 13:48:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:07.762 13:48:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:07.762 13:48:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:07.762 13:48:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:07.762 13:48:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:07.762 13:48:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:07.762 13:48:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:07.762 13:48:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:07.762 13:48:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:07.762 13:48:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:07.762 13:48:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:07.762 13:48:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:07.762 13:48:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:07.762 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:07.762 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:15:07.762 00:15:07.762 --- 10.0.0.2 ping statistics --- 00:15:07.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:07.762 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:15:07.762 13:48:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:07.762 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:07.762 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:15:07.762 00:15:07.762 --- 10.0.0.1 ping statistics --- 00:15:07.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:07.762 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:15:07.762 13:48:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:07.762 13:48:47 -- nvmf/common.sh@410 -- # return 0 00:15:07.762 13:48:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:07.762 13:48:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:07.762 13:48:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:07.762 13:48:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:07.762 13:48:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:07.762 13:48:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:07.762 13:48:47 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:07.762 13:48:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:07.762 13:48:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:07.762 13:48:47 -- common/autotest_common.sh@10 -- # set +x 00:15:07.762 13:48:47 -- nvmf/common.sh@469 -- # nvmfpid=2268842 00:15:07.762 13:48:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:07.762 13:48:47 -- nvmf/common.sh@470 -- # waitforlisten 2268842 00:15:07.762 13:48:47 -- common/autotest_common.sh@829 -- # '[' -z 2268842 ']' 00:15:07.762 13:48:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:07.762 13:48:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:07.762 13:48:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:07.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:07.762 13:48:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:07.762 13:48:47 -- common/autotest_common.sh@10 -- # set +x 00:15:07.762 [2024-11-29 13:48:47.956644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:07.762 [2024-11-29 13:48:47.956726] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:07.762 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.762 [2024-11-29 13:48:48.021805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:08.021 [2024-11-29 13:48:48.108518] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.021 [2024-11-29 13:48:48.108670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.021 [2024-11-29 13:48:48.108687] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.021 [2024-11-29 13:48:48.108711] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.021 [2024-11-29 13:48:48.108768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.021 [2024-11-29 13:48:48.108773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:08.953 13:48:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:08.953 13:48:48 -- common/autotest_common.sh@862 -- # return 0 00:15:08.953 13:48:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:08.953 13:48:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 13:48:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 [2024-11-29 13:48:48.948251] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 [2024-11-29 13:48:48.964516] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 NULL1 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 Delay0 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:08.953 13:48:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.953 13:48:48 -- common/autotest_common.sh@10 -- # set +x 00:15:08.953 13:48:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@28 -- # perf_pid=2268996 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:08.953 13:48:48 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:08.953 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.953 [2024-11-29 13:48:49.039203] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:10.856 13:48:50 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:10.856 13:48:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.856 13:48:50 -- common/autotest_common.sh@10 -- # set +x 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.116 Read completed with error (sct=0, sc=8) 00:15:11.116 starting I/O failed: -6 00:15:11.116 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 [2024-11-29 13:48:51.171317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1adf810 is same with the state(5) to be set 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 starting I/O failed: -6 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Read completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.117 Write completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Write completed with error (sct=0, sc=8) 00:15:11.118 Write completed with error (sct=0, sc=8) 00:15:11.118 starting I/O failed: -6 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Write completed with error (sct=0, sc=8) 00:15:11.118 starting I/O failed: -6 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 starting I/O failed: -6 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Write completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:11.118 Read completed with error (sct=0, sc=8) 00:15:12.056 [2024-11-29 13:48:52.136018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae0a40 is same with the state(5) to be set 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 [2024-11-29 13:48:52.172627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1adf690 is same with the state(5) to be set 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 [2024-11-29 13:48:52.172898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe24400bf20 is same with the state(5) to be set 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 [2024-11-29 13:48:52.173078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae0c90 is same with the state(5) to be set 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Write completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.056 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 Write completed with error (sct=0, sc=8) 00:15:12.057 Read completed with error (sct=0, sc=8) 00:15:12.057 [2024-11-29 13:48:52.173330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe24400c600 is same with the state(5) to be set 00:15:12.057 [2024-11-29 13:48:52.174331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae0a40 (9): Bad file descriptor 00:15:12.057 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:12.057 13:48:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.057 13:48:52 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:12.057 13:48:52 -- target/delete_subsystem.sh@35 -- # kill -0 2268996 00:15:12.057 13:48:52 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:12.057 Initializing NVMe Controllers 00:15:12.057 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:12.057 Controller IO queue size 128, less than required. 00:15:12.057 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:12.057 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:12.057 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:12.057 Initialization complete. Launching workers. 00:15:12.057 ======================================================== 00:15:12.057 Latency(us) 00:15:12.057 Device Information : IOPS MiB/s Average min max 00:15:12.057 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 171.62 0.08 893218.77 631.03 1015016.26 00:15:12.057 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 188.98 0.09 897653.25 656.05 1013955.39 00:15:12.057 ======================================================== 00:15:12.057 Total : 360.60 0.18 895542.75 631.03 1015016.26 00:15:12.057 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@35 -- # kill -0 2268996 00:15:12.626 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2268996) - No such process 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@45 -- # NOT wait 2268996 00:15:12.626 13:48:52 -- common/autotest_common.sh@650 -- # local es=0 00:15:12.626 13:48:52 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2268996 00:15:12.626 13:48:52 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:12.626 13:48:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.626 13:48:52 -- common/autotest_common.sh@642 -- # type -t wait 00:15:12.626 13:48:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.626 13:48:52 -- common/autotest_common.sh@653 -- # wait 2268996 00:15:12.626 13:48:52 -- common/autotest_common.sh@653 -- # es=1 00:15:12.626 13:48:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:12.626 13:48:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:12.626 13:48:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:12.626 13:48:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.626 13:48:52 -- common/autotest_common.sh@10 -- # set +x 00:15:12.626 13:48:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:12.626 13:48:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.626 13:48:52 -- common/autotest_common.sh@10 -- # set +x 00:15:12.626 [2024-11-29 13:48:52.694174] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:12.626 13:48:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:12.626 13:48:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.626 13:48:52 -- common/autotest_common.sh@10 -- # set +x 00:15:12.626 13:48:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@54 -- # perf_pid=2269525 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:12.626 13:48:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:12.626 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.626 [2024-11-29 13:48:52.760995] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:13.195 13:48:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.195 13:48:53 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:13.195 13:48:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:13.453 13:48:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.453 13:48:53 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:13.453 13:48:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.023 13:48:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.023 13:48:54 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:14.023 13:48:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.593 13:48:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.593 13:48:54 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:14.593 13:48:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.160 13:48:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.160 13:48:55 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:15.160 13:48:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.729 13:48:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.729 13:48:55 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:15.729 13:48:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.988 Initializing NVMe Controllers 00:15:15.988 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:15.988 Controller IO queue size 128, less than required. 00:15:15.988 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:15.988 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:15.988 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:15.988 Initialization complete. Launching workers. 00:15:15.988 ======================================================== 00:15:15.988 Latency(us) 00:15:15.988 Device Information : IOPS MiB/s Average min max 00:15:15.988 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004581.60 1000148.16 1042337.36 00:15:15.988 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004190.31 1000164.84 1010558.39 00:15:15.988 ======================================================== 00:15:15.988 Total : 256.00 0.12 1004385.95 1000148.16 1042337.36 00:15:15.988 00:15:15.988 13:48:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.988 13:48:56 -- target/delete_subsystem.sh@57 -- # kill -0 2269525 00:15:15.988 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2269525) - No such process 00:15:15.988 13:48:56 -- target/delete_subsystem.sh@67 -- # wait 2269525 00:15:15.988 13:48:56 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:15.988 13:48:56 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:15.988 13:48:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:15.989 13:48:56 -- nvmf/common.sh@116 -- # sync 00:15:15.989 13:48:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:15.989 13:48:56 -- nvmf/common.sh@119 -- # set +e 00:15:15.989 13:48:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:15.989 13:48:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:15.989 rmmod nvme_tcp 00:15:15.989 rmmod nvme_fabrics 00:15:15.989 rmmod nvme_keyring 00:15:16.247 13:48:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:16.247 13:48:56 -- nvmf/common.sh@123 -- # set -e 00:15:16.247 13:48:56 -- nvmf/common.sh@124 -- # return 0 00:15:16.247 13:48:56 -- nvmf/common.sh@477 -- # '[' -n 2268842 ']' 00:15:16.247 13:48:56 -- nvmf/common.sh@478 -- # killprocess 2268842 00:15:16.247 13:48:56 -- common/autotest_common.sh@936 -- # '[' -z 2268842 ']' 00:15:16.248 13:48:56 -- common/autotest_common.sh@940 -- # kill -0 2268842 00:15:16.248 13:48:56 -- common/autotest_common.sh@941 -- # uname 00:15:16.248 13:48:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.248 13:48:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2268842 00:15:16.248 13:48:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:16.248 13:48:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:16.248 13:48:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2268842' 00:15:16.248 killing process with pid 2268842 00:15:16.248 13:48:56 -- common/autotest_common.sh@955 -- # kill 2268842 00:15:16.248 13:48:56 -- common/autotest_common.sh@960 -- # wait 2268842 00:15:16.508 13:48:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:16.508 13:48:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:16.508 13:48:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:16.508 13:48:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:16.508 13:48:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:16.508 13:48:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.508 13:48:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.508 13:48:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.418 13:48:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:18.418 00:15:18.418 real 0m12.935s 00:15:18.418 user 0m29.457s 00:15:18.418 sys 0m2.891s 00:15:18.418 13:48:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:18.418 13:48:58 -- common/autotest_common.sh@10 -- # set +x 00:15:18.418 ************************************ 00:15:18.418 END TEST nvmf_delete_subsystem 00:15:18.418 ************************************ 00:15:18.418 13:48:58 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:18.418 13:48:58 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:18.418 13:48:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:18.418 13:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:18.418 13:48:58 -- common/autotest_common.sh@10 -- # set +x 00:15:18.418 ************************************ 00:15:18.418 START TEST nvmf_nvme_cli 00:15:18.418 ************************************ 00:15:18.418 13:48:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:18.418 * Looking for test storage... 00:15:18.418 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:18.418 13:48:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:18.418 13:48:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:18.418 13:48:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:18.678 13:48:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:18.678 13:48:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:18.678 13:48:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:18.678 13:48:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:18.678 13:48:58 -- scripts/common.sh@335 -- # IFS=.-: 00:15:18.678 13:48:58 -- scripts/common.sh@335 -- # read -ra ver1 00:15:18.678 13:48:58 -- scripts/common.sh@336 -- # IFS=.-: 00:15:18.678 13:48:58 -- scripts/common.sh@336 -- # read -ra ver2 00:15:18.678 13:48:58 -- scripts/common.sh@337 -- # local 'op=<' 00:15:18.678 13:48:58 -- scripts/common.sh@339 -- # ver1_l=2 00:15:18.678 13:48:58 -- scripts/common.sh@340 -- # ver2_l=1 00:15:18.678 13:48:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:18.678 13:48:58 -- scripts/common.sh@343 -- # case "$op" in 00:15:18.678 13:48:58 -- scripts/common.sh@344 -- # : 1 00:15:18.678 13:48:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:18.678 13:48:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:18.678 13:48:58 -- scripts/common.sh@364 -- # decimal 1 00:15:18.678 13:48:58 -- scripts/common.sh@352 -- # local d=1 00:15:18.678 13:48:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:18.678 13:48:58 -- scripts/common.sh@354 -- # echo 1 00:15:18.678 13:48:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:18.678 13:48:58 -- scripts/common.sh@365 -- # decimal 2 00:15:18.678 13:48:58 -- scripts/common.sh@352 -- # local d=2 00:15:18.678 13:48:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:18.678 13:48:58 -- scripts/common.sh@354 -- # echo 2 00:15:18.678 13:48:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:18.678 13:48:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:18.678 13:48:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:18.678 13:48:58 -- scripts/common.sh@367 -- # return 0 00:15:18.678 13:48:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:18.678 13:48:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:18.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.678 --rc genhtml_branch_coverage=1 00:15:18.678 --rc genhtml_function_coverage=1 00:15:18.678 --rc genhtml_legend=1 00:15:18.678 --rc geninfo_all_blocks=1 00:15:18.678 --rc geninfo_unexecuted_blocks=1 00:15:18.678 00:15:18.678 ' 00:15:18.678 13:48:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:18.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.679 --rc genhtml_branch_coverage=1 00:15:18.679 --rc genhtml_function_coverage=1 00:15:18.679 --rc genhtml_legend=1 00:15:18.679 --rc geninfo_all_blocks=1 00:15:18.679 --rc geninfo_unexecuted_blocks=1 00:15:18.679 00:15:18.679 ' 00:15:18.679 13:48:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:18.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.679 --rc genhtml_branch_coverage=1 00:15:18.679 --rc genhtml_function_coverage=1 00:15:18.679 --rc genhtml_legend=1 00:15:18.679 --rc geninfo_all_blocks=1 00:15:18.679 --rc geninfo_unexecuted_blocks=1 00:15:18.679 00:15:18.679 ' 00:15:18.679 13:48:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:18.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.679 --rc genhtml_branch_coverage=1 00:15:18.679 --rc genhtml_function_coverage=1 00:15:18.679 --rc genhtml_legend=1 00:15:18.679 --rc geninfo_all_blocks=1 00:15:18.679 --rc geninfo_unexecuted_blocks=1 00:15:18.679 00:15:18.679 ' 00:15:18.679 13:48:58 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:18.679 13:48:58 -- nvmf/common.sh@7 -- # uname -s 00:15:18.679 13:48:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:18.679 13:48:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:18.679 13:48:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:18.679 13:48:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:18.679 13:48:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:18.679 13:48:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:18.679 13:48:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:18.679 13:48:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:18.679 13:48:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:18.679 13:48:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:18.679 13:48:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.679 13:48:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.679 13:48:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:18.679 13:48:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:18.679 13:48:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:18.679 13:48:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:18.679 13:48:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:18.679 13:48:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:18.679 13:48:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:18.679 13:48:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.679 13:48:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.679 13:48:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.679 13:48:58 -- paths/export.sh@5 -- # export PATH 00:15:18.679 13:48:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.679 13:48:58 -- nvmf/common.sh@46 -- # : 0 00:15:18.679 13:48:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:18.679 13:48:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:18.679 13:48:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:18.679 13:48:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:18.679 13:48:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:18.679 13:48:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:18.679 13:48:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:18.679 13:48:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:18.679 13:48:58 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:18.679 13:48:58 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:18.679 13:48:58 -- target/nvme_cli.sh@14 -- # devs=() 00:15:18.679 13:48:58 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:18.679 13:48:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:18.679 13:48:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:18.679 13:48:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:18.679 13:48:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:18.679 13:48:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:18.679 13:48:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.679 13:48:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.679 13:48:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.679 13:48:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:18.679 13:48:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:18.679 13:48:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:18.679 13:48:58 -- common/autotest_common.sh@10 -- # set +x 00:15:20.584 13:49:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:20.584 13:49:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:20.584 13:49:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:20.584 13:49:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:20.584 13:49:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:20.584 13:49:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:20.584 13:49:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:20.584 13:49:00 -- nvmf/common.sh@294 -- # net_devs=() 00:15:20.584 13:49:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:20.584 13:49:00 -- nvmf/common.sh@295 -- # e810=() 00:15:20.584 13:49:00 -- nvmf/common.sh@295 -- # local -ga e810 00:15:20.584 13:49:00 -- nvmf/common.sh@296 -- # x722=() 00:15:20.584 13:49:00 -- nvmf/common.sh@296 -- # local -ga x722 00:15:20.584 13:49:00 -- nvmf/common.sh@297 -- # mlx=() 00:15:20.584 13:49:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:20.584 13:49:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:20.584 13:49:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:20.584 13:49:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:20.584 13:49:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.584 13:49:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:20.584 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:20.584 13:49:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.584 13:49:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:20.584 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:20.584 13:49:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.584 13:49:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.584 13:49:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.584 13:49:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:20.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:20.584 13:49:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.584 13:49:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.584 13:49:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.584 13:49:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.584 13:49:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:20.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:20.584 13:49:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.584 13:49:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:20.584 13:49:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:20.584 13:49:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:20.584 13:49:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:20.584 13:49:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:20.584 13:49:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:20.584 13:49:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:20.584 13:49:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:20.584 13:49:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:20.584 13:49:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:20.584 13:49:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:20.584 13:49:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:20.584 13:49:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:20.584 13:49:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:20.585 13:49:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:20.847 13:49:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:20.847 13:49:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:20.847 13:49:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:20.847 13:49:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:20.847 13:49:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:20.847 13:49:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:20.847 13:49:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:20.847 13:49:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:20.847 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:20.847 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.376 ms 00:15:20.847 00:15:20.847 --- 10.0.0.2 ping statistics --- 00:15:20.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.847 rtt min/avg/max/mdev = 0.376/0.376/0.376/0.000 ms 00:15:20.847 13:49:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:20.847 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:20.847 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:15:20.847 00:15:20.847 --- 10.0.0.1 ping statistics --- 00:15:20.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.847 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:15:20.847 13:49:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:20.847 13:49:00 -- nvmf/common.sh@410 -- # return 0 00:15:20.847 13:49:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:20.847 13:49:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:20.847 13:49:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:20.847 13:49:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:20.847 13:49:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:20.847 13:49:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:20.847 13:49:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:20.847 13:49:01 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:20.847 13:49:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:20.847 13:49:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:20.847 13:49:01 -- common/autotest_common.sh@10 -- # set +x 00:15:20.847 13:49:01 -- nvmf/common.sh@469 -- # nvmfpid=2271904 00:15:20.847 13:49:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:20.847 13:49:01 -- nvmf/common.sh@470 -- # waitforlisten 2271904 00:15:20.847 13:49:01 -- common/autotest_common.sh@829 -- # '[' -z 2271904 ']' 00:15:20.847 13:49:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.847 13:49:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:20.847 13:49:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.847 13:49:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:20.847 13:49:01 -- common/autotest_common.sh@10 -- # set +x 00:15:20.847 [2024-11-29 13:49:01.069770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.847 [2024-11-29 13:49:01.069850] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:20.847 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.147 [2024-11-29 13:49:01.138744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:21.147 [2024-11-29 13:49:01.227189] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:21.147 [2024-11-29 13:49:01.227357] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.148 [2024-11-29 13:49:01.227374] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.148 [2024-11-29 13:49:01.227387] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.148 [2024-11-29 13:49:01.227449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:21.148 [2024-11-29 13:49:01.227514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:21.148 [2024-11-29 13:49:01.227563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:21.148 [2024-11-29 13:49:01.227566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:22.117 13:49:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:22.117 13:49:02 -- common/autotest_common.sh@862 -- # return 0 00:15:22.117 13:49:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:22.117 13:49:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 13:49:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:22.117 13:49:02 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 [2024-11-29 13:49:02.104168] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 Malloc0 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 Malloc1 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 [2024-11-29 13:49:02.185711] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:22.117 13:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.117 13:49:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.117 13:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.117 13:49:02 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:22.117 00:15:22.117 Discovery Log Number of Records 2, Generation counter 2 00:15:22.117 =====Discovery Log Entry 0====== 00:15:22.117 trtype: tcp 00:15:22.117 adrfam: ipv4 00:15:22.117 subtype: current discovery subsystem 00:15:22.117 treq: not required 00:15:22.117 portid: 0 00:15:22.117 trsvcid: 4420 00:15:22.117 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:22.117 traddr: 10.0.0.2 00:15:22.117 eflags: explicit discovery connections, duplicate discovery information 00:15:22.117 sectype: none 00:15:22.117 =====Discovery Log Entry 1====== 00:15:22.117 trtype: tcp 00:15:22.117 adrfam: ipv4 00:15:22.117 subtype: nvme subsystem 00:15:22.117 treq: not required 00:15:22.117 portid: 0 00:15:22.117 trsvcid: 4420 00:15:22.117 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:22.117 traddr: 10.0.0.2 00:15:22.117 eflags: none 00:15:22.117 sectype: none 00:15:22.117 13:49:02 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:22.117 13:49:02 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:22.117 13:49:02 -- nvmf/common.sh@510 -- # local dev _ 00:15:22.117 13:49:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.117 13:49:02 -- nvmf/common.sh@509 -- # nvme list 00:15:22.117 13:49:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:22.117 13:49:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.118 13:49:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:22.118 13:49:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.118 13:49:02 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:22.118 13:49:02 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:23.056 13:49:03 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:23.056 13:49:03 -- common/autotest_common.sh@1187 -- # local i=0 00:15:23.056 13:49:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:23.056 13:49:03 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:23.056 13:49:03 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:23.056 13:49:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:24.963 13:49:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:24.963 13:49:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:24.963 13:49:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:24.963 13:49:05 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:24.963 13:49:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:24.963 13:49:05 -- common/autotest_common.sh@1197 -- # return 0 00:15:24.964 13:49:05 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:24.964 13:49:05 -- nvmf/common.sh@510 -- # local dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@509 -- # nvme list 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:24.964 /dev/nvme0n2 ]] 00:15:24.964 13:49:05 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:24.964 13:49:05 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:24.964 13:49:05 -- nvmf/common.sh@510 -- # local dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@509 -- # nvme list 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:24.964 13:49:05 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:24.964 13:49:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:24.964 13:49:05 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:24.964 13:49:05 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:24.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:24.964 13:49:05 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:24.964 13:49:05 -- common/autotest_common.sh@1208 -- # local i=0 00:15:24.964 13:49:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:24.964 13:49:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:24.964 13:49:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:24.964 13:49:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:24.964 13:49:05 -- common/autotest_common.sh@1220 -- # return 0 00:15:24.964 13:49:05 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:24.964 13:49:05 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:24.964 13:49:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.964 13:49:05 -- common/autotest_common.sh@10 -- # set +x 00:15:24.964 13:49:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.964 13:49:05 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:24.964 13:49:05 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:24.964 13:49:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.964 13:49:05 -- nvmf/common.sh@116 -- # sync 00:15:24.964 13:49:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.964 13:49:05 -- nvmf/common.sh@119 -- # set +e 00:15:24.964 13:49:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.964 13:49:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.964 rmmod nvme_tcp 00:15:24.964 rmmod nvme_fabrics 00:15:24.964 rmmod nvme_keyring 00:15:25.223 13:49:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:25.223 13:49:05 -- nvmf/common.sh@123 -- # set -e 00:15:25.223 13:49:05 -- nvmf/common.sh@124 -- # return 0 00:15:25.223 13:49:05 -- nvmf/common.sh@477 -- # '[' -n 2271904 ']' 00:15:25.223 13:49:05 -- nvmf/common.sh@478 -- # killprocess 2271904 00:15:25.223 13:49:05 -- common/autotest_common.sh@936 -- # '[' -z 2271904 ']' 00:15:25.223 13:49:05 -- common/autotest_common.sh@940 -- # kill -0 2271904 00:15:25.223 13:49:05 -- common/autotest_common.sh@941 -- # uname 00:15:25.223 13:49:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:25.223 13:49:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2271904 00:15:25.223 13:49:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:25.223 13:49:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:25.223 13:49:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2271904' 00:15:25.223 killing process with pid 2271904 00:15:25.223 13:49:05 -- common/autotest_common.sh@955 -- # kill 2271904 00:15:25.223 13:49:05 -- common/autotest_common.sh@960 -- # wait 2271904 00:15:25.484 13:49:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:25.484 13:49:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:25.484 13:49:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:25.484 13:49:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:25.484 13:49:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:25.484 13:49:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.484 13:49:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.484 13:49:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.384 13:49:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:27.384 00:15:27.384 real 0m9.004s 00:15:27.384 user 0m18.161s 00:15:27.385 sys 0m2.305s 00:15:27.385 13:49:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:27.385 13:49:07 -- common/autotest_common.sh@10 -- # set +x 00:15:27.385 ************************************ 00:15:27.385 END TEST nvmf_nvme_cli 00:15:27.385 ************************************ 00:15:27.385 13:49:07 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:27.385 13:49:07 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:27.385 13:49:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:27.385 13:49:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:27.385 13:49:07 -- common/autotest_common.sh@10 -- # set +x 00:15:27.385 ************************************ 00:15:27.385 START TEST nvmf_vfio_user 00:15:27.385 ************************************ 00:15:27.385 13:49:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:27.644 * Looking for test storage... 00:15:27.644 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:27.644 13:49:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:27.644 13:49:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:27.644 13:49:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:27.644 13:49:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:27.644 13:49:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:27.644 13:49:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:27.644 13:49:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:27.644 13:49:07 -- scripts/common.sh@335 -- # IFS=.-: 00:15:27.644 13:49:07 -- scripts/common.sh@335 -- # read -ra ver1 00:15:27.644 13:49:07 -- scripts/common.sh@336 -- # IFS=.-: 00:15:27.644 13:49:07 -- scripts/common.sh@336 -- # read -ra ver2 00:15:27.644 13:49:07 -- scripts/common.sh@337 -- # local 'op=<' 00:15:27.644 13:49:07 -- scripts/common.sh@339 -- # ver1_l=2 00:15:27.644 13:49:07 -- scripts/common.sh@340 -- # ver2_l=1 00:15:27.644 13:49:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:27.644 13:49:07 -- scripts/common.sh@343 -- # case "$op" in 00:15:27.644 13:49:07 -- scripts/common.sh@344 -- # : 1 00:15:27.644 13:49:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:27.644 13:49:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:27.644 13:49:07 -- scripts/common.sh@364 -- # decimal 1 00:15:27.644 13:49:07 -- scripts/common.sh@352 -- # local d=1 00:15:27.644 13:49:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:27.644 13:49:07 -- scripts/common.sh@354 -- # echo 1 00:15:27.644 13:49:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:27.644 13:49:07 -- scripts/common.sh@365 -- # decimal 2 00:15:27.644 13:49:07 -- scripts/common.sh@352 -- # local d=2 00:15:27.644 13:49:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:27.644 13:49:07 -- scripts/common.sh@354 -- # echo 2 00:15:27.644 13:49:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:27.644 13:49:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:27.644 13:49:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:27.644 13:49:07 -- scripts/common.sh@367 -- # return 0 00:15:27.644 13:49:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:27.644 13:49:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:27.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.644 --rc genhtml_branch_coverage=1 00:15:27.644 --rc genhtml_function_coverage=1 00:15:27.644 --rc genhtml_legend=1 00:15:27.644 --rc geninfo_all_blocks=1 00:15:27.644 --rc geninfo_unexecuted_blocks=1 00:15:27.644 00:15:27.644 ' 00:15:27.644 13:49:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:27.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.644 --rc genhtml_branch_coverage=1 00:15:27.644 --rc genhtml_function_coverage=1 00:15:27.644 --rc genhtml_legend=1 00:15:27.644 --rc geninfo_all_blocks=1 00:15:27.644 --rc geninfo_unexecuted_blocks=1 00:15:27.644 00:15:27.644 ' 00:15:27.644 13:49:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:27.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.644 --rc genhtml_branch_coverage=1 00:15:27.644 --rc genhtml_function_coverage=1 00:15:27.644 --rc genhtml_legend=1 00:15:27.644 --rc geninfo_all_blocks=1 00:15:27.644 --rc geninfo_unexecuted_blocks=1 00:15:27.644 00:15:27.644 ' 00:15:27.644 13:49:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:27.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.644 --rc genhtml_branch_coverage=1 00:15:27.644 --rc genhtml_function_coverage=1 00:15:27.644 --rc genhtml_legend=1 00:15:27.644 --rc geninfo_all_blocks=1 00:15:27.644 --rc geninfo_unexecuted_blocks=1 00:15:27.644 00:15:27.644 ' 00:15:27.644 13:49:07 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:27.644 13:49:07 -- nvmf/common.sh@7 -- # uname -s 00:15:27.644 13:49:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:27.644 13:49:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:27.644 13:49:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:27.644 13:49:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:27.644 13:49:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:27.644 13:49:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:27.644 13:49:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:27.644 13:49:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:27.644 13:49:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:27.644 13:49:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:27.644 13:49:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.644 13:49:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.644 13:49:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:27.644 13:49:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:27.644 13:49:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:27.644 13:49:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:27.644 13:49:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:27.645 13:49:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:27.645 13:49:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:27.645 13:49:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.645 13:49:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.645 13:49:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.645 13:49:07 -- paths/export.sh@5 -- # export PATH 00:15:27.645 13:49:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.645 13:49:07 -- nvmf/common.sh@46 -- # : 0 00:15:27.645 13:49:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:27.645 13:49:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:27.645 13:49:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:27.645 13:49:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:27.645 13:49:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:27.645 13:49:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:27.645 13:49:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:27.645 13:49:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2272861 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2272861' 00:15:27.645 Process pid: 2272861 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:27.645 13:49:07 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2272861 00:15:27.645 13:49:07 -- common/autotest_common.sh@829 -- # '[' -z 2272861 ']' 00:15:27.645 13:49:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:27.645 13:49:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:27.645 13:49:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:27.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:27.645 13:49:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:27.645 13:49:07 -- common/autotest_common.sh@10 -- # set +x 00:15:27.645 [2024-11-29 13:49:07.878608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.645 [2024-11-29 13:49:07.878723] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:27.645 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.905 [2024-11-29 13:49:07.945152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:27.905 [2024-11-29 13:49:08.030507] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:27.905 [2024-11-29 13:49:08.030666] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:27.905 [2024-11-29 13:49:08.030694] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:27.905 [2024-11-29 13:49:08.030706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:27.905 [2024-11-29 13:49:08.030758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.905 [2024-11-29 13:49:08.030819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:27.905 [2024-11-29 13:49:08.030868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:27.905 [2024-11-29 13:49:08.030870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:28.841 13:49:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:28.841 13:49:08 -- common/autotest_common.sh@862 -- # return 0 00:15:28.841 13:49:08 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:29.774 13:49:09 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:30.032 13:49:10 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:30.032 13:49:10 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:30.032 13:49:10 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:30.032 13:49:10 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:30.032 13:49:10 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:30.289 Malloc1 00:15:30.290 13:49:10 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:30.547 13:49:10 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:30.805 13:49:11 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:31.062 13:49:11 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:31.062 13:49:11 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:31.062 13:49:11 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:31.320 Malloc2 00:15:31.320 13:49:11 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:31.577 13:49:11 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:31.834 13:49:12 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:32.090 13:49:12 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:32.090 [2024-11-29 13:49:12.343349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:32.090 [2024-11-29 13:49:12.343449] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2273432 ] 00:15:32.090 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.351 [2024-11-29 13:49:12.374196] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:32.351 [2024-11-29 13:49:12.382768] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.351 [2024-11-29 13:49:12.382795] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fd30f02e000 00:15:32.351 [2024-11-29 13:49:12.383760] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.384755] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.385756] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.386760] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.387766] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.388771] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.389777] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.390780] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.351 [2024-11-29 13:49:12.391789] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.351 [2024-11-29 13:49:12.391809] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fd30dd26000 00:15:32.351 [2024-11-29 13:49:12.392949] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.351 [2024-11-29 13:49:12.408052] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:32.351 [2024-11-29 13:49:12.408090] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:32.351 [2024-11-29 13:49:12.412925] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.351 [2024-11-29 13:49:12.412981] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:32.351 [2024-11-29 13:49:12.413078] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:32.351 [2024-11-29 13:49:12.413112] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:32.351 [2024-11-29 13:49:12.413124] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:32.351 [2024-11-29 13:49:12.413916] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:32.351 [2024-11-29 13:49:12.413936] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:32.351 [2024-11-29 13:49:12.413948] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:32.351 [2024-11-29 13:49:12.414920] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.351 [2024-11-29 13:49:12.414939] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:32.351 [2024-11-29 13:49:12.414952] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.415926] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:32.351 [2024-11-29 13:49:12.415944] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.416929] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:32.351 [2024-11-29 13:49:12.416949] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:32.351 [2024-11-29 13:49:12.416958] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.416969] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.417078] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:32.351 [2024-11-29 13:49:12.417086] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.417095] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:32.351 [2024-11-29 13:49:12.417936] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:32.351 [2024-11-29 13:49:12.418946] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:32.351 [2024-11-29 13:49:12.419955] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.351 [2024-11-29 13:49:12.420991] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:32.351 [2024-11-29 13:49:12.421964] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:32.351 [2024-11-29 13:49:12.421983] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:32.351 [2024-11-29 13:49:12.421992] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:32.351 [2024-11-29 13:49:12.422016] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:32.351 [2024-11-29 13:49:12.422029] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:32.351 [2024-11-29 13:49:12.422053] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.351 [2024-11-29 13:49:12.422063] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.351 [2024-11-29 13:49:12.422084] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.351 [2024-11-29 13:49:12.422170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:32.351 [2024-11-29 13:49:12.422187] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:32.351 [2024-11-29 13:49:12.422196] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:32.351 [2024-11-29 13:49:12.422203] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:32.351 [2024-11-29 13:49:12.422210] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:32.351 [2024-11-29 13:49:12.422219] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:32.351 [2024-11-29 13:49:12.422226] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:32.351 [2024-11-29 13:49:12.422233] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:32.351 [2024-11-29 13:49:12.422250] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:32.351 [2024-11-29 13:49:12.422266] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:32.351 [2024-11-29 13:49:12.422281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:32.351 [2024-11-29 13:49:12.422301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.351 [2024-11-29 13:49:12.422314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.351 [2024-11-29 13:49:12.422325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.351 [2024-11-29 13:49:12.422337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.351 [2024-11-29 13:49:12.422344] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422362] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422399] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422426] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:32.352 [2024-11-29 13:49:12.422435] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422446] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422460] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422475] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422552] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422567] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422580] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:32.352 [2024-11-29 13:49:12.422589] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:32.352 [2024-11-29 13:49:12.422598] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422642] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:32.352 [2024-11-29 13:49:12.422659] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422674] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422702] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.352 [2024-11-29 13:49:12.422710] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.352 [2024-11-29 13:49:12.422719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422780] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422795] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422807] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.352 [2024-11-29 13:49:12.422818] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.352 [2024-11-29 13:49:12.422828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422858] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422868] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422882] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422892] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422901] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422909] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:32.352 [2024-11-29 13:49:12.422917] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:32.352 [2024-11-29 13:49:12.422925] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:32.352 [2024-11-29 13:49:12.422950] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.422987] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.422998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423013] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.423024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423039] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.423050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423067] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:32.352 [2024-11-29 13:49:12.423076] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:32.352 [2024-11-29 13:49:12.423082] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:32.352 [2024-11-29 13:49:12.423087] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:32.352 [2024-11-29 13:49:12.423096] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:32.352 [2024-11-29 13:49:12.423107] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:32.352 [2024-11-29 13:49:12.423115] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:32.352 [2024-11-29 13:49:12.423124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.423138] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:32.352 [2024-11-29 13:49:12.423146] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.352 [2024-11-29 13:49:12.423154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.423165] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:32.352 [2024-11-29 13:49:12.423173] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:32.352 [2024-11-29 13:49:12.423181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:32.352 [2024-11-29 13:49:12.423192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:32.352 [2024-11-29 13:49:12.423239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:32.352 ===================================================== 00:15:32.352 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:32.352 ===================================================== 00:15:32.352 Controller Capabilities/Features 00:15:32.352 ================================ 00:15:32.352 Vendor ID: 4e58 00:15:32.352 Subsystem Vendor ID: 4e58 00:15:32.352 Serial Number: SPDK1 00:15:32.352 Model Number: SPDK bdev Controller 00:15:32.352 Firmware Version: 24.01.1 00:15:32.352 Recommended Arb Burst: 6 00:15:32.352 IEEE OUI Identifier: 8d 6b 50 00:15:32.352 Multi-path I/O 00:15:32.352 May have multiple subsystem ports: Yes 00:15:32.352 May have multiple controllers: Yes 00:15:32.352 Associated with SR-IOV VF: No 00:15:32.352 Max Data Transfer Size: 131072 00:15:32.352 Max Number of Namespaces: 32 00:15:32.352 Max Number of I/O Queues: 127 00:15:32.352 NVMe Specification Version (VS): 1.3 00:15:32.352 NVMe Specification Version (Identify): 1.3 00:15:32.352 Maximum Queue Entries: 256 00:15:32.352 Contiguous Queues Required: Yes 00:15:32.352 Arbitration Mechanisms Supported 00:15:32.352 Weighted Round Robin: Not Supported 00:15:32.352 Vendor Specific: Not Supported 00:15:32.352 Reset Timeout: 15000 ms 00:15:32.352 Doorbell Stride: 4 bytes 00:15:32.352 NVM Subsystem Reset: Not Supported 00:15:32.352 Command Sets Supported 00:15:32.352 NVM Command Set: Supported 00:15:32.352 Boot Partition: Not Supported 00:15:32.352 Memory Page Size Minimum: 4096 bytes 00:15:32.352 Memory Page Size Maximum: 4096 bytes 00:15:32.352 Persistent Memory Region: Not Supported 00:15:32.352 Optional Asynchronous Events Supported 00:15:32.352 Namespace Attribute Notices: Supported 00:15:32.352 Firmware Activation Notices: Not Supported 00:15:32.352 ANA Change Notices: Not Supported 00:15:32.352 PLE Aggregate Log Change Notices: Not Supported 00:15:32.352 LBA Status Info Alert Notices: Not Supported 00:15:32.352 EGE Aggregate Log Change Notices: Not Supported 00:15:32.352 Normal NVM Subsystem Shutdown event: Not Supported 00:15:32.352 Zone Descriptor Change Notices: Not Supported 00:15:32.352 Discovery Log Change Notices: Not Supported 00:15:32.352 Controller Attributes 00:15:32.352 128-bit Host Identifier: Supported 00:15:32.353 Non-Operational Permissive Mode: Not Supported 00:15:32.353 NVM Sets: Not Supported 00:15:32.353 Read Recovery Levels: Not Supported 00:15:32.353 Endurance Groups: Not Supported 00:15:32.353 Predictable Latency Mode: Not Supported 00:15:32.353 Traffic Based Keep ALive: Not Supported 00:15:32.353 Namespace Granularity: Not Supported 00:15:32.353 SQ Associations: Not Supported 00:15:32.353 UUID List: Not Supported 00:15:32.353 Multi-Domain Subsystem: Not Supported 00:15:32.353 Fixed Capacity Management: Not Supported 00:15:32.353 Variable Capacity Management: Not Supported 00:15:32.353 Delete Endurance Group: Not Supported 00:15:32.353 Delete NVM Set: Not Supported 00:15:32.353 Extended LBA Formats Supported: Not Supported 00:15:32.353 Flexible Data Placement Supported: Not Supported 00:15:32.353 00:15:32.353 Controller Memory Buffer Support 00:15:32.353 ================================ 00:15:32.353 Supported: No 00:15:32.353 00:15:32.353 Persistent Memory Region Support 00:15:32.353 ================================ 00:15:32.353 Supported: No 00:15:32.353 00:15:32.353 Admin Command Set Attributes 00:15:32.353 ============================ 00:15:32.353 Security Send/Receive: Not Supported 00:15:32.353 Format NVM: Not Supported 00:15:32.353 Firmware Activate/Download: Not Supported 00:15:32.353 Namespace Management: Not Supported 00:15:32.353 Device Self-Test: Not Supported 00:15:32.353 Directives: Not Supported 00:15:32.353 NVMe-MI: Not Supported 00:15:32.353 Virtualization Management: Not Supported 00:15:32.353 Doorbell Buffer Config: Not Supported 00:15:32.353 Get LBA Status Capability: Not Supported 00:15:32.353 Command & Feature Lockdown Capability: Not Supported 00:15:32.353 Abort Command Limit: 4 00:15:32.353 Async Event Request Limit: 4 00:15:32.353 Number of Firmware Slots: N/A 00:15:32.353 Firmware Slot 1 Read-Only: N/A 00:15:32.353 Firmware Activation Without Reset: N/A 00:15:32.353 Multiple Update Detection Support: N/A 00:15:32.353 Firmware Update Granularity: No Information Provided 00:15:32.353 Per-Namespace SMART Log: No 00:15:32.353 Asymmetric Namespace Access Log Page: Not Supported 00:15:32.353 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:32.353 Command Effects Log Page: Supported 00:15:32.353 Get Log Page Extended Data: Supported 00:15:32.353 Telemetry Log Pages: Not Supported 00:15:32.353 Persistent Event Log Pages: Not Supported 00:15:32.353 Supported Log Pages Log Page: May Support 00:15:32.353 Commands Supported & Effects Log Page: Not Supported 00:15:32.353 Feature Identifiers & Effects Log Page:May Support 00:15:32.353 NVMe-MI Commands & Effects Log Page: May Support 00:15:32.353 Data Area 4 for Telemetry Log: Not Supported 00:15:32.353 Error Log Page Entries Supported: 128 00:15:32.353 Keep Alive: Supported 00:15:32.353 Keep Alive Granularity: 10000 ms 00:15:32.353 00:15:32.353 NVM Command Set Attributes 00:15:32.353 ========================== 00:15:32.353 Submission Queue Entry Size 00:15:32.353 Max: 64 00:15:32.353 Min: 64 00:15:32.353 Completion Queue Entry Size 00:15:32.353 Max: 16 00:15:32.353 Min: 16 00:15:32.353 Number of Namespaces: 32 00:15:32.353 Compare Command: Supported 00:15:32.353 Write Uncorrectable Command: Not Supported 00:15:32.353 Dataset Management Command: Supported 00:15:32.353 Write Zeroes Command: Supported 00:15:32.353 Set Features Save Field: Not Supported 00:15:32.353 Reservations: Not Supported 00:15:32.353 Timestamp: Not Supported 00:15:32.353 Copy: Supported 00:15:32.353 Volatile Write Cache: Present 00:15:32.353 Atomic Write Unit (Normal): 1 00:15:32.353 Atomic Write Unit (PFail): 1 00:15:32.353 Atomic Compare & Write Unit: 1 00:15:32.353 Fused Compare & Write: Supported 00:15:32.353 Scatter-Gather List 00:15:32.353 SGL Command Set: Supported (Dword aligned) 00:15:32.353 SGL Keyed: Not Supported 00:15:32.353 SGL Bit Bucket Descriptor: Not Supported 00:15:32.353 SGL Metadata Pointer: Not Supported 00:15:32.353 Oversized SGL: Not Supported 00:15:32.353 SGL Metadata Address: Not Supported 00:15:32.353 SGL Offset: Not Supported 00:15:32.353 Transport SGL Data Block: Not Supported 00:15:32.353 Replay Protected Memory Block: Not Supported 00:15:32.353 00:15:32.353 Firmware Slot Information 00:15:32.353 ========================= 00:15:32.353 Active slot: 1 00:15:32.353 Slot 1 Firmware Revision: 24.01.1 00:15:32.353 00:15:32.353 00:15:32.353 Commands Supported and Effects 00:15:32.353 ============================== 00:15:32.353 Admin Commands 00:15:32.353 -------------- 00:15:32.353 Get Log Page (02h): Supported 00:15:32.353 Identify (06h): Supported 00:15:32.353 Abort (08h): Supported 00:15:32.353 Set Features (09h): Supported 00:15:32.353 Get Features (0Ah): Supported 00:15:32.353 Asynchronous Event Request (0Ch): Supported 00:15:32.353 Keep Alive (18h): Supported 00:15:32.353 I/O Commands 00:15:32.353 ------------ 00:15:32.353 Flush (00h): Supported LBA-Change 00:15:32.353 Write (01h): Supported LBA-Change 00:15:32.353 Read (02h): Supported 00:15:32.353 Compare (05h): Supported 00:15:32.353 Write Zeroes (08h): Supported LBA-Change 00:15:32.353 Dataset Management (09h): Supported LBA-Change 00:15:32.353 Copy (19h): Supported LBA-Change 00:15:32.353 Unknown (79h): Supported LBA-Change 00:15:32.353 Unknown (7Ah): Supported 00:15:32.353 00:15:32.353 Error Log 00:15:32.353 ========= 00:15:32.353 00:15:32.353 Arbitration 00:15:32.353 =========== 00:15:32.353 Arbitration Burst: 1 00:15:32.353 00:15:32.353 Power Management 00:15:32.353 ================ 00:15:32.353 Number of Power States: 1 00:15:32.353 Current Power State: Power State #0 00:15:32.353 Power State #0: 00:15:32.353 Max Power: 0.00 W 00:15:32.353 Non-Operational State: Operational 00:15:32.353 Entry Latency: Not Reported 00:15:32.353 Exit Latency: Not Reported 00:15:32.353 Relative Read Throughput: 0 00:15:32.353 Relative Read Latency: 0 00:15:32.353 Relative Write Throughput: 0 00:15:32.353 Relative Write Latency: 0 00:15:32.353 Idle Power: Not Reported 00:15:32.353 Active Power: Not Reported 00:15:32.353 Non-Operational Permissive Mode: Not Supported 00:15:32.353 00:15:32.353 Health Information 00:15:32.353 ================== 00:15:32.353 Critical Warnings: 00:15:32.353 Available Spare Space: OK 00:15:32.353 Temperature: OK 00:15:32.353 Device Reliability: OK 00:15:32.353 Read Only: No 00:15:32.353 Volatile Memory Backup: OK 00:15:32.353 Current Temperature: 0 Kelvin[2024-11-29 13:49:12.423360] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:32.353 [2024-11-29 13:49:12.423402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:32.353 [2024-11-29 13:49:12.423443] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:32.353 [2024-11-29 13:49:12.423461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.353 [2024-11-29 13:49:12.423472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.353 [2024-11-29 13:49:12.423482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.353 [2024-11-29 13:49:12.423491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.353 [2024-11-29 13:49:12.427406] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.353 [2024-11-29 13:49:12.427437] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:32.353 [2024-11-29 13:49:12.428032] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:32.353 [2024-11-29 13:49:12.428045] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:32.353 [2024-11-29 13:49:12.428992] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:32.353 [2024-11-29 13:49:12.429015] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:32.353 [2024-11-29 13:49:12.429069] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:32.353 [2024-11-29 13:49:12.431033] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.353 (-273 Celsius) 00:15:32.353 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:32.353 Available Spare: 0% 00:15:32.353 Available Spare Threshold: 0% 00:15:32.353 Life Percentage Used: 0% 00:15:32.353 Data Units Read: 0 00:15:32.353 Data Units Written: 0 00:15:32.353 Host Read Commands: 0 00:15:32.353 Host Write Commands: 0 00:15:32.353 Controller Busy Time: 0 minutes 00:15:32.353 Power Cycles: 0 00:15:32.353 Power On Hours: 0 hours 00:15:32.353 Unsafe Shutdowns: 0 00:15:32.353 Unrecoverable Media Errors: 0 00:15:32.353 Lifetime Error Log Entries: 0 00:15:32.353 Warning Temperature Time: 0 minutes 00:15:32.354 Critical Temperature Time: 0 minutes 00:15:32.354 00:15:32.354 Number of Queues 00:15:32.354 ================ 00:15:32.354 Number of I/O Submission Queues: 127 00:15:32.354 Number of I/O Completion Queues: 127 00:15:32.354 00:15:32.354 Active Namespaces 00:15:32.354 ================= 00:15:32.354 Namespace ID:1 00:15:32.354 Error Recovery Timeout: Unlimited 00:15:32.354 Command Set Identifier: NVM (00h) 00:15:32.354 Deallocate: Supported 00:15:32.354 Deallocated/Unwritten Error: Not Supported 00:15:32.354 Deallocated Read Value: Unknown 00:15:32.354 Deallocate in Write Zeroes: Not Supported 00:15:32.354 Deallocated Guard Field: 0xFFFF 00:15:32.354 Flush: Supported 00:15:32.354 Reservation: Supported 00:15:32.354 Namespace Sharing Capabilities: Multiple Controllers 00:15:32.354 Size (in LBAs): 131072 (0GiB) 00:15:32.354 Capacity (in LBAs): 131072 (0GiB) 00:15:32.354 Utilization (in LBAs): 131072 (0GiB) 00:15:32.354 NGUID: D96E01814EEF49FB8C7FD0D090E3E15A 00:15:32.354 UUID: d96e0181-4eef-49fb-8c7f-d0d090e3e15a 00:15:32.354 Thin Provisioning: Not Supported 00:15:32.354 Per-NS Atomic Units: Yes 00:15:32.354 Atomic Boundary Size (Normal): 0 00:15:32.354 Atomic Boundary Size (PFail): 0 00:15:32.354 Atomic Boundary Offset: 0 00:15:32.354 Maximum Single Source Range Length: 65535 00:15:32.354 Maximum Copy Length: 65535 00:15:32.354 Maximum Source Range Count: 1 00:15:32.354 NGUID/EUI64 Never Reused: No 00:15:32.354 Namespace Write Protected: No 00:15:32.354 Number of LBA Formats: 1 00:15:32.354 Current LBA Format: LBA Format #00 00:15:32.354 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:32.354 00:15:32.354 13:49:12 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:32.354 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.630 Initializing NVMe Controllers 00:15:37.630 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:37.630 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:37.630 Initialization complete. Launching workers. 00:15:37.630 ======================================================== 00:15:37.630 Latency(us) 00:15:37.630 Device Information : IOPS MiB/s Average min max 00:15:37.630 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37459.59 146.33 3417.45 1125.69 8247.25 00:15:37.630 ======================================================== 00:15:37.630 Total : 37459.59 146.33 3417.45 1125.69 8247.25 00:15:37.630 00:15:37.630 13:49:17 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:37.630 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.904 Initializing NVMe Controllers 00:15:42.904 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:42.904 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:42.904 Initialization complete. Launching workers. 00:15:42.904 ======================================================== 00:15:42.904 Latency(us) 00:15:42.904 Device Information : IOPS MiB/s Average min max 00:15:42.904 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 15974.40 62.40 8022.86 7529.85 15995.11 00:15:42.904 ======================================================== 00:15:42.904 Total : 15974.40 62.40 8022.86 7529.85 15995.11 00:15:42.904 00:15:42.904 13:49:23 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:42.904 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.197 Initializing NVMe Controllers 00:15:48.197 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.197 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.197 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:48.197 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:48.197 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:48.197 Initialization complete. Launching workers. 00:15:48.197 Starting thread on core 2 00:15:48.197 Starting thread on core 3 00:15:48.197 Starting thread on core 1 00:15:48.197 13:49:28 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:48.197 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.490 Initializing NVMe Controllers 00:15:51.490 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.490 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.490 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:51.490 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:51.490 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:51.490 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:51.490 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:51.490 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:51.490 Initialization complete. Launching workers. 00:15:51.490 Starting thread on core 1 with urgent priority queue 00:15:51.490 Starting thread on core 2 with urgent priority queue 00:15:51.490 Starting thread on core 3 with urgent priority queue 00:15:51.490 Starting thread on core 0 with urgent priority queue 00:15:51.490 SPDK bdev Controller (SPDK1 ) core 0: 2500.67 IO/s 39.99 secs/100000 ios 00:15:51.490 SPDK bdev Controller (SPDK1 ) core 1: 2722.33 IO/s 36.73 secs/100000 ios 00:15:51.490 SPDK bdev Controller (SPDK1 ) core 2: 2734.00 IO/s 36.58 secs/100000 ios 00:15:51.490 SPDK bdev Controller (SPDK1 ) core 3: 2705.00 IO/s 36.97 secs/100000 ios 00:15:51.490 ======================================================== 00:15:51.490 00:15:51.490 13:49:31 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:51.490 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.748 Initializing NVMe Controllers 00:15:51.748 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.748 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.748 Namespace ID: 1 size: 0GB 00:15:51.748 Initialization complete. 00:15:51.748 INFO: using host memory buffer for IO 00:15:51.748 Hello world! 00:15:51.748 13:49:31 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:52.008 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.387 Initializing NVMe Controllers 00:15:53.387 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.387 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.387 Initialization complete. Launching workers. 00:15:53.387 submit (in ns) avg, min, max = 7976.5, 3425.6, 4019724.4 00:15:53.387 complete (in ns) avg, min, max = 26422.4, 2045.6, 4021135.6 00:15:53.387 00:15:53.387 Submit histogram 00:15:53.387 ================ 00:15:53.387 Range in us Cumulative Count 00:15:53.387 3.413 - 3.437: 0.0291% ( 4) 00:15:53.387 3.437 - 3.461: 0.5754% ( 75) 00:15:53.387 3.461 - 3.484: 2.0905% ( 208) 00:15:53.387 3.484 - 3.508: 5.4847% ( 466) 00:15:53.387 3.508 - 3.532: 11.7489% ( 860) 00:15:53.387 3.532 - 3.556: 21.6549% ( 1360) 00:15:53.387 3.556 - 3.579: 29.9002% ( 1132) 00:15:53.387 3.579 - 3.603: 37.9343% ( 1103) 00:15:53.387 3.603 - 3.627: 44.5043% ( 902) 00:15:53.387 3.627 - 3.650: 51.1035% ( 906) 00:15:53.387 3.650 - 3.674: 55.6413% ( 623) 00:15:53.387 3.674 - 3.698: 59.6183% ( 546) 00:15:53.387 3.698 - 3.721: 63.1728% ( 488) 00:15:53.387 3.721 - 3.745: 66.8293% ( 502) 00:15:53.387 3.745 - 3.769: 70.6097% ( 519) 00:15:53.387 3.769 - 3.793: 74.6231% ( 551) 00:15:53.387 3.793 - 3.816: 79.0007% ( 601) 00:15:53.387 3.816 - 3.840: 82.3439% ( 459) 00:15:53.387 3.840 - 3.864: 85.2793% ( 403) 00:15:53.387 3.864 - 3.887: 87.0129% ( 238) 00:15:53.387 3.887 - 3.911: 88.7537% ( 239) 00:15:53.387 3.911 - 3.935: 90.3489% ( 219) 00:15:53.387 3.935 - 3.959: 91.4925% ( 157) 00:15:53.387 3.959 - 3.982: 92.3738% ( 121) 00:15:53.387 3.982 - 4.006: 93.3061% ( 128) 00:15:53.387 4.006 - 4.030: 94.1875% ( 121) 00:15:53.387 4.030 - 4.053: 94.8503% ( 91) 00:15:53.387 4.053 - 4.077: 95.3238% ( 65) 00:15:53.387 4.077 - 4.101: 95.6661% ( 47) 00:15:53.387 4.101 - 4.124: 95.8992% ( 32) 00:15:53.387 4.124 - 4.148: 96.0959% ( 27) 00:15:53.387 4.148 - 4.172: 96.2488% ( 21) 00:15:53.387 4.172 - 4.196: 96.4018% ( 21) 00:15:53.387 4.196 - 4.219: 96.5620% ( 22) 00:15:53.387 4.219 - 4.243: 96.6567% ( 13) 00:15:53.387 4.243 - 4.267: 96.7514% ( 13) 00:15:53.387 4.267 - 4.290: 96.8752% ( 17) 00:15:53.387 4.290 - 4.314: 96.8971% ( 3) 00:15:53.387 4.314 - 4.338: 96.9481% ( 7) 00:15:53.387 4.338 - 4.361: 96.9918% ( 6) 00:15:53.387 4.361 - 4.385: 97.0136% ( 3) 00:15:53.387 4.385 - 4.409: 97.0428% ( 4) 00:15:53.387 4.409 - 4.433: 97.0719% ( 4) 00:15:53.387 4.433 - 4.456: 97.0865% ( 2) 00:15:53.387 4.480 - 4.504: 97.1010% ( 2) 00:15:53.387 4.527 - 4.551: 97.1083% ( 1) 00:15:53.387 4.551 - 4.575: 97.1229% ( 2) 00:15:53.387 4.575 - 4.599: 97.1447% ( 3) 00:15:53.387 4.622 - 4.646: 97.1739% ( 4) 00:15:53.387 4.646 - 4.670: 97.1957% ( 3) 00:15:53.387 4.670 - 4.693: 97.2321% ( 5) 00:15:53.387 4.693 - 4.717: 97.2613% ( 4) 00:15:53.387 4.717 - 4.741: 97.3195% ( 8) 00:15:53.387 4.741 - 4.764: 97.3705% ( 7) 00:15:53.387 4.764 - 4.788: 97.4215% ( 7) 00:15:53.387 4.788 - 4.812: 97.4434% ( 3) 00:15:53.387 4.812 - 4.836: 97.4871% ( 6) 00:15:53.387 4.836 - 4.859: 97.5016% ( 2) 00:15:53.387 4.859 - 4.883: 97.5526% ( 7) 00:15:53.387 4.883 - 4.907: 97.5818% ( 4) 00:15:53.387 4.907 - 4.930: 97.6255% ( 6) 00:15:53.387 4.930 - 4.954: 97.6400% ( 2) 00:15:53.387 4.954 - 4.978: 97.6619% ( 3) 00:15:53.387 4.978 - 5.001: 97.6983% ( 5) 00:15:53.387 5.001 - 5.025: 97.7129% ( 2) 00:15:53.387 5.025 - 5.049: 97.7347% ( 3) 00:15:53.387 5.049 - 5.073: 97.7639% ( 4) 00:15:53.387 5.073 - 5.096: 97.7784% ( 2) 00:15:53.387 5.096 - 5.120: 97.7930% ( 2) 00:15:53.387 5.120 - 5.144: 97.8076% ( 2) 00:15:53.387 5.144 - 5.167: 97.8294% ( 3) 00:15:53.387 5.167 - 5.191: 97.8585% ( 4) 00:15:53.387 5.191 - 5.215: 97.8731% ( 2) 00:15:53.387 5.215 - 5.239: 97.8804% ( 1) 00:15:53.387 5.239 - 5.262: 97.8877% ( 1) 00:15:53.387 5.286 - 5.310: 97.9023% ( 2) 00:15:53.387 5.310 - 5.333: 97.9168% ( 2) 00:15:53.387 5.333 - 5.357: 97.9241% ( 1) 00:15:53.387 5.523 - 5.547: 97.9387% ( 2) 00:15:53.387 5.570 - 5.594: 97.9605% ( 3) 00:15:53.387 5.641 - 5.665: 97.9678% ( 1) 00:15:53.387 5.665 - 5.689: 97.9751% ( 1) 00:15:53.387 5.689 - 5.713: 97.9824% ( 1) 00:15:53.387 5.713 - 5.736: 97.9897% ( 1) 00:15:53.387 5.760 - 5.784: 97.9969% ( 1) 00:15:53.387 5.784 - 5.807: 98.0042% ( 1) 00:15:53.387 5.902 - 5.926: 98.0115% ( 1) 00:15:53.387 5.973 - 5.997: 98.0188% ( 1) 00:15:53.387 5.997 - 6.021: 98.0406% ( 3) 00:15:53.387 6.044 - 6.068: 98.0479% ( 1) 00:15:53.387 6.068 - 6.116: 98.0552% ( 1) 00:15:53.387 6.116 - 6.163: 98.0698% ( 2) 00:15:53.387 6.210 - 6.258: 98.0843% ( 2) 00:15:53.387 6.447 - 6.495: 98.0916% ( 1) 00:15:53.387 6.542 - 6.590: 98.0989% ( 1) 00:15:53.387 6.637 - 6.684: 98.1062% ( 1) 00:15:53.387 6.732 - 6.779: 98.1135% ( 1) 00:15:53.387 6.874 - 6.921: 98.1208% ( 1) 00:15:53.387 6.921 - 6.969: 98.1281% ( 1) 00:15:53.387 7.016 - 7.064: 98.1353% ( 1) 00:15:53.387 7.159 - 7.206: 98.1426% ( 1) 00:15:53.387 7.443 - 7.490: 98.1499% ( 1) 00:15:53.387 7.585 - 7.633: 98.1645% ( 2) 00:15:53.387 7.633 - 7.680: 98.1718% ( 1) 00:15:53.387 7.680 - 7.727: 98.1790% ( 1) 00:15:53.387 7.727 - 7.775: 98.1936% ( 2) 00:15:53.387 7.822 - 7.870: 98.2009% ( 1) 00:15:53.387 7.870 - 7.917: 98.2082% ( 1) 00:15:53.387 8.107 - 8.154: 98.2227% ( 2) 00:15:53.387 8.154 - 8.201: 98.2300% ( 1) 00:15:53.387 8.296 - 8.344: 98.2373% ( 1) 00:15:53.387 8.344 - 8.391: 98.2519% ( 2) 00:15:53.387 8.391 - 8.439: 98.2664% ( 2) 00:15:53.387 8.628 - 8.676: 98.2737% ( 1) 00:15:53.387 8.676 - 8.723: 98.2810% ( 1) 00:15:53.387 8.770 - 8.818: 98.2883% ( 1) 00:15:53.388 8.818 - 8.865: 98.3029% ( 2) 00:15:53.388 8.865 - 8.913: 98.3174% ( 2) 00:15:53.388 8.913 - 8.960: 98.3320% ( 2) 00:15:53.388 8.960 - 9.007: 98.3466% ( 2) 00:15:53.388 9.102 - 9.150: 98.3757% ( 4) 00:15:53.388 9.150 - 9.197: 98.3830% ( 1) 00:15:53.388 9.197 - 9.244: 98.3903% ( 1) 00:15:53.388 9.244 - 9.292: 98.4121% ( 3) 00:15:53.388 9.292 - 9.339: 98.4267% ( 2) 00:15:53.388 9.387 - 9.434: 98.4340% ( 1) 00:15:53.388 9.434 - 9.481: 98.4413% ( 1) 00:15:53.388 9.529 - 9.576: 98.4485% ( 1) 00:15:53.388 9.576 - 9.624: 98.4631% ( 2) 00:15:53.388 9.624 - 9.671: 98.4777% ( 2) 00:15:53.388 9.671 - 9.719: 98.4995% ( 3) 00:15:53.388 9.766 - 9.813: 98.5141% ( 2) 00:15:53.388 9.861 - 9.908: 98.5214% ( 1) 00:15:53.388 9.908 - 9.956: 98.5287% ( 1) 00:15:53.388 9.956 - 10.003: 98.5432% ( 2) 00:15:53.388 10.145 - 10.193: 98.5505% ( 1) 00:15:53.388 10.193 - 10.240: 98.5578% ( 1) 00:15:53.388 10.240 - 10.287: 98.5651% ( 1) 00:15:53.388 10.335 - 10.382: 98.5724% ( 1) 00:15:53.388 10.430 - 10.477: 98.5796% ( 1) 00:15:53.388 10.524 - 10.572: 98.5869% ( 1) 00:15:53.388 10.572 - 10.619: 98.6015% ( 2) 00:15:53.388 10.619 - 10.667: 98.6088% ( 1) 00:15:53.388 10.856 - 10.904: 98.6234% ( 2) 00:15:53.388 10.904 - 10.951: 98.6306% ( 1) 00:15:53.388 10.951 - 10.999: 98.6525% ( 3) 00:15:53.388 11.046 - 11.093: 98.6598% ( 1) 00:15:53.388 11.188 - 11.236: 98.6671% ( 1) 00:15:53.388 11.378 - 11.425: 98.6743% ( 1) 00:15:53.388 11.473 - 11.520: 98.7035% ( 4) 00:15:53.388 11.662 - 11.710: 98.7108% ( 1) 00:15:53.388 11.710 - 11.757: 98.7180% ( 1) 00:15:53.388 11.757 - 11.804: 98.7253% ( 1) 00:15:53.388 11.947 - 11.994: 98.7326% ( 1) 00:15:53.388 11.994 - 12.041: 98.7399% ( 1) 00:15:53.388 12.089 - 12.136: 98.7545% ( 2) 00:15:53.388 12.136 - 12.231: 98.7617% ( 1) 00:15:53.388 12.231 - 12.326: 98.7763% ( 2) 00:15:53.388 12.326 - 12.421: 98.7836% ( 1) 00:15:53.388 12.421 - 12.516: 98.7909% ( 1) 00:15:53.388 12.610 - 12.705: 98.7982% ( 1) 00:15:53.388 12.895 - 12.990: 98.8127% ( 2) 00:15:53.388 12.990 - 13.084: 98.8200% ( 1) 00:15:53.388 13.179 - 13.274: 98.8273% ( 1) 00:15:53.388 13.274 - 13.369: 98.8346% ( 1) 00:15:53.388 13.369 - 13.464: 98.8419% ( 1) 00:15:53.388 13.464 - 13.559: 98.8637% ( 3) 00:15:53.388 13.559 - 13.653: 98.8710% ( 1) 00:15:53.388 13.653 - 13.748: 98.8856% ( 2) 00:15:53.388 13.748 - 13.843: 98.8929% ( 1) 00:15:53.388 13.843 - 13.938: 98.9074% ( 2) 00:15:53.388 13.938 - 14.033: 98.9147% ( 1) 00:15:53.388 14.317 - 14.412: 98.9220% ( 1) 00:15:53.388 14.507 - 14.601: 98.9293% ( 1) 00:15:53.388 14.601 - 14.696: 98.9366% ( 1) 00:15:53.388 14.696 - 14.791: 98.9438% ( 1) 00:15:53.388 14.791 - 14.886: 98.9584% ( 2) 00:15:53.388 14.981 - 15.076: 98.9730% ( 2) 00:15:53.388 16.687 - 16.782: 98.9803% ( 1) 00:15:53.388 16.782 - 16.877: 98.9875% ( 1) 00:15:53.388 17.161 - 17.256: 99.0021% ( 2) 00:15:53.388 17.256 - 17.351: 99.0240% ( 3) 00:15:53.388 17.351 - 17.446: 99.0385% ( 2) 00:15:53.388 17.446 - 17.541: 99.0822% ( 6) 00:15:53.388 17.541 - 17.636: 99.1114% ( 4) 00:15:53.388 17.636 - 17.730: 99.1551% ( 6) 00:15:53.388 17.730 - 17.825: 99.1915% ( 5) 00:15:53.388 17.825 - 17.920: 99.2425% ( 7) 00:15:53.388 17.920 - 18.015: 99.3080% ( 9) 00:15:53.388 18.015 - 18.110: 99.3590% ( 7) 00:15:53.388 18.110 - 18.204: 99.4027% ( 6) 00:15:53.388 18.204 - 18.299: 99.4974% ( 13) 00:15:53.388 18.299 - 18.394: 99.5848% ( 12) 00:15:53.388 18.394 - 18.489: 99.6285% ( 6) 00:15:53.388 18.489 - 18.584: 99.6431% ( 2) 00:15:53.388 18.584 - 18.679: 99.6941% ( 7) 00:15:53.388 18.679 - 18.773: 99.7232% ( 4) 00:15:53.388 18.773 - 18.868: 99.7596% ( 5) 00:15:53.388 18.868 - 18.963: 99.7669% ( 1) 00:15:53.388 19.058 - 19.153: 99.7815% ( 2) 00:15:53.388 19.153 - 19.247: 99.7888% ( 1) 00:15:53.388 19.247 - 19.342: 99.8033% ( 2) 00:15:53.388 19.342 - 19.437: 99.8106% ( 1) 00:15:53.388 20.006 - 20.101: 99.8179% ( 1) 00:15:53.388 20.385 - 20.480: 99.8325% ( 2) 00:15:53.388 21.049 - 21.144: 99.8398% ( 1) 00:15:53.388 22.187 - 22.281: 99.8470% ( 1) 00:15:53.388 22.661 - 22.756: 99.8543% ( 1) 00:15:53.388 23.135 - 23.230: 99.8616% ( 1) 00:15:53.388 23.230 - 23.324: 99.8689% ( 1) 00:15:53.388 23.704 - 23.799: 99.8762% ( 1) 00:15:53.388 24.273 - 24.462: 99.8907% ( 2) 00:15:53.388 27.686 - 27.876: 99.8980% ( 1) 00:15:53.388 3980.705 - 4004.978: 99.9636% ( 9) 00:15:53.388 4004.978 - 4029.250: 100.0000% ( 5) 00:15:53.388 00:15:53.388 Complete histogram 00:15:53.388 ================== 00:15:53.388 Range in us Cumulative Count 00:15:53.388 2.039 - 2.050: 0.4516% ( 62) 00:15:53.388 2.050 - 2.062: 9.7021% ( 1270) 00:15:53.388 2.062 - 2.074: 14.5896% ( 671) 00:15:53.388 2.074 - 2.086: 21.3781% ( 932) 00:15:53.388 2.086 - 2.098: 50.0838% ( 3941) 00:15:53.388 2.098 - 2.110: 58.7807% ( 1194) 00:15:53.388 2.110 - 2.121: 61.4466% ( 366) 00:15:53.388 2.121 - 2.133: 64.7389% ( 452) 00:15:53.388 2.133 - 2.145: 65.6639% ( 127) 00:15:53.388 2.145 - 2.157: 70.6752% ( 688) 00:15:53.388 2.157 - 2.169: 80.1224% ( 1297) 00:15:53.388 2.169 - 2.181: 82.6134% ( 342) 00:15:53.388 2.181 - 2.193: 84.2960% ( 231) 00:15:53.388 2.193 - 2.204: 85.8329% ( 211) 00:15:53.388 2.204 - 2.216: 86.5467% ( 98) 00:15:53.388 2.216 - 2.228: 89.5040% ( 406) 00:15:53.388 2.228 - 2.240: 92.9638% ( 475) 00:15:53.388 2.240 - 2.252: 94.0782% ( 153) 00:15:53.388 2.252 - 2.264: 94.6318% ( 76) 00:15:53.388 2.264 - 2.276: 94.9523% ( 44) 00:15:53.388 2.276 - 2.287: 95.1708% ( 30) 00:15:53.388 2.287 - 2.299: 95.6151% ( 61) 00:15:53.388 2.299 - 2.311: 95.7462% ( 18) 00:15:53.388 2.311 - 2.323: 95.7972% ( 7) 00:15:53.388 2.323 - 2.335: 95.9429% ( 20) 00:15:53.388 2.335 - 2.347: 96.1250% ( 25) 00:15:53.388 2.347 - 2.359: 96.3217% ( 27) 00:15:53.388 2.359 - 2.370: 96.6421% ( 44) 00:15:53.388 2.370 - 2.382: 96.9481% ( 42) 00:15:53.388 2.382 - 2.394: 97.2176% ( 37) 00:15:53.388 2.394 - 2.406: 97.4652% ( 34) 00:15:53.388 2.406 - 2.418: 97.5672% ( 14) 00:15:53.388 2.418 - 2.430: 97.7420% ( 24) 00:15:53.388 2.430 - 2.441: 97.8658% ( 17) 00:15:53.388 2.441 - 2.453: 97.9678% ( 14) 00:15:53.388 2.453 - 2.465: 98.0843% ( 16) 00:15:53.388 2.465 - 2.477: 98.1572% ( 10) 00:15:53.388 2.477 - 2.489: 98.2373% ( 11) 00:15:53.388 2.489 - 2.501: 98.3029% ( 9) 00:15:53.388 2.501 - 2.513: 98.3320% ( 4) 00:15:53.388 2.513 - 2.524: 98.3466% ( 2) 00:15:53.388 2.524 - 2.536: 98.3684% ( 3) 00:15:53.388 2.548 - 2.560: 98.4048% ( 5) 00:15:53.388 2.584 - 2.596: 98.4194% ( 2) 00:15:53.388 2.596 - 2.607: 98.4340% ( 2) 00:15:53.388 2.631 - 2.643: 98.4413% ( 1) 00:15:53.388 2.655 - 2.667: 98.4558% ( 2) 00:15:53.388 2.667 - 2.679: 98.4631% ( 1) 00:15:53.388 2.679 - 2.690: 98.4850% ( 3) 00:15:53.388 2.714 - 2.726: 98.4922% ( 1) 00:15:53.388 3.200 - 3.224: 98.4995% ( 1) 00:15:53.388 3.224 - 3.247: 98.5068% ( 1) 00:15:53.388 3.247 - 3.271: 98.5214% ( 2) 00:15:53.388 3.271 - 3.295: 98.5359% ( 2) 00:15:53.388 3.295 - 3.319: 98.5651% ( 4) 00:15:53.388 3.319 - 3.342: 98.5724% ( 1) 00:15:53.388 3.342 - 3.366: 98.5796% ( 1) 00:15:53.388 3.366 - 3.390: 98.5869% ( 1) 00:15:53.388 3.390 - 3.413: 98.5942% ( 1) 00:15:53.388 3.413 - 3.437: 98.6015% ( 1) 00:15:53.388 3.437 - 3.461: 98.6161% ( 2) 00:15:53.388 3.461 - 3.484: 98.6306% ( 2) 00:15:53.388 3.508 - 3.532: 98.6379% ( 1) 00:15:53.388 3.556 - 3.579: 98.6525% ( 2) 00:15:53.388 3.674 - 3.698: 98.6598% ( 1) 00:15:53.388 3.769 - 3.793: 98.6671% ( 1) 00:15:53.388 3.793 - 3.816: 98.6743% ( 1) 00:15:53.388 3.840 - 3.864: 98.6816% ( 1) 00:15:53.388 5.523 - 5.547: 98.6889% ( 1) 00:15:53.388 5.594 - 5.618: 98.6962% ( 1) 00:15:53.388 6.163 - 6.210: 98.7035% ( 1) 00:15:53.388 6.353 - 6.400: 98.7108% ( 1) 00:15:53.388 6.447 - 6.495: 98.7180% ( 1) 00:15:53.388 6.732 - 6.779: 98.7253% ( 1) 00:15:53.388 6.779 - 6.827: 98.7326% ( 1) 00:15:53.388 6.969 - 7.016: 98.7545% ( 3) 00:15:53.388 7.064 - 7.111: 98.7617% ( 1) 00:15:53.388 7.111 - 7.159: 98.7836% ( 3) 00:15:53.388 7.490 - 7.538: 98.7909% ( 1) 00:15:53.388 7.633 - 7.680: 98.8054% ( 2) 00:15:53.388 8.296 - 8.344: 98.8127% ( 1) 00:15:53.388 9.102 - 9.150: 98.8200% ( 1) 00:15:53.388 10.240 - 10.287: 98.8273% ( 1) 00:15:53.388 11.899 - 11.947: 98.8346% ( 1) 00:15:53.388 12.516 - 12.610: 98.8419% ( 1) 00:15:53.388 15.360 - 15.455: 98.8564% ( 2) 00:15:53.388 15.644 - 15.739: 98.8710% ( 2) 00:15:53.388 15.739 - 15.834: 98.8783% ( 1) 00:15:53.388 15.834 - 15.929: 98.8856% ( 1) 00:15:53.388 15.929 - 16.024: 98.9001% ( 2) 00:15:53.388 16.024 - 16.119: 98.9220% ( 3) 00:15:53.388 16.119 - 16.213: 98.9366% ( 2) 00:15:53.388 16.213 - 16.308: 98.9584% ( 3) 00:15:53.389 16.308 - 16.403: 98.9875% ( 4) 00:15:53.389 16.403 - 16.498: 99.0167% ( 4) 00:15:53.389 16.498 - 16.593: 99.0968% ( 11) 00:15:53.389 16.593 - 16.687: 99.1624% ( 9) 00:15:53.389 16.687 - 16.782: 99.2279% ( 9) 00:15:53.389 16.782 - 16.877: 99.2716% ( 6) 00:15:53.389 16.877 - 16.972: 99.3008% ( 4) 00:15:53.389 16.972 - 17.067: 99.3153% ( 2) 00:15:53.389 17.067 - 17.161: 99.3226% ( 1) 00:15:53.389 17.161 - 17.256: 99.3372% ( 2) 00:15:53.389 17.256 - 17.351: 99.3517% ( 2) 00:15:53.389 17.541 - 17.636: 99.3736% ( 3) 00:15:53.389 17.730 - 17.825: 99.3809% ( 1) 00:15:53.389 23.230 - 23.324: 99.3882% ( 1) 00:15:53.389 25.410 - 25.600: 99.3954% ( 1) 00:15:53.389 3980.705 - 4004.978: 99.7815% ( 53) 00:15:53.389 4004.978 - 4029.250: 100.0000% ( 30) 00:15:53.389 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:53.389 [2024-11-29 13:49:33.589822] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:53.389 [ 00:15:53.389 { 00:15:53.389 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:53.389 "subtype": "Discovery", 00:15:53.389 "listen_addresses": [], 00:15:53.389 "allow_any_host": true, 00:15:53.389 "hosts": [] 00:15:53.389 }, 00:15:53.389 { 00:15:53.389 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:53.389 "subtype": "NVMe", 00:15:53.389 "listen_addresses": [ 00:15:53.389 { 00:15:53.389 "transport": "VFIOUSER", 00:15:53.389 "trtype": "VFIOUSER", 00:15:53.389 "adrfam": "IPv4", 00:15:53.389 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:53.389 "trsvcid": "0" 00:15:53.389 } 00:15:53.389 ], 00:15:53.389 "allow_any_host": true, 00:15:53.389 "hosts": [], 00:15:53.389 "serial_number": "SPDK1", 00:15:53.389 "model_number": "SPDK bdev Controller", 00:15:53.389 "max_namespaces": 32, 00:15:53.389 "min_cntlid": 1, 00:15:53.389 "max_cntlid": 65519, 00:15:53.389 "namespaces": [ 00:15:53.389 { 00:15:53.389 "nsid": 1, 00:15:53.389 "bdev_name": "Malloc1", 00:15:53.389 "name": "Malloc1", 00:15:53.389 "nguid": "D96E01814EEF49FB8C7FD0D090E3E15A", 00:15:53.389 "uuid": "d96e0181-4eef-49fb-8c7f-d0d090e3e15a" 00:15:53.389 } 00:15:53.389 ] 00:15:53.389 }, 00:15:53.389 { 00:15:53.389 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:53.389 "subtype": "NVMe", 00:15:53.389 "listen_addresses": [ 00:15:53.389 { 00:15:53.389 "transport": "VFIOUSER", 00:15:53.389 "trtype": "VFIOUSER", 00:15:53.389 "adrfam": "IPv4", 00:15:53.389 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:53.389 "trsvcid": "0" 00:15:53.389 } 00:15:53.389 ], 00:15:53.389 "allow_any_host": true, 00:15:53.389 "hosts": [], 00:15:53.389 "serial_number": "SPDK2", 00:15:53.389 "model_number": "SPDK bdev Controller", 00:15:53.389 "max_namespaces": 32, 00:15:53.389 "min_cntlid": 1, 00:15:53.389 "max_cntlid": 65519, 00:15:53.389 "namespaces": [ 00:15:53.389 { 00:15:53.389 "nsid": 1, 00:15:53.389 "bdev_name": "Malloc2", 00:15:53.389 "name": "Malloc2", 00:15:53.389 "nguid": "B0B5FFB71B374A85836BC7BBDF17018B", 00:15:53.389 "uuid": "b0b5ffb7-1b37-4a85-836b-c7bbdf17018b" 00:15:53.389 } 00:15:53.389 ] 00:15:53.389 } 00:15:53.389 ] 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2276022 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:53.389 13:49:33 -- common/autotest_common.sh@1254 -- # local i=0 00:15:53.389 13:49:33 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.389 13:49:33 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.389 13:49:33 -- common/autotest_common.sh@1265 -- # return 0 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:53.389 13:49:33 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:53.389 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.648 Malloc3 00:15:53.648 13:49:33 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:53.906 13:49:34 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:53.906 Asynchronous Event Request test 00:15:53.906 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.906 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.906 Registering asynchronous event callbacks... 00:15:53.906 Starting namespace attribute notice tests for all controllers... 00:15:53.906 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:53.906 aer_cb - Changed Namespace 00:15:53.906 Cleaning up... 00:15:54.167 [ 00:15:54.167 { 00:15:54.167 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:54.167 "subtype": "Discovery", 00:15:54.167 "listen_addresses": [], 00:15:54.167 "allow_any_host": true, 00:15:54.167 "hosts": [] 00:15:54.167 }, 00:15:54.167 { 00:15:54.167 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:54.167 "subtype": "NVMe", 00:15:54.167 "listen_addresses": [ 00:15:54.167 { 00:15:54.167 "transport": "VFIOUSER", 00:15:54.167 "trtype": "VFIOUSER", 00:15:54.167 "adrfam": "IPv4", 00:15:54.167 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:54.167 "trsvcid": "0" 00:15:54.167 } 00:15:54.167 ], 00:15:54.167 "allow_any_host": true, 00:15:54.167 "hosts": [], 00:15:54.167 "serial_number": "SPDK1", 00:15:54.167 "model_number": "SPDK bdev Controller", 00:15:54.167 "max_namespaces": 32, 00:15:54.167 "min_cntlid": 1, 00:15:54.167 "max_cntlid": 65519, 00:15:54.167 "namespaces": [ 00:15:54.167 { 00:15:54.167 "nsid": 1, 00:15:54.167 "bdev_name": "Malloc1", 00:15:54.167 "name": "Malloc1", 00:15:54.167 "nguid": "D96E01814EEF49FB8C7FD0D090E3E15A", 00:15:54.167 "uuid": "d96e0181-4eef-49fb-8c7f-d0d090e3e15a" 00:15:54.167 }, 00:15:54.167 { 00:15:54.167 "nsid": 2, 00:15:54.167 "bdev_name": "Malloc3", 00:15:54.167 "name": "Malloc3", 00:15:54.167 "nguid": "AB89B0EBD9944D9C84B6247E3846854B", 00:15:54.167 "uuid": "ab89b0eb-d994-4d9c-84b6-247e3846854b" 00:15:54.167 } 00:15:54.167 ] 00:15:54.167 }, 00:15:54.167 { 00:15:54.167 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:54.167 "subtype": "NVMe", 00:15:54.167 "listen_addresses": [ 00:15:54.167 { 00:15:54.167 "transport": "VFIOUSER", 00:15:54.167 "trtype": "VFIOUSER", 00:15:54.167 "adrfam": "IPv4", 00:15:54.167 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:54.167 "trsvcid": "0" 00:15:54.167 } 00:15:54.167 ], 00:15:54.167 "allow_any_host": true, 00:15:54.167 "hosts": [], 00:15:54.167 "serial_number": "SPDK2", 00:15:54.167 "model_number": "SPDK bdev Controller", 00:15:54.167 "max_namespaces": 32, 00:15:54.167 "min_cntlid": 1, 00:15:54.167 "max_cntlid": 65519, 00:15:54.167 "namespaces": [ 00:15:54.167 { 00:15:54.167 "nsid": 1, 00:15:54.167 "bdev_name": "Malloc2", 00:15:54.167 "name": "Malloc2", 00:15:54.167 "nguid": "B0B5FFB71B374A85836BC7BBDF17018B", 00:15:54.167 "uuid": "b0b5ffb7-1b37-4a85-836b-c7bbdf17018b" 00:15:54.167 } 00:15:54.167 ] 00:15:54.167 } 00:15:54.167 ] 00:15:54.167 13:49:34 -- target/nvmf_vfio_user.sh@44 -- # wait 2276022 00:15:54.167 13:49:34 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:54.167 13:49:34 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:54.167 13:49:34 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:54.167 13:49:34 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:54.167 [2024-11-29 13:49:34.409536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:54.167 [2024-11-29 13:49:34.409577] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2276044 ] 00:15:54.167 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.167 [2024-11-29 13:49:34.445634] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:54.167 [2024-11-29 13:49:34.447948] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.428 [2024-11-29 13:49:34.447978] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f10d36dc000 00:15:54.428 [2024-11-29 13:49:34.448968] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.449966] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.450980] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.451987] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.452986] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.453997] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.455004] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.456013] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.428 [2024-11-29 13:49:34.457028] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.428 [2024-11-29 13:49:34.457050] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f10d23d4000 00:15:54.428 [2024-11-29 13:49:34.458166] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.428 [2024-11-29 13:49:34.472036] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:54.428 [2024-11-29 13:49:34.472074] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:54.428 [2024-11-29 13:49:34.477197] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.428 [2024-11-29 13:49:34.477254] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:54.428 [2024-11-29 13:49:34.477344] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:54.428 [2024-11-29 13:49:34.477384] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:54.428 [2024-11-29 13:49:34.477406] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:54.428 [2024-11-29 13:49:34.478205] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:54.428 [2024-11-29 13:49:34.478225] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:54.428 [2024-11-29 13:49:34.478238] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:54.428 [2024-11-29 13:49:34.479207] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.428 [2024-11-29 13:49:34.479227] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:54.428 [2024-11-29 13:49:34.479241] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:54.428 [2024-11-29 13:49:34.480215] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:54.428 [2024-11-29 13:49:34.480235] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:54.428 [2024-11-29 13:49:34.481222] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:54.428 [2024-11-29 13:49:34.481242] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:54.428 [2024-11-29 13:49:34.481251] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:54.428 [2024-11-29 13:49:34.481263] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:54.429 [2024-11-29 13:49:34.481387] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:54.429 [2024-11-29 13:49:34.481403] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:54.429 [2024-11-29 13:49:34.481413] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:54.429 [2024-11-29 13:49:34.482231] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:54.429 [2024-11-29 13:49:34.483240] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:54.429 [2024-11-29 13:49:34.484247] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.429 [2024-11-29 13:49:34.485275] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:54.429 [2024-11-29 13:49:34.486253] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:54.429 [2024-11-29 13:49:34.486278] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:54.429 [2024-11-29 13:49:34.486288] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.486312] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:54.429 [2024-11-29 13:49:34.486325] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.486346] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.429 [2024-11-29 13:49:34.486356] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.429 [2024-11-29 13:49:34.486398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.494422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.494446] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:54.429 [2024-11-29 13:49:34.494456] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:54.429 [2024-11-29 13:49:34.494463] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:54.429 [2024-11-29 13:49:34.494471] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:54.429 [2024-11-29 13:49:34.494480] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:54.429 [2024-11-29 13:49:34.494488] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:54.429 [2024-11-29 13:49:34.494497] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.494515] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.494533] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.502405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.502434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.429 [2024-11-29 13:49:34.502449] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.429 [2024-11-29 13:49:34.502461] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.429 [2024-11-29 13:49:34.502472] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.429 [2024-11-29 13:49:34.502481] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.502497] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.502512] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.510403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.510423] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:54.429 [2024-11-29 13:49:34.510433] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.510445] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.510459] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.510474] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.518405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.518478] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.518493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.518505] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:54.429 [2024-11-29 13:49:34.518514] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:54.429 [2024-11-29 13:49:34.518524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.526406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.526436] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:54.429 [2024-11-29 13:49:34.526455] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.526471] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.526483] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.429 [2024-11-29 13:49:34.526492] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.429 [2024-11-29 13:49:34.526502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.534404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.534432] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.534449] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.534462] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.429 [2024-11-29 13:49:34.534471] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.429 [2024-11-29 13:49:34.534480] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.429 [2024-11-29 13:49:34.542406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:54.429 [2024-11-29 13:49:34.542428] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.542441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.542456] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.542467] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.542476] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:54.429 [2024-11-29 13:49:34.542484] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:54.430 [2024-11-29 13:49:34.542493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:54.430 [2024-11-29 13:49:34.542501] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:54.430 [2024-11-29 13:49:34.542526] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.550405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.550430] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.558409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.558460] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.566405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.566431] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.574405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.574433] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:54.430 [2024-11-29 13:49:34.574443] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:54.430 [2024-11-29 13:49:34.574449] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:54.430 [2024-11-29 13:49:34.574455] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:54.430 [2024-11-29 13:49:34.574465] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:54.430 [2024-11-29 13:49:34.574477] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:54.430 [2024-11-29 13:49:34.574486] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:54.430 [2024-11-29 13:49:34.574495] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.574506] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:54.430 [2024-11-29 13:49:34.574513] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.430 [2024-11-29 13:49:34.574527] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.574540] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:54.430 [2024-11-29 13:49:34.574548] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:54.430 [2024-11-29 13:49:34.574557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:54.430 [2024-11-29 13:49:34.582408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.582450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.582467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:54.430 [2024-11-29 13:49:34.582479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:54.430 ===================================================== 00:15:54.430 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:54.430 ===================================================== 00:15:54.430 Controller Capabilities/Features 00:15:54.430 ================================ 00:15:54.430 Vendor ID: 4e58 00:15:54.430 Subsystem Vendor ID: 4e58 00:15:54.430 Serial Number: SPDK2 00:15:54.430 Model Number: SPDK bdev Controller 00:15:54.430 Firmware Version: 24.01.1 00:15:54.430 Recommended Arb Burst: 6 00:15:54.430 IEEE OUI Identifier: 8d 6b 50 00:15:54.430 Multi-path I/O 00:15:54.430 May have multiple subsystem ports: Yes 00:15:54.430 May have multiple controllers: Yes 00:15:54.430 Associated with SR-IOV VF: No 00:15:54.430 Max Data Transfer Size: 131072 00:15:54.430 Max Number of Namespaces: 32 00:15:54.430 Max Number of I/O Queues: 127 00:15:54.430 NVMe Specification Version (VS): 1.3 00:15:54.430 NVMe Specification Version (Identify): 1.3 00:15:54.430 Maximum Queue Entries: 256 00:15:54.430 Contiguous Queues Required: Yes 00:15:54.430 Arbitration Mechanisms Supported 00:15:54.430 Weighted Round Robin: Not Supported 00:15:54.430 Vendor Specific: Not Supported 00:15:54.430 Reset Timeout: 15000 ms 00:15:54.430 Doorbell Stride: 4 bytes 00:15:54.430 NVM Subsystem Reset: Not Supported 00:15:54.430 Command Sets Supported 00:15:54.430 NVM Command Set: Supported 00:15:54.430 Boot Partition: Not Supported 00:15:54.430 Memory Page Size Minimum: 4096 bytes 00:15:54.430 Memory Page Size Maximum: 4096 bytes 00:15:54.430 Persistent Memory Region: Not Supported 00:15:54.430 Optional Asynchronous Events Supported 00:15:54.430 Namespace Attribute Notices: Supported 00:15:54.430 Firmware Activation Notices: Not Supported 00:15:54.430 ANA Change Notices: Not Supported 00:15:54.430 PLE Aggregate Log Change Notices: Not Supported 00:15:54.430 LBA Status Info Alert Notices: Not Supported 00:15:54.430 EGE Aggregate Log Change Notices: Not Supported 00:15:54.430 Normal NVM Subsystem Shutdown event: Not Supported 00:15:54.430 Zone Descriptor Change Notices: Not Supported 00:15:54.430 Discovery Log Change Notices: Not Supported 00:15:54.430 Controller Attributes 00:15:54.430 128-bit Host Identifier: Supported 00:15:54.430 Non-Operational Permissive Mode: Not Supported 00:15:54.430 NVM Sets: Not Supported 00:15:54.430 Read Recovery Levels: Not Supported 00:15:54.430 Endurance Groups: Not Supported 00:15:54.430 Predictable Latency Mode: Not Supported 00:15:54.430 Traffic Based Keep ALive: Not Supported 00:15:54.430 Namespace Granularity: Not Supported 00:15:54.430 SQ Associations: Not Supported 00:15:54.430 UUID List: Not Supported 00:15:54.430 Multi-Domain Subsystem: Not Supported 00:15:54.430 Fixed Capacity Management: Not Supported 00:15:54.430 Variable Capacity Management: Not Supported 00:15:54.430 Delete Endurance Group: Not Supported 00:15:54.430 Delete NVM Set: Not Supported 00:15:54.430 Extended LBA Formats Supported: Not Supported 00:15:54.430 Flexible Data Placement Supported: Not Supported 00:15:54.430 00:15:54.430 Controller Memory Buffer Support 00:15:54.430 ================================ 00:15:54.430 Supported: No 00:15:54.430 00:15:54.430 Persistent Memory Region Support 00:15:54.430 ================================ 00:15:54.430 Supported: No 00:15:54.430 00:15:54.430 Admin Command Set Attributes 00:15:54.430 ============================ 00:15:54.430 Security Send/Receive: Not Supported 00:15:54.430 Format NVM: Not Supported 00:15:54.430 Firmware Activate/Download: Not Supported 00:15:54.430 Namespace Management: Not Supported 00:15:54.430 Device Self-Test: Not Supported 00:15:54.430 Directives: Not Supported 00:15:54.430 NVMe-MI: Not Supported 00:15:54.430 Virtualization Management: Not Supported 00:15:54.430 Doorbell Buffer Config: Not Supported 00:15:54.430 Get LBA Status Capability: Not Supported 00:15:54.430 Command & Feature Lockdown Capability: Not Supported 00:15:54.430 Abort Command Limit: 4 00:15:54.430 Async Event Request Limit: 4 00:15:54.430 Number of Firmware Slots: N/A 00:15:54.431 Firmware Slot 1 Read-Only: N/A 00:15:54.431 Firmware Activation Without Reset: N/A 00:15:54.431 Multiple Update Detection Support: N/A 00:15:54.431 Firmware Update Granularity: No Information Provided 00:15:54.431 Per-Namespace SMART Log: No 00:15:54.431 Asymmetric Namespace Access Log Page: Not Supported 00:15:54.431 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:54.431 Command Effects Log Page: Supported 00:15:54.431 Get Log Page Extended Data: Supported 00:15:54.431 Telemetry Log Pages: Not Supported 00:15:54.431 Persistent Event Log Pages: Not Supported 00:15:54.431 Supported Log Pages Log Page: May Support 00:15:54.431 Commands Supported & Effects Log Page: Not Supported 00:15:54.431 Feature Identifiers & Effects Log Page:May Support 00:15:54.431 NVMe-MI Commands & Effects Log Page: May Support 00:15:54.431 Data Area 4 for Telemetry Log: Not Supported 00:15:54.431 Error Log Page Entries Supported: 128 00:15:54.431 Keep Alive: Supported 00:15:54.431 Keep Alive Granularity: 10000 ms 00:15:54.431 00:15:54.431 NVM Command Set Attributes 00:15:54.431 ========================== 00:15:54.431 Submission Queue Entry Size 00:15:54.431 Max: 64 00:15:54.431 Min: 64 00:15:54.431 Completion Queue Entry Size 00:15:54.431 Max: 16 00:15:54.431 Min: 16 00:15:54.431 Number of Namespaces: 32 00:15:54.431 Compare Command: Supported 00:15:54.431 Write Uncorrectable Command: Not Supported 00:15:54.431 Dataset Management Command: Supported 00:15:54.431 Write Zeroes Command: Supported 00:15:54.431 Set Features Save Field: Not Supported 00:15:54.431 Reservations: Not Supported 00:15:54.431 Timestamp: Not Supported 00:15:54.431 Copy: Supported 00:15:54.431 Volatile Write Cache: Present 00:15:54.431 Atomic Write Unit (Normal): 1 00:15:54.431 Atomic Write Unit (PFail): 1 00:15:54.431 Atomic Compare & Write Unit: 1 00:15:54.431 Fused Compare & Write: Supported 00:15:54.431 Scatter-Gather List 00:15:54.431 SGL Command Set: Supported (Dword aligned) 00:15:54.431 SGL Keyed: Not Supported 00:15:54.431 SGL Bit Bucket Descriptor: Not Supported 00:15:54.431 SGL Metadata Pointer: Not Supported 00:15:54.431 Oversized SGL: Not Supported 00:15:54.431 SGL Metadata Address: Not Supported 00:15:54.431 SGL Offset: Not Supported 00:15:54.431 Transport SGL Data Block: Not Supported 00:15:54.431 Replay Protected Memory Block: Not Supported 00:15:54.431 00:15:54.431 Firmware Slot Information 00:15:54.431 ========================= 00:15:54.431 Active slot: 1 00:15:54.431 Slot 1 Firmware Revision: 24.01.1 00:15:54.431 00:15:54.431 00:15:54.431 Commands Supported and Effects 00:15:54.431 ============================== 00:15:54.431 Admin Commands 00:15:54.431 -------------- 00:15:54.431 Get Log Page (02h): Supported 00:15:54.431 Identify (06h): Supported 00:15:54.431 Abort (08h): Supported 00:15:54.431 Set Features (09h): Supported 00:15:54.431 Get Features (0Ah): Supported 00:15:54.431 Asynchronous Event Request (0Ch): Supported 00:15:54.431 Keep Alive (18h): Supported 00:15:54.431 I/O Commands 00:15:54.431 ------------ 00:15:54.431 Flush (00h): Supported LBA-Change 00:15:54.431 Write (01h): Supported LBA-Change 00:15:54.431 Read (02h): Supported 00:15:54.431 Compare (05h): Supported 00:15:54.431 Write Zeroes (08h): Supported LBA-Change 00:15:54.431 Dataset Management (09h): Supported LBA-Change 00:15:54.431 Copy (19h): Supported LBA-Change 00:15:54.431 Unknown (79h): Supported LBA-Change 00:15:54.431 Unknown (7Ah): Supported 00:15:54.431 00:15:54.431 Error Log 00:15:54.431 ========= 00:15:54.431 00:15:54.431 Arbitration 00:15:54.431 =========== 00:15:54.431 Arbitration Burst: 1 00:15:54.431 00:15:54.431 Power Management 00:15:54.431 ================ 00:15:54.431 Number of Power States: 1 00:15:54.431 Current Power State: Power State #0 00:15:54.431 Power State #0: 00:15:54.431 Max Power: 0.00 W 00:15:54.431 Non-Operational State: Operational 00:15:54.431 Entry Latency: Not Reported 00:15:54.431 Exit Latency: Not Reported 00:15:54.431 Relative Read Throughput: 0 00:15:54.431 Relative Read Latency: 0 00:15:54.431 Relative Write Throughput: 0 00:15:54.431 Relative Write Latency: 0 00:15:54.431 Idle Power: Not Reported 00:15:54.431 Active Power: Not Reported 00:15:54.431 Non-Operational Permissive Mode: Not Supported 00:15:54.431 00:15:54.431 Health Information 00:15:54.431 ================== 00:15:54.431 Critical Warnings: 00:15:54.431 Available Spare Space: OK 00:15:54.431 Temperature: OK 00:15:54.431 Device Reliability: OK 00:15:54.431 Read Only: No 00:15:54.431 Volatile Memory Backup: OK 00:15:54.431 Current Temperature: 0 Kelvin[2024-11-29 13:49:34.582597] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:54.431 [2024-11-29 13:49:34.590405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:54.431 [2024-11-29 13:49:34.590451] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:54.431 [2024-11-29 13:49:34.590470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.431 [2024-11-29 13:49:34.590481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.431 [2024-11-29 13:49:34.590492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.431 [2024-11-29 13:49:34.590502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.431 [2024-11-29 13:49:34.590585] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.431 [2024-11-29 13:49:34.590606] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:54.431 [2024-11-29 13:49:34.591628] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:54.431 [2024-11-29 13:49:34.591644] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:54.431 [2024-11-29 13:49:34.592601] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:54.431 [2024-11-29 13:49:34.592626] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:54.431 [2024-11-29 13:49:34.592679] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:54.431 [2024-11-29 13:49:34.593888] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.431 (-273 Celsius) 00:15:54.431 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:54.431 Available Spare: 0% 00:15:54.432 Available Spare Threshold: 0% 00:15:54.432 Life Percentage Used: 0% 00:15:54.432 Data Units Read: 0 00:15:54.432 Data Units Written: 0 00:15:54.432 Host Read Commands: 0 00:15:54.432 Host Write Commands: 0 00:15:54.432 Controller Busy Time: 0 minutes 00:15:54.432 Power Cycles: 0 00:15:54.432 Power On Hours: 0 hours 00:15:54.432 Unsafe Shutdowns: 0 00:15:54.432 Unrecoverable Media Errors: 0 00:15:54.432 Lifetime Error Log Entries: 0 00:15:54.432 Warning Temperature Time: 0 minutes 00:15:54.432 Critical Temperature Time: 0 minutes 00:15:54.432 00:15:54.432 Number of Queues 00:15:54.432 ================ 00:15:54.432 Number of I/O Submission Queues: 127 00:15:54.432 Number of I/O Completion Queues: 127 00:15:54.432 00:15:54.432 Active Namespaces 00:15:54.432 ================= 00:15:54.432 Namespace ID:1 00:15:54.432 Error Recovery Timeout: Unlimited 00:15:54.432 Command Set Identifier: NVM (00h) 00:15:54.432 Deallocate: Supported 00:15:54.432 Deallocated/Unwritten Error: Not Supported 00:15:54.432 Deallocated Read Value: Unknown 00:15:54.432 Deallocate in Write Zeroes: Not Supported 00:15:54.432 Deallocated Guard Field: 0xFFFF 00:15:54.432 Flush: Supported 00:15:54.432 Reservation: Supported 00:15:54.432 Namespace Sharing Capabilities: Multiple Controllers 00:15:54.432 Size (in LBAs): 131072 (0GiB) 00:15:54.432 Capacity (in LBAs): 131072 (0GiB) 00:15:54.432 Utilization (in LBAs): 131072 (0GiB) 00:15:54.432 NGUID: B0B5FFB71B374A85836BC7BBDF17018B 00:15:54.432 UUID: b0b5ffb7-1b37-4a85-836b-c7bbdf17018b 00:15:54.432 Thin Provisioning: Not Supported 00:15:54.432 Per-NS Atomic Units: Yes 00:15:54.432 Atomic Boundary Size (Normal): 0 00:15:54.432 Atomic Boundary Size (PFail): 0 00:15:54.432 Atomic Boundary Offset: 0 00:15:54.432 Maximum Single Source Range Length: 65535 00:15:54.432 Maximum Copy Length: 65535 00:15:54.432 Maximum Source Range Count: 1 00:15:54.432 NGUID/EUI64 Never Reused: No 00:15:54.432 Namespace Write Protected: No 00:15:54.432 Number of LBA Formats: 1 00:15:54.432 Current LBA Format: LBA Format #00 00:15:54.432 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:54.432 00:15:54.432 13:49:34 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:54.432 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.711 Initializing NVMe Controllers 00:15:59.711 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:59.711 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:59.711 Initialization complete. Launching workers. 00:15:59.711 ======================================================== 00:15:59.711 Latency(us) 00:15:59.711 Device Information : IOPS MiB/s Average min max 00:15:59.711 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37716.51 147.33 3392.93 1130.79 8702.14 00:15:59.711 ======================================================== 00:15:59.711 Total : 37716.51 147.33 3392.93 1130.79 8702.14 00:15:59.711 00:15:59.711 13:49:39 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:59.711 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.008 Initializing NVMe Controllers 00:16:05.008 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:05.008 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:05.008 Initialization complete. Launching workers. 00:16:05.008 ======================================================== 00:16:05.008 Latency(us) 00:16:05.008 Device Information : IOPS MiB/s Average min max 00:16:05.008 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 35706.46 139.48 3584.21 1138.99 10043.68 00:16:05.008 ======================================================== 00:16:05.008 Total : 35706.46 139.48 3584.21 1138.99 10043.68 00:16:05.008 00:16:05.008 13:49:45 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:05.008 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.332 Initializing NVMe Controllers 00:16:10.332 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.332 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.332 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:10.332 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:10.332 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:10.332 Initialization complete. Launching workers. 00:16:10.332 Starting thread on core 2 00:16:10.332 Starting thread on core 3 00:16:10.332 Starting thread on core 1 00:16:10.332 13:49:50 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:10.598 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.898 Initializing NVMe Controllers 00:16:13.898 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.898 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.898 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:13.898 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:13.898 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:13.898 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:13.898 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:13.898 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:13.898 Initialization complete. Launching workers. 00:16:13.898 Starting thread on core 1 with urgent priority queue 00:16:13.898 Starting thread on core 2 with urgent priority queue 00:16:13.898 Starting thread on core 3 with urgent priority queue 00:16:13.899 Starting thread on core 0 with urgent priority queue 00:16:13.899 SPDK bdev Controller (SPDK2 ) core 0: 5858.33 IO/s 17.07 secs/100000 ios 00:16:13.899 SPDK bdev Controller (SPDK2 ) core 1: 6180.67 IO/s 16.18 secs/100000 ios 00:16:13.899 SPDK bdev Controller (SPDK2 ) core 2: 6051.33 IO/s 16.53 secs/100000 ios 00:16:13.899 SPDK bdev Controller (SPDK2 ) core 3: 6004.00 IO/s 16.66 secs/100000 ios 00:16:13.899 ======================================================== 00:16:13.899 00:16:13.899 13:49:53 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:13.899 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.157 Initializing NVMe Controllers 00:16:14.157 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.157 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.157 Namespace ID: 1 size: 0GB 00:16:14.157 Initialization complete. 00:16:14.157 INFO: using host memory buffer for IO 00:16:14.157 Hello world! 00:16:14.157 13:49:54 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:14.157 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.538 Initializing NVMe Controllers 00:16:15.538 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.538 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.538 Initialization complete. Launching workers. 00:16:15.538 submit (in ns) avg, min, max = 6246.5, 3462.2, 4016452.2 00:16:15.538 complete (in ns) avg, min, max = 26167.0, 2034.4, 5996834.4 00:16:15.538 00:16:15.538 Submit histogram 00:16:15.538 ================ 00:16:15.538 Range in us Cumulative Count 00:16:15.538 3.461 - 3.484: 0.1988% ( 27) 00:16:15.538 3.484 - 3.508: 0.9426% ( 101) 00:16:15.538 3.508 - 3.532: 3.0707% ( 289) 00:16:15.538 3.532 - 3.556: 7.0177% ( 536) 00:16:15.538 3.556 - 3.579: 15.1988% ( 1111) 00:16:15.538 3.579 - 3.603: 24.1973% ( 1222) 00:16:15.538 3.603 - 3.627: 35.4934% ( 1534) 00:16:15.538 3.627 - 3.650: 43.4978% ( 1087) 00:16:15.538 3.650 - 3.674: 50.3093% ( 925) 00:16:15.538 3.674 - 3.698: 54.3225% ( 545) 00:16:15.538 3.698 - 3.721: 59.0722% ( 645) 00:16:15.538 3.721 - 3.745: 62.6878% ( 491) 00:16:15.538 3.745 - 3.769: 66.2960% ( 490) 00:16:15.538 3.769 - 3.793: 69.9853% ( 501) 00:16:15.538 3.793 - 3.816: 73.6598% ( 499) 00:16:15.538 3.816 - 3.840: 78.0560% ( 597) 00:16:15.538 3.840 - 3.864: 82.3932% ( 589) 00:16:15.538 3.864 - 3.887: 85.3682% ( 404) 00:16:15.538 3.887 - 3.911: 87.2828% ( 260) 00:16:15.538 3.911 - 3.935: 89.1016% ( 247) 00:16:15.538 3.935 - 3.959: 90.6554% ( 211) 00:16:15.538 3.959 - 3.982: 91.7894% ( 154) 00:16:15.538 3.982 - 4.006: 92.7688% ( 133) 00:16:15.538 4.006 - 4.030: 93.7187% ( 129) 00:16:15.538 4.030 - 4.053: 94.6686% ( 129) 00:16:15.538 4.053 - 4.077: 95.3756% ( 96) 00:16:15.538 4.077 - 4.101: 95.9352% ( 76) 00:16:15.538 4.101 - 4.124: 96.3034% ( 50) 00:16:15.538 4.124 - 4.148: 96.5022% ( 27) 00:16:15.538 4.148 - 4.172: 96.6863% ( 25) 00:16:15.538 4.172 - 4.196: 96.8041% ( 16) 00:16:15.538 4.196 - 4.219: 96.9293% ( 17) 00:16:15.538 4.219 - 4.243: 97.0029% ( 10) 00:16:15.538 4.243 - 4.267: 97.1355% ( 18) 00:16:15.538 4.267 - 4.290: 97.2312% ( 13) 00:16:15.538 4.290 - 4.314: 97.2975% ( 9) 00:16:15.538 4.314 - 4.338: 97.4006% ( 14) 00:16:15.538 4.338 - 4.361: 97.4521% ( 7) 00:16:15.538 4.361 - 4.385: 97.4816% ( 4) 00:16:15.538 4.385 - 4.409: 97.5037% ( 3) 00:16:15.538 4.409 - 4.433: 97.5184% ( 2) 00:16:15.538 4.433 - 4.456: 97.5258% ( 1) 00:16:15.538 4.480 - 4.504: 97.5405% ( 2) 00:16:15.538 4.646 - 4.670: 97.5552% ( 2) 00:16:15.538 4.670 - 4.693: 97.5700% ( 2) 00:16:15.538 4.693 - 4.717: 97.6068% ( 5) 00:16:15.538 4.717 - 4.741: 97.6583% ( 7) 00:16:15.538 4.741 - 4.764: 97.6804% ( 3) 00:16:15.538 4.764 - 4.788: 97.7246% ( 6) 00:16:15.538 4.788 - 4.812: 97.7688% ( 6) 00:16:15.538 4.812 - 4.836: 97.8351% ( 9) 00:16:15.538 4.836 - 4.859: 97.9087% ( 10) 00:16:15.538 4.859 - 4.883: 97.9529% ( 6) 00:16:15.538 4.883 - 4.907: 97.9750% ( 3) 00:16:15.538 4.907 - 4.930: 97.9897% ( 2) 00:16:15.538 4.930 - 4.954: 98.0486% ( 8) 00:16:15.538 4.954 - 4.978: 98.1001% ( 7) 00:16:15.538 4.978 - 5.001: 98.1149% ( 2) 00:16:15.538 5.001 - 5.025: 98.1296% ( 2) 00:16:15.538 5.025 - 5.049: 98.1591% ( 4) 00:16:15.538 5.049 - 5.073: 98.1885% ( 4) 00:16:15.538 5.073 - 5.096: 98.2180% ( 4) 00:16:15.538 5.096 - 5.120: 98.2474% ( 4) 00:16:15.538 5.120 - 5.144: 98.2622% ( 2) 00:16:15.538 5.144 - 5.167: 98.2916% ( 4) 00:16:15.538 5.167 - 5.191: 98.2990% ( 1) 00:16:15.538 5.191 - 5.215: 98.3211% ( 3) 00:16:15.538 5.215 - 5.239: 98.3284% ( 1) 00:16:15.538 5.286 - 5.310: 98.3432% ( 2) 00:16:15.538 5.404 - 5.428: 98.3505% ( 1) 00:16:15.538 5.570 - 5.594: 98.3579% ( 1) 00:16:15.538 5.594 - 5.618: 98.3652% ( 1) 00:16:15.538 5.618 - 5.641: 98.3726% ( 1) 00:16:15.538 5.689 - 5.713: 98.3800% ( 1) 00:16:15.538 5.760 - 5.784: 98.3873% ( 1) 00:16:15.538 5.807 - 5.831: 98.3947% ( 1) 00:16:15.538 5.831 - 5.855: 98.4021% ( 1) 00:16:15.538 5.879 - 5.902: 98.4094% ( 1) 00:16:15.538 5.926 - 5.950: 98.4168% ( 1) 00:16:15.538 6.068 - 6.116: 98.4315% ( 2) 00:16:15.538 6.163 - 6.210: 98.4462% ( 2) 00:16:15.538 6.542 - 6.590: 98.4610% ( 2) 00:16:15.538 6.732 - 6.779: 98.4683% ( 1) 00:16:15.538 6.874 - 6.921: 98.4757% ( 1) 00:16:15.538 6.921 - 6.969: 98.4831% ( 1) 00:16:15.538 6.969 - 7.016: 98.4904% ( 1) 00:16:15.538 7.016 - 7.064: 98.4978% ( 1) 00:16:15.538 7.111 - 7.159: 98.5052% ( 1) 00:16:15.538 7.206 - 7.253: 98.5199% ( 2) 00:16:15.538 7.301 - 7.348: 98.5272% ( 1) 00:16:15.538 7.348 - 7.396: 98.5346% ( 1) 00:16:15.538 7.443 - 7.490: 98.5420% ( 1) 00:16:15.538 7.585 - 7.633: 98.5493% ( 1) 00:16:15.538 7.633 - 7.680: 98.5567% ( 1) 00:16:15.538 7.727 - 7.775: 98.5641% ( 1) 00:16:15.538 7.775 - 7.822: 98.5714% ( 1) 00:16:15.538 7.822 - 7.870: 98.5788% ( 1) 00:16:15.538 7.870 - 7.917: 98.5862% ( 1) 00:16:15.538 7.917 - 7.964: 98.5935% ( 1) 00:16:15.538 8.012 - 8.059: 98.6082% ( 2) 00:16:15.538 8.059 - 8.107: 98.6230% ( 2) 00:16:15.538 8.107 - 8.154: 98.6377% ( 2) 00:16:15.538 8.154 - 8.201: 98.6524% ( 2) 00:16:15.538 8.344 - 8.391: 98.6598% ( 1) 00:16:15.538 8.439 - 8.486: 98.6672% ( 1) 00:16:15.538 8.486 - 8.533: 98.6819% ( 2) 00:16:15.538 8.581 - 8.628: 98.6892% ( 1) 00:16:15.538 8.676 - 8.723: 98.7113% ( 3) 00:16:15.538 8.770 - 8.818: 98.7187% ( 1) 00:16:15.538 8.818 - 8.865: 98.7261% ( 1) 00:16:15.538 8.913 - 8.960: 98.7334% ( 1) 00:16:15.538 8.960 - 9.007: 98.7408% ( 1) 00:16:15.538 9.007 - 9.055: 98.7555% ( 2) 00:16:15.538 9.102 - 9.150: 98.7629% ( 1) 00:16:15.538 9.150 - 9.197: 98.7703% ( 1) 00:16:15.538 9.197 - 9.244: 98.7776% ( 1) 00:16:15.538 9.292 - 9.339: 98.7850% ( 1) 00:16:15.538 9.339 - 9.387: 98.7923% ( 1) 00:16:15.538 9.387 - 9.434: 98.7997% ( 1) 00:16:15.538 9.434 - 9.481: 98.8071% ( 1) 00:16:15.538 9.481 - 9.529: 98.8144% ( 1) 00:16:15.538 9.529 - 9.576: 98.8218% ( 1) 00:16:15.538 10.003 - 10.050: 98.8365% ( 2) 00:16:15.538 10.098 - 10.145: 98.8439% ( 1) 00:16:15.538 10.145 - 10.193: 98.8586% ( 2) 00:16:15.538 10.477 - 10.524: 98.8660% ( 1) 00:16:15.538 10.524 - 10.572: 98.8733% ( 1) 00:16:15.538 10.714 - 10.761: 98.8807% ( 1) 00:16:15.538 10.809 - 10.856: 98.8881% ( 1) 00:16:15.538 10.999 - 11.046: 98.8954% ( 1) 00:16:15.538 11.093 - 11.141: 98.9102% ( 2) 00:16:15.538 11.141 - 11.188: 98.9175% ( 1) 00:16:15.538 11.188 - 11.236: 98.9249% ( 1) 00:16:15.538 11.236 - 11.283: 98.9323% ( 1) 00:16:15.538 11.378 - 11.425: 98.9396% ( 1) 00:16:15.538 11.567 - 11.615: 98.9543% ( 2) 00:16:15.538 11.615 - 11.662: 98.9691% ( 2) 00:16:15.538 11.710 - 11.757: 98.9764% ( 1) 00:16:15.538 11.757 - 11.804: 98.9838% ( 1) 00:16:15.538 11.899 - 11.947: 98.9912% ( 1) 00:16:15.538 12.136 - 12.231: 98.9985% ( 1) 00:16:15.538 12.326 - 12.421: 99.0059% ( 1) 00:16:15.538 12.610 - 12.705: 99.0133% ( 1) 00:16:15.538 12.705 - 12.800: 99.0206% ( 1) 00:16:15.538 12.800 - 12.895: 99.0280% ( 1) 00:16:15.538 13.559 - 13.653: 99.0353% ( 1) 00:16:15.538 13.653 - 13.748: 99.0427% ( 1) 00:16:15.538 13.843 - 13.938: 99.0501% ( 1) 00:16:15.538 14.033 - 14.127: 99.0574% ( 1) 00:16:15.538 14.127 - 14.222: 99.0648% ( 1) 00:16:15.538 14.222 - 14.317: 99.0722% ( 1) 00:16:15.538 14.317 - 14.412: 99.0795% ( 1) 00:16:15.538 14.412 - 14.507: 99.0869% ( 1) 00:16:15.538 15.265 - 15.360: 99.0943% ( 1) 00:16:15.538 17.161 - 17.256: 99.1237% ( 4) 00:16:15.538 17.256 - 17.351: 99.1311% ( 1) 00:16:15.538 17.351 - 17.446: 99.1605% ( 4) 00:16:15.538 17.446 - 17.541: 99.1679% ( 1) 00:16:15.538 17.541 - 17.636: 99.1826% ( 2) 00:16:15.538 17.636 - 17.730: 99.2268% ( 6) 00:16:15.539 17.730 - 17.825: 99.2636% ( 5) 00:16:15.539 17.825 - 17.920: 99.3225% ( 8) 00:16:15.539 17.920 - 18.015: 99.3520% ( 4) 00:16:15.539 18.015 - 18.110: 99.3888% ( 5) 00:16:15.539 18.110 - 18.204: 99.4551% ( 9) 00:16:15.539 18.204 - 18.299: 99.5287% ( 10) 00:16:15.539 18.299 - 18.394: 99.6097% ( 11) 00:16:15.539 18.394 - 18.489: 99.6981% ( 12) 00:16:15.539 18.489 - 18.584: 99.7570% ( 8) 00:16:15.539 18.584 - 18.679: 99.8306% ( 10) 00:16:15.539 18.679 - 18.773: 99.8601% ( 4) 00:16:15.539 18.773 - 18.868: 99.8748% ( 2) 00:16:15.539 18.868 - 18.963: 99.8822% ( 1) 00:16:15.539 19.058 - 19.153: 99.8895% ( 1) 00:16:15.539 19.247 - 19.342: 99.8969% ( 1) 00:16:15.539 19.532 - 19.627: 99.9043% ( 1) 00:16:15.539 19.627 - 19.721: 99.9116% ( 1) 00:16:15.539 19.816 - 19.911: 99.9190% ( 1) 00:16:15.539 20.006 - 20.101: 99.9264% ( 1) 00:16:15.539 22.092 - 22.187: 99.9337% ( 1) 00:16:15.539 24.841 - 25.031: 99.9411% ( 1) 00:16:15.539 3980.705 - 4004.978: 99.9853% ( 6) 00:16:15.539 4004.978 - 4029.250: 100.0000% ( 2) 00:16:15.539 00:16:15.539 Complete histogram 00:16:15.539 ================== 00:16:15.539 Range in us Cumulative Count 00:16:15.539 2.027 - 2.039: 0.1473% ( 20) 00:16:15.539 2.039 - 2.050: 9.1826% ( 1227) 00:16:15.539 2.050 - 2.062: 13.8071% ( 628) 00:16:15.539 2.062 - 2.074: 19.9558% ( 835) 00:16:15.539 2.074 - 2.086: 50.2651% ( 4116) 00:16:15.539 2.086 - 2.098: 58.2106% ( 1079) 00:16:15.539 2.098 - 2.110: 60.9205% ( 368) 00:16:15.539 2.110 - 2.121: 64.4477% ( 479) 00:16:15.539 2.121 - 2.133: 65.1105% ( 90) 00:16:15.539 2.133 - 2.145: 70.6112% ( 747) 00:16:15.539 2.145 - 2.157: 80.4345% ( 1334) 00:16:15.539 2.157 - 2.169: 82.5037% ( 281) 00:16:15.539 2.169 - 2.181: 83.9028% ( 190) 00:16:15.539 2.181 - 2.193: 85.6333% ( 235) 00:16:15.539 2.193 - 2.204: 86.3108% ( 92) 00:16:15.539 2.204 - 2.216: 89.1532% ( 386) 00:16:15.539 2.216 - 2.228: 93.3358% ( 568) 00:16:15.539 2.228 - 2.240: 94.2636% ( 126) 00:16:15.539 2.240 - 2.252: 94.6834% ( 57) 00:16:15.539 2.252 - 2.264: 95.1252% ( 60) 00:16:15.539 2.264 - 2.276: 95.2872% ( 22) 00:16:15.539 2.276 - 2.287: 95.6922% ( 55) 00:16:15.539 2.287 - 2.299: 95.8910% ( 27) 00:16:15.539 2.299 - 2.311: 95.9573% ( 9) 00:16:15.539 2.311 - 2.323: 96.1414% ( 25) 00:16:15.539 2.323 - 2.335: 96.3108% ( 23) 00:16:15.539 2.335 - 2.347: 96.5169% ( 28) 00:16:15.539 2.347 - 2.359: 96.7305% ( 29) 00:16:15.539 2.359 - 2.370: 97.0029% ( 37) 00:16:15.539 2.370 - 2.382: 97.2533% ( 34) 00:16:15.539 2.382 - 2.394: 97.4006% ( 20) 00:16:15.539 2.394 - 2.406: 97.5920% ( 26) 00:16:15.539 2.406 - 2.418: 97.7393% ( 20) 00:16:15.539 2.418 - 2.430: 97.8571% ( 16) 00:16:15.539 2.430 - 2.441: 98.0118% ( 21) 00:16:15.539 2.441 - 2.453: 98.1001% ( 12) 00:16:15.539 2.453 - 2.465: 98.1664% ( 9) 00:16:15.539 2.465 - 2.477: 98.2474% ( 11) 00:16:15.539 2.477 - 2.489: 98.3137% ( 9) 00:16:15.539 2.489 - 2.501: 98.3579% ( 6) 00:16:15.539 2.501 - 2.513: 98.3800% ( 3) 00:16:15.539 2.524 - 2.536: 98.3873% ( 1) 00:16:15.539 2.536 - 2.548: 98.3947% ( 1) 00:16:15.539 2.560 - 2.572: 98.4021% ( 1) 00:16:15.539 3.295 - 3.319: 98.4094% ( 1) 00:16:15.539 3.342 - 3.366: 98.4168% ( 1) 00:16:15.539 3.366 - 3.390: 98.4242% ( 1) 00:16:15.539 3.390 - 3.413: 98.4462% ( 3) 00:16:15.539 3.437 - 3.461: 98.4683% ( 3) 00:16:15.539 3.461 - 3.484: 98.4757% ( 1) 00:16:15.539 3.508 - 3.532: 98.4904% ( 2) 00:16:15.539 3.532 - 3.556: 98.4978% ( 1) 00:16:15.539 3.556 - 3.579: 98.5052% ( 1) 00:16:15.539 3.579 - 3.603: 98.5199% ( 2) 00:16:15.539 3.603 - 3.627: 98.5420% ( 3) 00:16:15.539 3.627 - 3.650: 98.5493% ( 1) 00:16:15.539 3.721 - 3.745: 98.5567% ( 1) 00:16:15.539 3.793 - 3.816: 98.5641% ( 1) 00:16:15.539 3.840 - 3.864: 98.5788% ( 2) 00:16:15.539 3.887 - 3.911: 98.5862% ( 1) 00:16:15.539 4.006 - 4.030: 98.5935% ( 1) 00:16:15.539 4.267 - 4.290: 98.6009% ( 1) 00:16:15.539 5.333 - 5.357: 98.6082% ( 1) 00:16:15.539 5.523 - 5.547: 98.6156% ( 1) 00:16:15.539 6.068 - 6.116: 98.6230% ( 1) 00:16:15.539 6.258 - 6.305: 98.6303% ( 1) 00:16:15.539 6.353 - 6.400: 98.6451% ( 2) 00:16:15.539 6.447 - 6.495: 98.6598% ( 2) 00:16:15.539 6.590 - 6.637: 98.6672% ( 1) 00:16:15.539 6.684 - 6.732: 98.6819% ( 2) 00:16:15.539 6.732 - 6.779: 98.6892% ( 1) 00:16:15.539 6.969 - 7.016: 98.7040% ( 2) 00:16:15.539 7.064 - 7.111: 98.7113% ( 1) 00:16:15.539 7.253 - 7.301: 98.7187% ( 1) 00:16:15.539 7.348 - 7.396: 98.7261% ( 1) 00:16:15.539 7.396 - 7.443: 98.7334% ( 1) 00:16:15.539 7.538 - 7.585: 98.7482% ( 2) 00:16:15.539 7.633 - 7.680: 98.7629% ( 2) 00:16:15.539 7.870 - 7.917: 98.7703% ( 1) 00:16:15.539 8.154 - 8.201: 98.7850% ( 2) 00:16:15.539 9.908 - 9.956: 98.7923% ( 1) 00:16:15.539 13.369 - 13.464: 98.7997% ( 1) 00:16:15.539 15.455 - 15.550: 98.8071% ( 1) 00:16:15.539 15.550 - 15.644: 98.8144% ( 1) 00:16:15.539 15.644 - 15.739: 98.8292% ( 2) 00:16:15.539 15.739 - 15.834: 98.8365% ( 1) 00:16:15.539 15.834 - 15.929: 98.8439% ( 1) 00:16:15.539 15.929 - 16.024: 98.8733% ( 4) 00:16:15.539 16.024 - 16.119: 98.8954% ( 3) 00:16:15.539 16.119 - 16.213: 98.9396% ( 6) 00:16:15.539 16.213 - 16.308: 98.9764% ( 5) 00:16:15.539 16.308 - 16.403: 99.0280% ( 7) 00:16:15.539 16.403 - 16.498: 99.0648% ( 5) 00:16:15.539 16.498 - 16.593: 99.1090% ( 6) 00:16:15.539 16.593 - 16.687: 99.1311% ( 3) 00:16:15.539 16.687 - 16.782: 99.1605% ( 4) 00:16:15.539 16.782 - 16.877: 99.1973% ( 5) 00:16:15.539 16.877 - 16.972: 99.2342% ( 5) 00:16:15.539 17.067 - 17.161: 99.2563% ( 3) 00:16:15.539 17.161 - 17.256: 99.2710% ( 2) 00:16:15.539 17.256 - 17.351: 99.2931% ( 3) 00:16:15.539 17.446 - 17.541: 99.3004% ( 1) 00:16:15.539 17.541 - 17.636: 99.3078% ( 1) 00:16:15.539 17.636 - 17.730: 99.3152% ( 1) 00:16:15.539 17.730 - 17.825: 99.3225% ( 1) 00:16:15.539 17.825 - 17.920: 99.3373% ( 2) 00:16:15.539 18.015 - 18.110: 99.3446% ( 1) 00:16:15.539 18.110 - 18.204: 99.3520% ( 1) 00:16:15.539 18.299 - 18.394: 99.3667% ( 2) 00:16:15.539 18.394 - 18.489: 99.3814% ( 2) 00:16:15.539 18.584 - 18.679: 99.3888% ( 1) 00:16:15.539 21.523 - 21.618: 99.3962% ( 1) 00:16:15.539 24.273 - 24.462: 99.4035% ( 1) 00:16:15.539 3034.074 - 3046.210: 99.4109% ( 1) 00:16:15.539 3980.705 - 4004.978: 99.8233% ( 56) 00:16:15.539 4004.978 - 4029.250: 99.9926% ( 23) 00:16:15.539 5995.330 - 6019.603: 100.0000% ( 1) 00:16:15.539 00:16:15.539 13:49:55 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:15.539 13:49:55 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:15.539 13:49:55 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:15.539 13:49:55 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:15.539 13:49:55 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:15.799 [ 00:16:15.799 { 00:16:15.799 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:15.799 "subtype": "Discovery", 00:16:15.799 "listen_addresses": [], 00:16:15.799 "allow_any_host": true, 00:16:15.799 "hosts": [] 00:16:15.799 }, 00:16:15.799 { 00:16:15.799 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:15.799 "subtype": "NVMe", 00:16:15.799 "listen_addresses": [ 00:16:15.799 { 00:16:15.799 "transport": "VFIOUSER", 00:16:15.799 "trtype": "VFIOUSER", 00:16:15.799 "adrfam": "IPv4", 00:16:15.799 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:15.799 "trsvcid": "0" 00:16:15.799 } 00:16:15.799 ], 00:16:15.799 "allow_any_host": true, 00:16:15.799 "hosts": [], 00:16:15.799 "serial_number": "SPDK1", 00:16:15.799 "model_number": "SPDK bdev Controller", 00:16:15.799 "max_namespaces": 32, 00:16:15.799 "min_cntlid": 1, 00:16:15.799 "max_cntlid": 65519, 00:16:15.799 "namespaces": [ 00:16:15.799 { 00:16:15.799 "nsid": 1, 00:16:15.799 "bdev_name": "Malloc1", 00:16:15.799 "name": "Malloc1", 00:16:15.799 "nguid": "D96E01814EEF49FB8C7FD0D090E3E15A", 00:16:15.799 "uuid": "d96e0181-4eef-49fb-8c7f-d0d090e3e15a" 00:16:15.799 }, 00:16:15.799 { 00:16:15.799 "nsid": 2, 00:16:15.799 "bdev_name": "Malloc3", 00:16:15.799 "name": "Malloc3", 00:16:15.799 "nguid": "AB89B0EBD9944D9C84B6247E3846854B", 00:16:15.799 "uuid": "ab89b0eb-d994-4d9c-84b6-247e3846854b" 00:16:15.799 } 00:16:15.799 ] 00:16:15.799 }, 00:16:15.799 { 00:16:15.799 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:15.799 "subtype": "NVMe", 00:16:15.799 "listen_addresses": [ 00:16:15.799 { 00:16:15.799 "transport": "VFIOUSER", 00:16:15.799 "trtype": "VFIOUSER", 00:16:15.799 "adrfam": "IPv4", 00:16:15.799 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:15.799 "trsvcid": "0" 00:16:15.799 } 00:16:15.799 ], 00:16:15.799 "allow_any_host": true, 00:16:15.799 "hosts": [], 00:16:15.799 "serial_number": "SPDK2", 00:16:15.799 "model_number": "SPDK bdev Controller", 00:16:15.799 "max_namespaces": 32, 00:16:15.799 "min_cntlid": 1, 00:16:15.799 "max_cntlid": 65519, 00:16:15.799 "namespaces": [ 00:16:15.799 { 00:16:15.799 "nsid": 1, 00:16:15.799 "bdev_name": "Malloc2", 00:16:15.799 "name": "Malloc2", 00:16:15.799 "nguid": "B0B5FFB71B374A85836BC7BBDF17018B", 00:16:15.799 "uuid": "b0b5ffb7-1b37-4a85-836b-c7bbdf17018b" 00:16:15.799 } 00:16:15.799 ] 00:16:15.799 } 00:16:15.799 ] 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2278638 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:15.799 13:49:55 -- common/autotest_common.sh@1254 -- # local i=0 00:16:15.799 13:49:55 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.799 13:49:55 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.799 13:49:55 -- common/autotest_common.sh@1265 -- # return 0 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:15.799 13:49:55 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:15.799 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.058 Malloc4 00:16:16.058 13:49:56 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:16.317 13:49:56 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:16.317 Asynchronous Event Request test 00:16:16.317 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.317 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.317 Registering asynchronous event callbacks... 00:16:16.317 Starting namespace attribute notice tests for all controllers... 00:16:16.317 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:16.317 aer_cb - Changed Namespace 00:16:16.317 Cleaning up... 00:16:16.578 [ 00:16:16.578 { 00:16:16.578 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:16.578 "subtype": "Discovery", 00:16:16.578 "listen_addresses": [], 00:16:16.578 "allow_any_host": true, 00:16:16.578 "hosts": [] 00:16:16.578 }, 00:16:16.578 { 00:16:16.578 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:16.578 "subtype": "NVMe", 00:16:16.578 "listen_addresses": [ 00:16:16.578 { 00:16:16.578 "transport": "VFIOUSER", 00:16:16.578 "trtype": "VFIOUSER", 00:16:16.578 "adrfam": "IPv4", 00:16:16.578 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:16.578 "trsvcid": "0" 00:16:16.578 } 00:16:16.578 ], 00:16:16.578 "allow_any_host": true, 00:16:16.578 "hosts": [], 00:16:16.578 "serial_number": "SPDK1", 00:16:16.578 "model_number": "SPDK bdev Controller", 00:16:16.578 "max_namespaces": 32, 00:16:16.578 "min_cntlid": 1, 00:16:16.578 "max_cntlid": 65519, 00:16:16.578 "namespaces": [ 00:16:16.578 { 00:16:16.578 "nsid": 1, 00:16:16.578 "bdev_name": "Malloc1", 00:16:16.578 "name": "Malloc1", 00:16:16.578 "nguid": "D96E01814EEF49FB8C7FD0D090E3E15A", 00:16:16.578 "uuid": "d96e0181-4eef-49fb-8c7f-d0d090e3e15a" 00:16:16.578 }, 00:16:16.578 { 00:16:16.578 "nsid": 2, 00:16:16.578 "bdev_name": "Malloc3", 00:16:16.578 "name": "Malloc3", 00:16:16.578 "nguid": "AB89B0EBD9944D9C84B6247E3846854B", 00:16:16.578 "uuid": "ab89b0eb-d994-4d9c-84b6-247e3846854b" 00:16:16.578 } 00:16:16.578 ] 00:16:16.578 }, 00:16:16.578 { 00:16:16.578 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:16.578 "subtype": "NVMe", 00:16:16.578 "listen_addresses": [ 00:16:16.578 { 00:16:16.578 "transport": "VFIOUSER", 00:16:16.578 "trtype": "VFIOUSER", 00:16:16.578 "adrfam": "IPv4", 00:16:16.578 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:16.578 "trsvcid": "0" 00:16:16.578 } 00:16:16.578 ], 00:16:16.578 "allow_any_host": true, 00:16:16.578 "hosts": [], 00:16:16.578 "serial_number": "SPDK2", 00:16:16.578 "model_number": "SPDK bdev Controller", 00:16:16.578 "max_namespaces": 32, 00:16:16.578 "min_cntlid": 1, 00:16:16.578 "max_cntlid": 65519, 00:16:16.578 "namespaces": [ 00:16:16.578 { 00:16:16.578 "nsid": 1, 00:16:16.578 "bdev_name": "Malloc2", 00:16:16.578 "name": "Malloc2", 00:16:16.578 "nguid": "B0B5FFB71B374A85836BC7BBDF17018B", 00:16:16.578 "uuid": "b0b5ffb7-1b37-4a85-836b-c7bbdf17018b" 00:16:16.578 }, 00:16:16.578 { 00:16:16.578 "nsid": 2, 00:16:16.578 "bdev_name": "Malloc4", 00:16:16.578 "name": "Malloc4", 00:16:16.578 "nguid": "4AB626130B894385AB8B2155B579D07A", 00:16:16.578 "uuid": "4ab62613-0b89-4385-ab8b-2155b579d07a" 00:16:16.578 } 00:16:16.578 ] 00:16:16.579 } 00:16:16.579 ] 00:16:16.579 13:49:56 -- target/nvmf_vfio_user.sh@44 -- # wait 2278638 00:16:16.579 13:49:56 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:16.579 13:49:56 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2272861 00:16:16.579 13:49:56 -- common/autotest_common.sh@936 -- # '[' -z 2272861 ']' 00:16:16.579 13:49:56 -- common/autotest_common.sh@940 -- # kill -0 2272861 00:16:16.579 13:49:56 -- common/autotest_common.sh@941 -- # uname 00:16:16.579 13:49:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:16.579 13:49:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2272861 00:16:16.579 13:49:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:16.579 13:49:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:16.579 13:49:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2272861' 00:16:16.579 killing process with pid 2272861 00:16:16.579 13:49:56 -- common/autotest_common.sh@955 -- # kill 2272861 00:16:16.579 [2024-11-29 13:49:56.726796] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:16.579 13:49:56 -- common/autotest_common.sh@960 -- # wait 2272861 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2278784 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2278784' 00:16:16.838 Process pid: 2278784 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:16.838 13:49:57 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2278784 00:16:16.838 13:49:57 -- common/autotest_common.sh@829 -- # '[' -z 2278784 ']' 00:16:16.838 13:49:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:16.838 13:49:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:16.838 13:49:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:16.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:16.838 13:49:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:16.838 13:49:57 -- common/autotest_common.sh@10 -- # set +x 00:16:16.838 [2024-11-29 13:49:57.116098] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:16.838 [2024-11-29 13:49:57.117206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:16.838 [2024-11-29 13:49:57.117263] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:17.097 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.097 [2024-11-29 13:49:57.180991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:17.097 [2024-11-29 13:49:57.268683] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:17.097 [2024-11-29 13:49:57.268857] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:17.097 [2024-11-29 13:49:57.268876] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:17.097 [2024-11-29 13:49:57.268889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:17.097 [2024-11-29 13:49:57.268978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:17.097 [2024-11-29 13:49:57.271415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:17.097 [2024-11-29 13:49:57.271485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:17.097 [2024-11-29 13:49:57.275410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:17.097 [2024-11-29 13:49:57.374734] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:17.097 [2024-11-29 13:49:57.375018] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:17.097 [2024-11-29 13:49:57.375335] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:17.097 [2024-11-29 13:49:57.376068] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:17.097 [2024-11-29 13:49:57.376178] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:18.035 13:49:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:18.035 13:49:58 -- common/autotest_common.sh@862 -- # return 0 00:16:18.035 13:49:58 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:18.970 13:49:59 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:19.229 13:49:59 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:19.229 13:49:59 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:19.229 13:49:59 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:19.229 13:49:59 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:19.229 13:49:59 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:19.487 Malloc1 00:16:19.487 13:49:59 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:19.745 13:50:00 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:20.315 13:50:00 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:20.315 13:50:00 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:20.315 13:50:00 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:20.315 13:50:00 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:20.576 Malloc2 00:16:20.835 13:50:00 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:20.835 13:50:01 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:21.092 13:50:01 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:21.351 13:50:01 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:21.351 13:50:01 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2278784 00:16:21.351 13:50:01 -- common/autotest_common.sh@936 -- # '[' -z 2278784 ']' 00:16:21.351 13:50:01 -- common/autotest_common.sh@940 -- # kill -0 2278784 00:16:21.351 13:50:01 -- common/autotest_common.sh@941 -- # uname 00:16:21.352 13:50:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.352 13:50:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2278784 00:16:21.609 13:50:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:21.609 13:50:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:21.609 13:50:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2278784' 00:16:21.609 killing process with pid 2278784 00:16:21.609 13:50:01 -- common/autotest_common.sh@955 -- # kill 2278784 00:16:21.609 13:50:01 -- common/autotest_common.sh@960 -- # wait 2278784 00:16:21.868 13:50:01 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:21.868 13:50:01 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:21.868 00:16:21.868 real 0m54.273s 00:16:21.868 user 3m34.660s 00:16:21.868 sys 0m4.510s 00:16:21.868 13:50:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:21.868 13:50:01 -- common/autotest_common.sh@10 -- # set +x 00:16:21.868 ************************************ 00:16:21.868 END TEST nvmf_vfio_user 00:16:21.868 ************************************ 00:16:21.868 13:50:01 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:21.868 13:50:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:21.868 13:50:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:21.868 13:50:01 -- common/autotest_common.sh@10 -- # set +x 00:16:21.868 ************************************ 00:16:21.868 START TEST nvmf_vfio_user_nvme_compliance 00:16:21.868 ************************************ 00:16:21.868 13:50:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:21.868 * Looking for test storage... 00:16:21.868 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:21.868 13:50:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:21.868 13:50:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:21.868 13:50:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:21.868 13:50:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:21.868 13:50:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:21.868 13:50:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:21.868 13:50:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:21.868 13:50:02 -- scripts/common.sh@335 -- # IFS=.-: 00:16:21.868 13:50:02 -- scripts/common.sh@335 -- # read -ra ver1 00:16:21.868 13:50:02 -- scripts/common.sh@336 -- # IFS=.-: 00:16:21.868 13:50:02 -- scripts/common.sh@336 -- # read -ra ver2 00:16:21.868 13:50:02 -- scripts/common.sh@337 -- # local 'op=<' 00:16:21.868 13:50:02 -- scripts/common.sh@339 -- # ver1_l=2 00:16:21.868 13:50:02 -- scripts/common.sh@340 -- # ver2_l=1 00:16:21.868 13:50:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:21.868 13:50:02 -- scripts/common.sh@343 -- # case "$op" in 00:16:21.868 13:50:02 -- scripts/common.sh@344 -- # : 1 00:16:21.868 13:50:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:21.868 13:50:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:21.868 13:50:02 -- scripts/common.sh@364 -- # decimal 1 00:16:21.868 13:50:02 -- scripts/common.sh@352 -- # local d=1 00:16:21.868 13:50:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:21.868 13:50:02 -- scripts/common.sh@354 -- # echo 1 00:16:21.868 13:50:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:21.868 13:50:02 -- scripts/common.sh@365 -- # decimal 2 00:16:21.868 13:50:02 -- scripts/common.sh@352 -- # local d=2 00:16:21.868 13:50:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:21.868 13:50:02 -- scripts/common.sh@354 -- # echo 2 00:16:21.868 13:50:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:21.868 13:50:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:21.868 13:50:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:21.868 13:50:02 -- scripts/common.sh@367 -- # return 0 00:16:21.868 13:50:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:21.868 13:50:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:21.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.868 --rc genhtml_branch_coverage=1 00:16:21.869 --rc genhtml_function_coverage=1 00:16:21.869 --rc genhtml_legend=1 00:16:21.869 --rc geninfo_all_blocks=1 00:16:21.869 --rc geninfo_unexecuted_blocks=1 00:16:21.869 00:16:21.869 ' 00:16:21.869 13:50:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:21.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.869 --rc genhtml_branch_coverage=1 00:16:21.869 --rc genhtml_function_coverage=1 00:16:21.869 --rc genhtml_legend=1 00:16:21.869 --rc geninfo_all_blocks=1 00:16:21.869 --rc geninfo_unexecuted_blocks=1 00:16:21.869 00:16:21.869 ' 00:16:21.869 13:50:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:21.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.869 --rc genhtml_branch_coverage=1 00:16:21.869 --rc genhtml_function_coverage=1 00:16:21.869 --rc genhtml_legend=1 00:16:21.869 --rc geninfo_all_blocks=1 00:16:21.869 --rc geninfo_unexecuted_blocks=1 00:16:21.869 00:16:21.869 ' 00:16:21.869 13:50:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:21.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.869 --rc genhtml_branch_coverage=1 00:16:21.869 --rc genhtml_function_coverage=1 00:16:21.869 --rc genhtml_legend=1 00:16:21.869 --rc geninfo_all_blocks=1 00:16:21.869 --rc geninfo_unexecuted_blocks=1 00:16:21.869 00:16:21.869 ' 00:16:21.869 13:50:02 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:21.869 13:50:02 -- nvmf/common.sh@7 -- # uname -s 00:16:21.869 13:50:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:21.869 13:50:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:21.869 13:50:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:21.869 13:50:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:21.869 13:50:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:21.869 13:50:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:21.869 13:50:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:21.869 13:50:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:21.869 13:50:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:21.869 13:50:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:21.869 13:50:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.869 13:50:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.869 13:50:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:21.869 13:50:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:21.869 13:50:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:21.869 13:50:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:21.869 13:50:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:21.869 13:50:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:21.869 13:50:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:21.869 13:50:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.869 13:50:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.869 13:50:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.869 13:50:02 -- paths/export.sh@5 -- # export PATH 00:16:21.869 13:50:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.869 13:50:02 -- nvmf/common.sh@46 -- # : 0 00:16:21.869 13:50:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:21.869 13:50:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:21.869 13:50:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:21.869 13:50:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:21.869 13:50:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:21.869 13:50:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:21.869 13:50:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:21.869 13:50:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:21.869 13:50:02 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:21.869 13:50:02 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:21.869 13:50:02 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:21.869 13:50:02 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:21.869 13:50:02 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:21.869 13:50:02 -- compliance/compliance.sh@20 -- # nvmfpid=2279538 00:16:21.869 13:50:02 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:21.869 13:50:02 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2279538' 00:16:21.869 Process pid: 2279538 00:16:21.869 13:50:02 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:21.869 13:50:02 -- compliance/compliance.sh@24 -- # waitforlisten 2279538 00:16:21.869 13:50:02 -- common/autotest_common.sh@829 -- # '[' -z 2279538 ']' 00:16:21.869 13:50:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:21.869 13:50:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:21.869 13:50:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:21.869 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:21.869 13:50:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:21.869 13:50:02 -- common/autotest_common.sh@10 -- # set +x 00:16:22.130 [2024-11-29 13:50:02.173990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:22.131 [2024-11-29 13:50:02.174065] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:22.131 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.131 [2024-11-29 13:50:02.234360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:22.131 [2024-11-29 13:50:02.321490] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:22.131 [2024-11-29 13:50:02.321662] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.131 [2024-11-29 13:50:02.321680] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.131 [2024-11-29 13:50:02.321693] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.131 [2024-11-29 13:50:02.321753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:22.131 [2024-11-29 13:50:02.321815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:22.131 [2024-11-29 13:50:02.321818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:23.082 13:50:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:23.082 13:50:03 -- common/autotest_common.sh@862 -- # return 0 00:16:23.082 13:50:03 -- compliance/compliance.sh@26 -- # sleep 1 00:16:24.019 13:50:04 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:24.019 13:50:04 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:24.019 13:50:04 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:24.019 13:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.019 13:50:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.019 13:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.019 13:50:04 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:24.019 13:50:04 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:24.019 13:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.019 13:50:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.019 malloc0 00:16:24.019 13:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.019 13:50:04 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:24.019 13:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.019 13:50:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.019 13:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.019 13:50:04 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:24.019 13:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.019 13:50:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.019 13:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.019 13:50:04 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:24.019 13:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.019 13:50:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.019 13:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.019 13:50:04 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:24.019 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.277 00:16:24.277 00:16:24.277 CUnit - A unit testing framework for C - Version 2.1-3 00:16:24.277 http://cunit.sourceforge.net/ 00:16:24.277 00:16:24.277 00:16:24.277 Suite: nvme_compliance 00:16:24.277 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-29 13:50:04.384265] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:24.277 [2024-11-29 13:50:04.384308] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:24.277 [2024-11-29 13:50:04.384335] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:24.277 passed 00:16:24.277 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:24.534 Test: admin_identify_ns ...[2024-11-29 13:50:04.624429] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:24.534 [2024-11-29 13:50:04.632427] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:24.534 passed 00:16:24.534 Test: admin_get_features_mandatory_features ...passed 00:16:24.792 Test: admin_get_features_optional_features ...passed 00:16:24.792 Test: admin_set_features_number_of_queues ...passed 00:16:25.050 Test: admin_get_log_page_mandatory_logs ...passed 00:16:25.050 Test: admin_get_log_page_with_lpo ...[2024-11-29 13:50:05.252437] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:25.050 passed 00:16:25.309 Test: fabric_property_get ...passed 00:16:25.309 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-29 13:50:05.438074] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:25.309 passed 00:16:25.569 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-29 13:50:05.606415] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.569 [2024-11-29 13:50:05.622419] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.569 passed 00:16:25.569 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-29 13:50:05.711336] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:25.569 passed 00:16:25.827 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-29 13:50:05.871414] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:25.827 [2024-11-29 13:50:05.895428] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.827 passed 00:16:25.827 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-29 13:50:05.985286] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:25.827 [2024-11-29 13:50:05.985341] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:25.827 passed 00:16:26.084 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-29 13:50:06.160423] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:26.084 [2024-11-29 13:50:06.168403] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:26.084 [2024-11-29 13:50:06.176419] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:26.084 [2024-11-29 13:50:06.184401] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:26.084 passed 00:16:26.084 Test: admin_create_io_sq_verify_pc ...[2024-11-29 13:50:06.312435] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:26.084 passed 00:16:27.462 Test: admin_create_io_qp_max_qps ...[2024-11-29 13:50:07.519409] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:27.723 passed 00:16:27.982 Test: admin_create_io_sq_shared_cq ...[2024-11-29 13:50:08.114404] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:27.982 passed 00:16:27.982 00:16:27.982 Run Summary: Type Total Ran Passed Failed Inactive 00:16:27.982 suites 1 1 n/a 0 0 00:16:27.982 tests 18 18 18 0 0 00:16:27.982 asserts 360 360 360 0 n/a 00:16:27.982 00:16:27.982 Elapsed time = 1.559 seconds 00:16:27.982 13:50:08 -- compliance/compliance.sh@42 -- # killprocess 2279538 00:16:27.982 13:50:08 -- common/autotest_common.sh@936 -- # '[' -z 2279538 ']' 00:16:27.982 13:50:08 -- common/autotest_common.sh@940 -- # kill -0 2279538 00:16:27.982 13:50:08 -- common/autotest_common.sh@941 -- # uname 00:16:27.982 13:50:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:27.982 13:50:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2279538 00:16:27.982 13:50:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:27.982 13:50:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:27.982 13:50:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2279538' 00:16:27.982 killing process with pid 2279538 00:16:27.982 13:50:08 -- common/autotest_common.sh@955 -- # kill 2279538 00:16:27.982 13:50:08 -- common/autotest_common.sh@960 -- # wait 2279538 00:16:28.241 13:50:08 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:28.241 13:50:08 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:28.241 00:16:28.241 real 0m6.546s 00:16:28.241 user 0m18.632s 00:16:28.241 sys 0m0.596s 00:16:28.241 13:50:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.241 13:50:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.241 ************************************ 00:16:28.241 END TEST nvmf_vfio_user_nvme_compliance 00:16:28.241 ************************************ 00:16:28.501 13:50:08 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:28.501 13:50:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.501 13:50:08 -- common/autotest_common.sh@10 -- # set +x 00:16:28.501 ************************************ 00:16:28.501 START TEST nvmf_vfio_user_fuzz 00:16:28.501 ************************************ 00:16:28.501 13:50:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:28.501 * Looking for test storage... 00:16:28.501 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.501 13:50:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.501 13:50:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.501 13:50:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.501 13:50:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.501 13:50:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.501 13:50:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.501 13:50:08 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.501 13:50:08 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.501 13:50:08 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.501 13:50:08 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.501 13:50:08 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.501 13:50:08 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.501 13:50:08 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.501 13:50:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.501 13:50:08 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.501 13:50:08 -- scripts/common.sh@344 -- # : 1 00:16:28.501 13:50:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.501 13:50:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.501 13:50:08 -- scripts/common.sh@364 -- # decimal 1 00:16:28.501 13:50:08 -- scripts/common.sh@352 -- # local d=1 00:16:28.501 13:50:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.501 13:50:08 -- scripts/common.sh@354 -- # echo 1 00:16:28.501 13:50:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.501 13:50:08 -- scripts/common.sh@365 -- # decimal 2 00:16:28.501 13:50:08 -- scripts/common.sh@352 -- # local d=2 00:16:28.501 13:50:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.501 13:50:08 -- scripts/common.sh@354 -- # echo 2 00:16:28.501 13:50:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.501 13:50:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.501 13:50:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.501 13:50:08 -- scripts/common.sh@367 -- # return 0 00:16:28.501 13:50:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.501 --rc genhtml_branch_coverage=1 00:16:28.501 --rc genhtml_function_coverage=1 00:16:28.501 --rc genhtml_legend=1 00:16:28.501 --rc geninfo_all_blocks=1 00:16:28.501 --rc geninfo_unexecuted_blocks=1 00:16:28.501 00:16:28.501 ' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.501 --rc genhtml_branch_coverage=1 00:16:28.501 --rc genhtml_function_coverage=1 00:16:28.501 --rc genhtml_legend=1 00:16:28.501 --rc geninfo_all_blocks=1 00:16:28.501 --rc geninfo_unexecuted_blocks=1 00:16:28.501 00:16:28.501 ' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.501 --rc genhtml_branch_coverage=1 00:16:28.501 --rc genhtml_function_coverage=1 00:16:28.501 --rc genhtml_legend=1 00:16:28.501 --rc geninfo_all_blocks=1 00:16:28.501 --rc geninfo_unexecuted_blocks=1 00:16:28.501 00:16:28.501 ' 00:16:28.501 13:50:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.501 --rc genhtml_branch_coverage=1 00:16:28.501 --rc genhtml_function_coverage=1 00:16:28.501 --rc genhtml_legend=1 00:16:28.501 --rc geninfo_all_blocks=1 00:16:28.501 --rc geninfo_unexecuted_blocks=1 00:16:28.501 00:16:28.501 ' 00:16:28.501 13:50:08 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.501 13:50:08 -- nvmf/common.sh@7 -- # uname -s 00:16:28.501 13:50:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.501 13:50:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.501 13:50:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.501 13:50:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.501 13:50:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.501 13:50:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.501 13:50:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.501 13:50:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.501 13:50:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.501 13:50:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.501 13:50:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.501 13:50:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.501 13:50:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.501 13:50:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.501 13:50:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.501 13:50:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.501 13:50:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.501 13:50:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.501 13:50:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.501 13:50:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.501 13:50:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.502 13:50:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.502 13:50:08 -- paths/export.sh@5 -- # export PATH 00:16:28.502 13:50:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.502 13:50:08 -- nvmf/common.sh@46 -- # : 0 00:16:28.502 13:50:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.502 13:50:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.502 13:50:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.502 13:50:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.502 13:50:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.502 13:50:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.502 13:50:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.502 13:50:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2280414 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2280414' 00:16:28.502 Process pid: 2280414 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:28.502 13:50:08 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2280414 00:16:28.502 13:50:08 -- common/autotest_common.sh@829 -- # '[' -z 2280414 ']' 00:16:28.502 13:50:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.502 13:50:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:28.502 13:50:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.502 13:50:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:28.502 13:50:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.885 13:50:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:29.885 13:50:09 -- common/autotest_common.sh@862 -- # return 0 00:16:29.885 13:50:09 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:30.452 13:50:10 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:30.452 13:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.452 13:50:10 -- common/autotest_common.sh@10 -- # set +x 00:16:30.711 13:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:30.711 13:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.711 13:50:10 -- common/autotest_common.sh@10 -- # set +x 00:16:30.711 malloc0 00:16:30.711 13:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:30.711 13:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.711 13:50:10 -- common/autotest_common.sh@10 -- # set +x 00:16:30.711 13:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:30.711 13:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.711 13:50:10 -- common/autotest_common.sh@10 -- # set +x 00:16:30.711 13:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:30.711 13:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.711 13:50:10 -- common/autotest_common.sh@10 -- # set +x 00:16:30.711 13:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:30.711 13:50:10 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:02.816 Fuzzing completed. Shutting down the fuzz application 00:17:02.816 00:17:02.816 Dumping successful admin opcodes: 00:17:02.816 8, 9, 10, 24, 00:17:02.816 Dumping successful io opcodes: 00:17:02.816 0, 00:17:02.816 NS: 0x200003a1ef00 I/O qp, Total commands completed: 736646, total successful commands: 2855, random_seed: 3172050880 00:17:02.816 NS: 0x200003a1ef00 admin qp, Total commands completed: 183782, total successful commands: 1481, random_seed: 2223905280 00:17:02.816 13:50:41 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:02.816 13:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.816 13:50:41 -- common/autotest_common.sh@10 -- # set +x 00:17:02.816 13:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.816 13:50:41 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2280414 00:17:02.816 13:50:41 -- common/autotest_common.sh@936 -- # '[' -z 2280414 ']' 00:17:02.816 13:50:41 -- common/autotest_common.sh@940 -- # kill -0 2280414 00:17:02.816 13:50:41 -- common/autotest_common.sh@941 -- # uname 00:17:02.816 13:50:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.816 13:50:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2280414 00:17:02.816 13:50:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:02.816 13:50:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:02.816 13:50:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2280414' 00:17:02.816 killing process with pid 2280414 00:17:02.816 13:50:41 -- common/autotest_common.sh@955 -- # kill 2280414 00:17:02.816 13:50:41 -- common/autotest_common.sh@960 -- # wait 2280414 00:17:02.816 13:50:41 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:02.816 13:50:41 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:02.816 00:17:02.816 real 0m33.062s 00:17:02.817 user 0m37.157s 00:17:02.817 sys 0m25.261s 00:17:02.817 13:50:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:02.817 13:50:41 -- common/autotest_common.sh@10 -- # set +x 00:17:02.817 ************************************ 00:17:02.817 END TEST nvmf_vfio_user_fuzz 00:17:02.817 ************************************ 00:17:02.817 13:50:41 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.817 13:50:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:02.817 13:50:41 -- common/autotest_common.sh@10 -- # set +x 00:17:02.817 ************************************ 00:17:02.817 START TEST nvmf_host_management 00:17:02.817 ************************************ 00:17:02.817 13:50:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.817 * Looking for test storage... 00:17:02.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:02.817 13:50:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:02.817 13:50:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:02.817 13:50:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:02.817 13:50:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:02.817 13:50:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:02.817 13:50:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:02.817 13:50:41 -- scripts/common.sh@335 -- # IFS=.-: 00:17:02.817 13:50:41 -- scripts/common.sh@335 -- # read -ra ver1 00:17:02.817 13:50:41 -- scripts/common.sh@336 -- # IFS=.-: 00:17:02.817 13:50:41 -- scripts/common.sh@336 -- # read -ra ver2 00:17:02.817 13:50:41 -- scripts/common.sh@337 -- # local 'op=<' 00:17:02.817 13:50:41 -- scripts/common.sh@339 -- # ver1_l=2 00:17:02.817 13:50:41 -- scripts/common.sh@340 -- # ver2_l=1 00:17:02.817 13:50:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:02.817 13:50:41 -- scripts/common.sh@343 -- # case "$op" in 00:17:02.817 13:50:41 -- scripts/common.sh@344 -- # : 1 00:17:02.817 13:50:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:02.817 13:50:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:02.817 13:50:41 -- scripts/common.sh@364 -- # decimal 1 00:17:02.817 13:50:41 -- scripts/common.sh@352 -- # local d=1 00:17:02.817 13:50:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:02.817 13:50:41 -- scripts/common.sh@354 -- # echo 1 00:17:02.817 13:50:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:02.817 13:50:41 -- scripts/common.sh@365 -- # decimal 2 00:17:02.817 13:50:41 -- scripts/common.sh@352 -- # local d=2 00:17:02.817 13:50:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:02.817 13:50:41 -- scripts/common.sh@354 -- # echo 2 00:17:02.817 13:50:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:02.817 13:50:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:02.817 13:50:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:02.817 13:50:41 -- scripts/common.sh@367 -- # return 0 00:17:02.817 13:50:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:02.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.817 --rc genhtml_branch_coverage=1 00:17:02.817 --rc genhtml_function_coverage=1 00:17:02.817 --rc genhtml_legend=1 00:17:02.817 --rc geninfo_all_blocks=1 00:17:02.817 --rc geninfo_unexecuted_blocks=1 00:17:02.817 00:17:02.817 ' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:02.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.817 --rc genhtml_branch_coverage=1 00:17:02.817 --rc genhtml_function_coverage=1 00:17:02.817 --rc genhtml_legend=1 00:17:02.817 --rc geninfo_all_blocks=1 00:17:02.817 --rc geninfo_unexecuted_blocks=1 00:17:02.817 00:17:02.817 ' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:02.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.817 --rc genhtml_branch_coverage=1 00:17:02.817 --rc genhtml_function_coverage=1 00:17:02.817 --rc genhtml_legend=1 00:17:02.817 --rc geninfo_all_blocks=1 00:17:02.817 --rc geninfo_unexecuted_blocks=1 00:17:02.817 00:17:02.817 ' 00:17:02.817 13:50:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:02.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.817 --rc genhtml_branch_coverage=1 00:17:02.817 --rc genhtml_function_coverage=1 00:17:02.817 --rc genhtml_legend=1 00:17:02.817 --rc geninfo_all_blocks=1 00:17:02.817 --rc geninfo_unexecuted_blocks=1 00:17:02.817 00:17:02.817 ' 00:17:02.817 13:50:41 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:02.817 13:50:41 -- nvmf/common.sh@7 -- # uname -s 00:17:02.817 13:50:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:02.817 13:50:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:02.817 13:50:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:02.817 13:50:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:02.817 13:50:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:02.817 13:50:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:02.817 13:50:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:02.817 13:50:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:02.817 13:50:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:02.817 13:50:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:02.817 13:50:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.817 13:50:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.817 13:50:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:02.817 13:50:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:02.817 13:50:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:02.817 13:50:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:02.817 13:50:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:02.817 13:50:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:02.817 13:50:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:02.817 13:50:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.817 13:50:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.818 13:50:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.818 13:50:41 -- paths/export.sh@5 -- # export PATH 00:17:02.818 13:50:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.818 13:50:41 -- nvmf/common.sh@46 -- # : 0 00:17:02.818 13:50:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:02.818 13:50:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:02.818 13:50:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:02.818 13:50:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:02.818 13:50:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:02.818 13:50:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:02.818 13:50:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:02.818 13:50:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:02.818 13:50:41 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:02.818 13:50:41 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:02.818 13:50:41 -- target/host_management.sh@104 -- # nvmftestinit 00:17:02.818 13:50:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:02.818 13:50:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:02.818 13:50:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:02.818 13:50:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:02.818 13:50:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:02.818 13:50:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.818 13:50:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.818 13:50:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.818 13:50:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:02.818 13:50:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:02.818 13:50:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:02.818 13:50:41 -- common/autotest_common.sh@10 -- # set +x 00:17:03.752 13:50:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:03.752 13:50:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:03.752 13:50:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:03.752 13:50:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:03.752 13:50:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:03.752 13:50:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:03.752 13:50:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:03.752 13:50:43 -- nvmf/common.sh@294 -- # net_devs=() 00:17:03.752 13:50:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:03.752 13:50:43 -- nvmf/common.sh@295 -- # e810=() 00:17:03.752 13:50:43 -- nvmf/common.sh@295 -- # local -ga e810 00:17:03.752 13:50:43 -- nvmf/common.sh@296 -- # x722=() 00:17:03.752 13:50:43 -- nvmf/common.sh@296 -- # local -ga x722 00:17:03.752 13:50:43 -- nvmf/common.sh@297 -- # mlx=() 00:17:03.752 13:50:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:03.752 13:50:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:03.752 13:50:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.752 13:50:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:03.752 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:03.752 13:50:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.752 13:50:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:03.752 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:03.752 13:50:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.752 13:50:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.752 13:50:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.752 13:50:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:03.752 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:03.752 13:50:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.752 13:50:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.752 13:50:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.752 13:50:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:03.752 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:03.752 13:50:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:03.752 13:50:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:03.752 13:50:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:03.752 13:50:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:03.752 13:50:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:03.752 13:50:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:03.752 13:50:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:03.752 13:50:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:03.752 13:50:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:03.752 13:50:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:03.752 13:50:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:03.752 13:50:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:03.752 13:50:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:03.752 13:50:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:03.752 13:50:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:03.752 13:50:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:03.752 13:50:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:03.752 13:50:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:03.752 13:50:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:03.752 13:50:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:03.752 13:50:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:03.752 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:03.752 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.318 ms 00:17:03.752 00:17:03.752 --- 10.0.0.2 ping statistics --- 00:17:03.752 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.752 rtt min/avg/max/mdev = 0.318/0.318/0.318/0.000 ms 00:17:03.752 13:50:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:03.752 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:03.752 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:17:03.752 00:17:03.752 --- 10.0.0.1 ping statistics --- 00:17:03.752 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.752 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:17:03.752 13:50:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:03.752 13:50:43 -- nvmf/common.sh@410 -- # return 0 00:17:03.752 13:50:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:03.752 13:50:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:03.752 13:50:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:03.752 13:50:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:03.752 13:50:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:03.752 13:50:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:03.752 13:50:43 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:03.752 13:50:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:03.752 13:50:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:03.752 13:50:43 -- common/autotest_common.sh@10 -- # set +x 00:17:03.752 ************************************ 00:17:03.753 START TEST nvmf_host_management 00:17:03.753 ************************************ 00:17:03.753 13:50:43 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:03.753 13:50:43 -- target/host_management.sh@69 -- # starttarget 00:17:03.753 13:50:43 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:03.753 13:50:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:03.753 13:50:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:03.753 13:50:43 -- common/autotest_common.sh@10 -- # set +x 00:17:03.753 13:50:43 -- nvmf/common.sh@469 -- # nvmfpid=2285995 00:17:03.753 13:50:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:03.753 13:50:43 -- nvmf/common.sh@470 -- # waitforlisten 2285995 00:17:03.753 13:50:43 -- common/autotest_common.sh@829 -- # '[' -z 2285995 ']' 00:17:03.753 13:50:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:03.753 13:50:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:03.753 13:50:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:03.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:03.753 13:50:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:03.753 13:50:43 -- common/autotest_common.sh@10 -- # set +x 00:17:03.753 [2024-11-29 13:50:44.000805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:03.753 [2024-11-29 13:50:44.000903] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:04.012 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.012 [2024-11-29 13:50:44.068096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:04.012 [2024-11-29 13:50:44.156403] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:04.012 [2024-11-29 13:50:44.156597] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:04.012 [2024-11-29 13:50:44.156615] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:04.012 [2024-11-29 13:50:44.156628] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:04.012 [2024-11-29 13:50:44.156715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:04.012 [2024-11-29 13:50:44.156845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:04.012 [2024-11-29 13:50:44.156895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:04.012 [2024-11-29 13:50:44.156898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:04.947 13:50:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:04.947 13:50:44 -- common/autotest_common.sh@862 -- # return 0 00:17:04.947 13:50:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:04.947 13:50:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.947 13:50:44 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 13:50:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.947 13:50:45 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:04.947 13:50:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.947 13:50:45 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 [2024-11-29 13:50:45.017117] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.947 13:50:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.947 13:50:45 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:04.947 13:50:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:04.947 13:50:45 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 13:50:45 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:04.947 13:50:45 -- target/host_management.sh@23 -- # cat 00:17:04.947 13:50:45 -- target/host_management.sh@30 -- # rpc_cmd 00:17:04.947 13:50:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.947 13:50:45 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 Malloc0 00:17:04.947 [2024-11-29 13:50:45.082161] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:04.947 13:50:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.947 13:50:45 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:04.947 13:50:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.947 13:50:45 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 13:50:45 -- target/host_management.sh@73 -- # perfpid=2286177 00:17:04.947 13:50:45 -- target/host_management.sh@74 -- # waitforlisten 2286177 /var/tmp/bdevperf.sock 00:17:04.947 13:50:45 -- common/autotest_common.sh@829 -- # '[' -z 2286177 ']' 00:17:04.947 13:50:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:04.947 13:50:45 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:04.947 13:50:45 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:04.947 13:50:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:04.947 13:50:45 -- nvmf/common.sh@520 -- # config=() 00:17:04.947 13:50:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:04.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:04.947 13:50:45 -- nvmf/common.sh@520 -- # local subsystem config 00:17:04.947 13:50:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:04.947 13:50:45 -- common/autotest_common.sh@10 -- # set +x 00:17:04.947 13:50:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:04.947 13:50:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:04.947 { 00:17:04.947 "params": { 00:17:04.947 "name": "Nvme$subsystem", 00:17:04.947 "trtype": "$TEST_TRANSPORT", 00:17:04.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.947 "adrfam": "ipv4", 00:17:04.947 "trsvcid": "$NVMF_PORT", 00:17:04.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.947 "hdgst": ${hdgst:-false}, 00:17:04.947 "ddgst": ${ddgst:-false} 00:17:04.947 }, 00:17:04.947 "method": "bdev_nvme_attach_controller" 00:17:04.947 } 00:17:04.947 EOF 00:17:04.947 )") 00:17:04.947 13:50:45 -- nvmf/common.sh@542 -- # cat 00:17:04.947 13:50:45 -- nvmf/common.sh@544 -- # jq . 00:17:04.947 13:50:45 -- nvmf/common.sh@545 -- # IFS=, 00:17:04.947 13:50:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:04.947 "params": { 00:17:04.947 "name": "Nvme0", 00:17:04.947 "trtype": "tcp", 00:17:04.947 "traddr": "10.0.0.2", 00:17:04.947 "adrfam": "ipv4", 00:17:04.947 "trsvcid": "4420", 00:17:04.947 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:04.947 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:04.947 "hdgst": false, 00:17:04.947 "ddgst": false 00:17:04.947 }, 00:17:04.947 "method": "bdev_nvme_attach_controller" 00:17:04.947 }' 00:17:04.947 [2024-11-29 13:50:45.161240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:04.947 [2024-11-29 13:50:45.161314] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2286177 ] 00:17:04.947 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.947 [2024-11-29 13:50:45.222893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:05.207 [2024-11-29 13:50:45.309164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:05.466 Running I/O for 10 seconds... 00:17:06.036 13:50:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:06.036 13:50:46 -- common/autotest_common.sh@862 -- # return 0 00:17:06.036 13:50:46 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:06.036 13:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.036 13:50:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.036 13:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.036 13:50:46 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:06.036 13:50:46 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:06.036 13:50:46 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:06.036 13:50:46 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:06.036 13:50:46 -- target/host_management.sh@52 -- # local ret=1 00:17:06.036 13:50:46 -- target/host_management.sh@53 -- # local i 00:17:06.036 13:50:46 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:06.036 13:50:46 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:06.036 13:50:46 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:06.036 13:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.036 13:50:46 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:06.036 13:50:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.036 13:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.036 13:50:46 -- target/host_management.sh@55 -- # read_io_count=2213 00:17:06.036 13:50:46 -- target/host_management.sh@58 -- # '[' 2213 -ge 100 ']' 00:17:06.036 13:50:46 -- target/host_management.sh@59 -- # ret=0 00:17:06.036 13:50:46 -- target/host_management.sh@60 -- # break 00:17:06.036 13:50:46 -- target/host_management.sh@64 -- # return 0 00:17:06.036 13:50:46 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:06.036 13:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.036 13:50:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.036 [2024-11-29 13:50:46.191442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ff40 is same with the state(5) to be set 00:17:06.036 [2024-11-29 13:50:46.191844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.191883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.191909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.191925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.191941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.191954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.191970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.191984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.191998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.036 [2024-11-29 13:50:46.192489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.036 [2024-11-29 13:50:46.192504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.192974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.192989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.037 [2024-11-29 13:50:46.193676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.037 [2024-11-29 13:50:46.193691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.038 [2024-11-29 13:50:46.193704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.038 [2024-11-29 13:50:46.193720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.038 [2024-11-29 13:50:46.193734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.038 [2024-11-29 13:50:46.193749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.038 [2024-11-29 13:50:46.193762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.038 [2024-11-29 13:50:46.193778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.038 [2024-11-29 13:50:46.193792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.038 [2024-11-29 13:50:46.193807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20adf30 is same with the state(5) to be set 00:17:06.038 [2024-11-29 13:50:46.193879] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20adf30 was disconnected and freed. reset controller. 00:17:06.038 13:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.038 13:50:46 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:06.038 13:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.038 13:50:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.038 [2024-11-29 13:50:46.195024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:06.038 task offset: 40704 on job bdev=Nvme0n1 fails 00:17:06.038 00:17:06.038 Latency(us) 00:17:06.038 [2024-11-29T12:50:46.320Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:06.038 [2024-11-29T12:50:46.320Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:06.038 [2024-11-29T12:50:46.320Z] Job: Nvme0n1 ended in about 0.59 seconds with error 00:17:06.038 Verification LBA range: start 0x0 length 0x400 00:17:06.038 Nvme0n1 : 0.59 3997.00 249.81 108.99 0.00 15340.13 2839.89 22816.24 00:17:06.038 [2024-11-29T12:50:46.320Z] =================================================================================================================== 00:17:06.038 [2024-11-29T12:50:46.320Z] Total : 3997.00 249.81 108.99 0.00 15340.13 2839.89 22816.24 00:17:06.038 [2024-11-29 13:50:46.196959] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:06.038 [2024-11-29 13:50:46.197002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b0870 (9): Bad file descriptor 00:17:06.038 13:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.038 13:50:46 -- target/host_management.sh@87 -- # sleep 1 00:17:06.038 [2024-11-29 13:50:46.207882] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:06.976 13:50:47 -- target/host_management.sh@91 -- # kill -9 2286177 00:17:06.976 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2286177) - No such process 00:17:06.976 13:50:47 -- target/host_management.sh@91 -- # true 00:17:06.976 13:50:47 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:06.976 13:50:47 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:06.976 13:50:47 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:06.976 13:50:47 -- nvmf/common.sh@520 -- # config=() 00:17:06.976 13:50:47 -- nvmf/common.sh@520 -- # local subsystem config 00:17:06.976 13:50:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:06.976 13:50:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:06.976 { 00:17:06.976 "params": { 00:17:06.976 "name": "Nvme$subsystem", 00:17:06.976 "trtype": "$TEST_TRANSPORT", 00:17:06.976 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:06.976 "adrfam": "ipv4", 00:17:06.976 "trsvcid": "$NVMF_PORT", 00:17:06.976 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:06.976 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:06.976 "hdgst": ${hdgst:-false}, 00:17:06.977 "ddgst": ${ddgst:-false} 00:17:06.977 }, 00:17:06.977 "method": "bdev_nvme_attach_controller" 00:17:06.977 } 00:17:06.977 EOF 00:17:06.977 )") 00:17:06.977 13:50:47 -- nvmf/common.sh@542 -- # cat 00:17:06.977 13:50:47 -- nvmf/common.sh@544 -- # jq . 00:17:06.977 13:50:47 -- nvmf/common.sh@545 -- # IFS=, 00:17:06.977 13:50:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:06.977 "params": { 00:17:06.977 "name": "Nvme0", 00:17:06.977 "trtype": "tcp", 00:17:06.977 "traddr": "10.0.0.2", 00:17:06.977 "adrfam": "ipv4", 00:17:06.977 "trsvcid": "4420", 00:17:06.977 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:06.977 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:06.977 "hdgst": false, 00:17:06.977 "ddgst": false 00:17:06.977 }, 00:17:06.977 "method": "bdev_nvme_attach_controller" 00:17:06.977 }' 00:17:06.977 [2024-11-29 13:50:47.250461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:06.977 [2024-11-29 13:50:47.250541] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2286458 ] 00:17:07.235 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.235 [2024-11-29 13:50:47.312460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:07.235 [2024-11-29 13:50:47.397521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.493 Running I/O for 1 seconds... 00:17:08.431 00:17:08.431 Latency(us) 00:17:08.431 [2024-11-29T12:50:48.713Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:08.431 [2024-11-29T12:50:48.713Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:08.431 Verification LBA range: start 0x0 length 0x400 00:17:08.431 Nvme0n1 : 1.01 4001.41 250.09 0.00 0.00 15748.64 807.06 23981.32 00:17:08.431 [2024-11-29T12:50:48.713Z] =================================================================================================================== 00:17:08.431 [2024-11-29T12:50:48.714Z] Total : 4001.41 250.09 0.00 0.00 15748.64 807.06 23981.32 00:17:08.713 13:50:48 -- target/host_management.sh@101 -- # stoptarget 00:17:08.713 13:50:48 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:08.713 13:50:48 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:08.713 13:50:48 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:08.713 13:50:48 -- target/host_management.sh@40 -- # nvmftestfini 00:17:08.713 13:50:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.713 13:50:48 -- nvmf/common.sh@116 -- # sync 00:17:08.713 13:50:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.713 13:50:48 -- nvmf/common.sh@119 -- # set +e 00:17:08.713 13:50:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.713 13:50:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.713 rmmod nvme_tcp 00:17:08.713 rmmod nvme_fabrics 00:17:08.713 rmmod nvme_keyring 00:17:08.713 13:50:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.713 13:50:48 -- nvmf/common.sh@123 -- # set -e 00:17:08.713 13:50:48 -- nvmf/common.sh@124 -- # return 0 00:17:08.713 13:50:48 -- nvmf/common.sh@477 -- # '[' -n 2285995 ']' 00:17:08.713 13:50:48 -- nvmf/common.sh@478 -- # killprocess 2285995 00:17:08.713 13:50:48 -- common/autotest_common.sh@936 -- # '[' -z 2285995 ']' 00:17:08.713 13:50:48 -- common/autotest_common.sh@940 -- # kill -0 2285995 00:17:08.713 13:50:48 -- common/autotest_common.sh@941 -- # uname 00:17:08.713 13:50:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.713 13:50:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2285995 00:17:08.713 13:50:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:08.713 13:50:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:08.713 13:50:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2285995' 00:17:08.713 killing process with pid 2285995 00:17:08.713 13:50:48 -- common/autotest_common.sh@955 -- # kill 2285995 00:17:08.713 13:50:48 -- common/autotest_common.sh@960 -- # wait 2285995 00:17:08.995 [2024-11-29 13:50:49.106868] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:08.995 13:50:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:08.995 13:50:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:08.995 13:50:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:08.995 13:50:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:08.995 13:50:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:08.995 13:50:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.995 13:50:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.995 13:50:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.901 13:50:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:10.901 00:17:10.902 real 0m7.223s 00:17:10.902 user 0m22.306s 00:17:10.902 sys 0m1.421s 00:17:10.902 13:50:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:10.902 13:50:51 -- common/autotest_common.sh@10 -- # set +x 00:17:10.902 ************************************ 00:17:10.902 END TEST nvmf_host_management 00:17:10.902 ************************************ 00:17:11.161 13:50:51 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:11.161 00:17:11.161 real 0m9.585s 00:17:11.161 user 0m23.180s 00:17:11.161 sys 0m2.935s 00:17:11.161 13:50:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.161 13:50:51 -- common/autotest_common.sh@10 -- # set +x 00:17:11.161 ************************************ 00:17:11.161 END TEST nvmf_host_management 00:17:11.161 ************************************ 00:17:11.161 13:50:51 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.161 13:50:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.161 13:50:51 -- common/autotest_common.sh@10 -- # set +x 00:17:11.161 ************************************ 00:17:11.161 START TEST nvmf_lvol 00:17:11.161 ************************************ 00:17:11.161 13:50:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.161 * Looking for test storage... 00:17:11.161 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.161 13:50:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:11.161 13:50:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:11.161 13:50:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:11.161 13:50:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:11.161 13:50:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:11.161 13:50:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:11.161 13:50:51 -- scripts/common.sh@335 -- # IFS=.-: 00:17:11.161 13:50:51 -- scripts/common.sh@335 -- # read -ra ver1 00:17:11.161 13:50:51 -- scripts/common.sh@336 -- # IFS=.-: 00:17:11.161 13:50:51 -- scripts/common.sh@336 -- # read -ra ver2 00:17:11.161 13:50:51 -- scripts/common.sh@337 -- # local 'op=<' 00:17:11.161 13:50:51 -- scripts/common.sh@339 -- # ver1_l=2 00:17:11.161 13:50:51 -- scripts/common.sh@340 -- # ver2_l=1 00:17:11.161 13:50:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:11.161 13:50:51 -- scripts/common.sh@343 -- # case "$op" in 00:17:11.161 13:50:51 -- scripts/common.sh@344 -- # : 1 00:17:11.161 13:50:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:11.161 13:50:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:11.161 13:50:51 -- scripts/common.sh@364 -- # decimal 1 00:17:11.161 13:50:51 -- scripts/common.sh@352 -- # local d=1 00:17:11.161 13:50:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:11.161 13:50:51 -- scripts/common.sh@354 -- # echo 1 00:17:11.161 13:50:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:11.161 13:50:51 -- scripts/common.sh@365 -- # decimal 2 00:17:11.161 13:50:51 -- scripts/common.sh@352 -- # local d=2 00:17:11.161 13:50:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:11.161 13:50:51 -- scripts/common.sh@354 -- # echo 2 00:17:11.161 13:50:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:11.161 13:50:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:11.161 13:50:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:11.161 13:50:51 -- scripts/common.sh@367 -- # return 0 00:17:11.161 13:50:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:11.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.161 --rc genhtml_branch_coverage=1 00:17:11.161 --rc genhtml_function_coverage=1 00:17:11.161 --rc genhtml_legend=1 00:17:11.161 --rc geninfo_all_blocks=1 00:17:11.161 --rc geninfo_unexecuted_blocks=1 00:17:11.161 00:17:11.161 ' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:11.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.161 --rc genhtml_branch_coverage=1 00:17:11.161 --rc genhtml_function_coverage=1 00:17:11.161 --rc genhtml_legend=1 00:17:11.161 --rc geninfo_all_blocks=1 00:17:11.161 --rc geninfo_unexecuted_blocks=1 00:17:11.161 00:17:11.161 ' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:11.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.161 --rc genhtml_branch_coverage=1 00:17:11.161 --rc genhtml_function_coverage=1 00:17:11.161 --rc genhtml_legend=1 00:17:11.161 --rc geninfo_all_blocks=1 00:17:11.161 --rc geninfo_unexecuted_blocks=1 00:17:11.161 00:17:11.161 ' 00:17:11.161 13:50:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:11.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.161 --rc genhtml_branch_coverage=1 00:17:11.161 --rc genhtml_function_coverage=1 00:17:11.161 --rc genhtml_legend=1 00:17:11.161 --rc geninfo_all_blocks=1 00:17:11.161 --rc geninfo_unexecuted_blocks=1 00:17:11.161 00:17:11.161 ' 00:17:11.161 13:50:51 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.161 13:50:51 -- nvmf/common.sh@7 -- # uname -s 00:17:11.161 13:50:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.161 13:50:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.161 13:50:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.161 13:50:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.161 13:50:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.161 13:50:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.161 13:50:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.161 13:50:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.161 13:50:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.162 13:50:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.162 13:50:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.162 13:50:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.162 13:50:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.162 13:50:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.162 13:50:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.162 13:50:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.162 13:50:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.162 13:50:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.162 13:50:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.162 13:50:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.162 13:50:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.162 13:50:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.162 13:50:51 -- paths/export.sh@5 -- # export PATH 00:17:11.162 13:50:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.162 13:50:51 -- nvmf/common.sh@46 -- # : 0 00:17:11.162 13:50:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.162 13:50:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.162 13:50:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.162 13:50:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.162 13:50:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.162 13:50:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.162 13:50:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.162 13:50:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.162 13:50:51 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:11.162 13:50:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:11.162 13:50:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:11.162 13:50:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:11.162 13:50:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:11.162 13:50:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:11.162 13:50:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.162 13:50:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.162 13:50:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.162 13:50:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:11.162 13:50:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:11.162 13:50:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:11.162 13:50:51 -- common/autotest_common.sh@10 -- # set +x 00:17:13.709 13:50:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:13.709 13:50:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:13.709 13:50:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:13.709 13:50:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:13.709 13:50:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:13.709 13:50:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:13.709 13:50:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:13.709 13:50:53 -- nvmf/common.sh@294 -- # net_devs=() 00:17:13.709 13:50:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:13.709 13:50:53 -- nvmf/common.sh@295 -- # e810=() 00:17:13.709 13:50:53 -- nvmf/common.sh@295 -- # local -ga e810 00:17:13.709 13:50:53 -- nvmf/common.sh@296 -- # x722=() 00:17:13.709 13:50:53 -- nvmf/common.sh@296 -- # local -ga x722 00:17:13.709 13:50:53 -- nvmf/common.sh@297 -- # mlx=() 00:17:13.709 13:50:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:13.709 13:50:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:13.709 13:50:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:13.709 13:50:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:13.709 13:50:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.709 13:50:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:13.709 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:13.709 13:50:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.709 13:50:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:13.709 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:13.709 13:50:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.709 13:50:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.709 13:50:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.709 13:50:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:13.709 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:13.709 13:50:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.709 13:50:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.709 13:50:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.709 13:50:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.709 13:50:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:13.709 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:13.709 13:50:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.709 13:50:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:13.709 13:50:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:13.709 13:50:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:13.709 13:50:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:13.709 13:50:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:13.709 13:50:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:13.709 13:50:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:13.709 13:50:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:13.709 13:50:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:13.710 13:50:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:13.710 13:50:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:13.710 13:50:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:13.710 13:50:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:13.710 13:50:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:13.710 13:50:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:13.710 13:50:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:13.710 13:50:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:13.710 13:50:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:13.710 13:50:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:13.710 13:50:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:13.710 13:50:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:13.710 13:50:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:13.710 13:50:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:13.710 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:13.710 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:17:13.710 00:17:13.710 --- 10.0.0.2 ping statistics --- 00:17:13.710 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.710 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:17:13.710 13:50:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:13.710 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:13.710 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:17:13.710 00:17:13.710 --- 10.0.0.1 ping statistics --- 00:17:13.710 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.710 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:17:13.710 13:50:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:13.710 13:50:53 -- nvmf/common.sh@410 -- # return 0 00:17:13.710 13:50:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:13.710 13:50:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:13.710 13:50:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:13.710 13:50:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:13.710 13:50:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:13.710 13:50:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:13.710 13:50:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:13.710 13:50:53 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:13.710 13:50:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:13.710 13:50:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:13.710 13:50:53 -- common/autotest_common.sh@10 -- # set +x 00:17:13.710 13:50:53 -- nvmf/common.sh@469 -- # nvmfpid=2288589 00:17:13.710 13:50:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:13.710 13:50:53 -- nvmf/common.sh@470 -- # waitforlisten 2288589 00:17:13.710 13:50:53 -- common/autotest_common.sh@829 -- # '[' -z 2288589 ']' 00:17:13.710 13:50:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:13.710 13:50:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.710 13:50:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:13.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:13.710 13:50:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.710 13:50:53 -- common/autotest_common.sh@10 -- # set +x 00:17:13.710 [2024-11-29 13:50:53.635111] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.710 [2024-11-29 13:50:53.635180] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:13.710 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.710 [2024-11-29 13:50:53.698663] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:13.710 [2024-11-29 13:50:53.784172] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:13.710 [2024-11-29 13:50:53.784347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:13.710 [2024-11-29 13:50:53.784364] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:13.710 [2024-11-29 13:50:53.784383] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:13.710 [2024-11-29 13:50:53.784453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:13.710 [2024-11-29 13:50:53.784518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:13.710 [2024-11-29 13:50:53.784522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:14.647 13:50:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:14.647 13:50:54 -- common/autotest_common.sh@862 -- # return 0 00:17:14.647 13:50:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:14.647 13:50:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:14.647 13:50:54 -- common/autotest_common.sh@10 -- # set +x 00:17:14.647 13:50:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:14.647 13:50:54 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:14.647 [2024-11-29 13:50:54.876119] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:14.647 13:50:54 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:14.907 13:50:55 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:14.907 13:50:55 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:15.165 13:50:55 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:15.165 13:50:55 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:15.733 13:50:55 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:15.733 13:50:55 -- target/nvmf_lvol.sh@29 -- # lvs=5cfd30c0-8132-4a55-a866-0002ed843b4f 00:17:15.733 13:50:55 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 5cfd30c0-8132-4a55-a866-0002ed843b4f lvol 20 00:17:15.991 13:50:56 -- target/nvmf_lvol.sh@32 -- # lvol=7c036c05-ea2c-4e6b-97e6-2f56f29e0135 00:17:15.991 13:50:56 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:16.248 13:50:56 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7c036c05-ea2c-4e6b-97e6-2f56f29e0135 00:17:16.506 13:50:56 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:16.764 [2024-11-29 13:50:56.972208] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.764 13:50:56 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:17.021 13:50:57 -- target/nvmf_lvol.sh@42 -- # perf_pid=2289122 00:17:17.021 13:50:57 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:17.021 13:50:57 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:17.021 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.399 13:50:58 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 7c036c05-ea2c-4e6b-97e6-2f56f29e0135 MY_SNAPSHOT 00:17:18.399 13:50:58 -- target/nvmf_lvol.sh@47 -- # snapshot=e5039495-3461-4b3b-8c72-371bd95ed2b7 00:17:18.399 13:50:58 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 7c036c05-ea2c-4e6b-97e6-2f56f29e0135 30 00:17:18.657 13:50:58 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone e5039495-3461-4b3b-8c72-371bd95ed2b7 MY_CLONE 00:17:18.915 13:50:59 -- target/nvmf_lvol.sh@49 -- # clone=9cf1fecb-6b37-473b-9679-a8087f4181a4 00:17:18.915 13:50:59 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 9cf1fecb-6b37-473b-9679-a8087f4181a4 00:17:19.852 13:50:59 -- target/nvmf_lvol.sh@53 -- # wait 2289122 00:17:27.968 Initializing NVMe Controllers 00:17:27.968 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:27.968 Controller IO queue size 128, less than required. 00:17:27.968 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:27.968 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:27.968 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:27.968 Initialization complete. Launching workers. 00:17:27.968 ======================================================== 00:17:27.968 Latency(us) 00:17:27.968 Device Information : IOPS MiB/s Average min max 00:17:27.968 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10965.20 42.83 11680.97 623.97 81605.46 00:17:27.968 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10651.10 41.61 12019.95 2218.16 76601.45 00:17:27.968 ======================================================== 00:17:27.968 Total : 21616.30 84.44 11848.00 623.97 81605.46 00:17:27.968 00:17:27.968 13:51:07 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:27.968 13:51:07 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7c036c05-ea2c-4e6b-97e6-2f56f29e0135 00:17:27.968 13:51:08 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 5cfd30c0-8132-4a55-a866-0002ed843b4f 00:17:28.227 13:51:08 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:28.227 13:51:08 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:28.227 13:51:08 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:28.227 13:51:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:28.227 13:51:08 -- nvmf/common.sh@116 -- # sync 00:17:28.227 13:51:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:28.227 13:51:08 -- nvmf/common.sh@119 -- # set +e 00:17:28.227 13:51:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:28.227 13:51:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:28.227 rmmod nvme_tcp 00:17:28.227 rmmod nvme_fabrics 00:17:28.227 rmmod nvme_keyring 00:17:28.227 13:51:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:28.227 13:51:08 -- nvmf/common.sh@123 -- # set -e 00:17:28.227 13:51:08 -- nvmf/common.sh@124 -- # return 0 00:17:28.227 13:51:08 -- nvmf/common.sh@477 -- # '[' -n 2288589 ']' 00:17:28.227 13:51:08 -- nvmf/common.sh@478 -- # killprocess 2288589 00:17:28.227 13:51:08 -- common/autotest_common.sh@936 -- # '[' -z 2288589 ']' 00:17:28.227 13:51:08 -- common/autotest_common.sh@940 -- # kill -0 2288589 00:17:28.486 13:51:08 -- common/autotest_common.sh@941 -- # uname 00:17:28.486 13:51:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:28.486 13:51:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2288589 00:17:28.486 13:51:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:28.486 13:51:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:28.486 13:51:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2288589' 00:17:28.486 killing process with pid 2288589 00:17:28.486 13:51:08 -- common/autotest_common.sh@955 -- # kill 2288589 00:17:28.486 13:51:08 -- common/autotest_common.sh@960 -- # wait 2288589 00:17:28.748 13:51:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:28.748 13:51:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:28.748 13:51:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:28.748 13:51:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:28.748 13:51:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:28.748 13:51:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.748 13:51:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.748 13:51:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.656 13:51:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:30.656 00:17:30.656 real 0m19.631s 00:17:30.656 user 1m6.121s 00:17:30.656 sys 0m5.721s 00:17:30.656 13:51:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:30.656 13:51:10 -- common/autotest_common.sh@10 -- # set +x 00:17:30.656 ************************************ 00:17:30.656 END TEST nvmf_lvol 00:17:30.656 ************************************ 00:17:30.656 13:51:10 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:30.656 13:51:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:30.656 13:51:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:30.656 13:51:10 -- common/autotest_common.sh@10 -- # set +x 00:17:30.656 ************************************ 00:17:30.656 START TEST nvmf_lvs_grow 00:17:30.656 ************************************ 00:17:30.656 13:51:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:30.656 * Looking for test storage... 00:17:30.914 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:30.914 13:51:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:30.914 13:51:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:30.914 13:51:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:30.914 13:51:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:30.914 13:51:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:30.914 13:51:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:30.914 13:51:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:30.914 13:51:11 -- scripts/common.sh@335 -- # IFS=.-: 00:17:30.914 13:51:11 -- scripts/common.sh@335 -- # read -ra ver1 00:17:30.914 13:51:11 -- scripts/common.sh@336 -- # IFS=.-: 00:17:30.914 13:51:11 -- scripts/common.sh@336 -- # read -ra ver2 00:17:30.914 13:51:11 -- scripts/common.sh@337 -- # local 'op=<' 00:17:30.914 13:51:11 -- scripts/common.sh@339 -- # ver1_l=2 00:17:30.914 13:51:11 -- scripts/common.sh@340 -- # ver2_l=1 00:17:30.914 13:51:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:30.914 13:51:11 -- scripts/common.sh@343 -- # case "$op" in 00:17:30.914 13:51:11 -- scripts/common.sh@344 -- # : 1 00:17:30.914 13:51:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:30.914 13:51:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:30.914 13:51:11 -- scripts/common.sh@364 -- # decimal 1 00:17:30.914 13:51:11 -- scripts/common.sh@352 -- # local d=1 00:17:30.914 13:51:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:30.914 13:51:11 -- scripts/common.sh@354 -- # echo 1 00:17:30.914 13:51:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:30.914 13:51:11 -- scripts/common.sh@365 -- # decimal 2 00:17:30.915 13:51:11 -- scripts/common.sh@352 -- # local d=2 00:17:30.915 13:51:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:30.915 13:51:11 -- scripts/common.sh@354 -- # echo 2 00:17:30.915 13:51:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:30.915 13:51:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:30.915 13:51:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:30.915 13:51:11 -- scripts/common.sh@367 -- # return 0 00:17:30.915 13:51:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:30.915 13:51:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:30.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.915 --rc genhtml_branch_coverage=1 00:17:30.915 --rc genhtml_function_coverage=1 00:17:30.915 --rc genhtml_legend=1 00:17:30.915 --rc geninfo_all_blocks=1 00:17:30.915 --rc geninfo_unexecuted_blocks=1 00:17:30.915 00:17:30.915 ' 00:17:30.915 13:51:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:30.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.915 --rc genhtml_branch_coverage=1 00:17:30.915 --rc genhtml_function_coverage=1 00:17:30.915 --rc genhtml_legend=1 00:17:30.915 --rc geninfo_all_blocks=1 00:17:30.915 --rc geninfo_unexecuted_blocks=1 00:17:30.915 00:17:30.915 ' 00:17:30.915 13:51:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:30.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.915 --rc genhtml_branch_coverage=1 00:17:30.915 --rc genhtml_function_coverage=1 00:17:30.915 --rc genhtml_legend=1 00:17:30.915 --rc geninfo_all_blocks=1 00:17:30.915 --rc geninfo_unexecuted_blocks=1 00:17:30.915 00:17:30.915 ' 00:17:30.915 13:51:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:30.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.915 --rc genhtml_branch_coverage=1 00:17:30.915 --rc genhtml_function_coverage=1 00:17:30.915 --rc genhtml_legend=1 00:17:30.915 --rc geninfo_all_blocks=1 00:17:30.915 --rc geninfo_unexecuted_blocks=1 00:17:30.915 00:17:30.915 ' 00:17:30.915 13:51:11 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:30.915 13:51:11 -- nvmf/common.sh@7 -- # uname -s 00:17:30.915 13:51:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:30.915 13:51:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:30.915 13:51:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:30.915 13:51:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:30.915 13:51:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:30.915 13:51:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:30.915 13:51:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:30.915 13:51:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:30.915 13:51:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:30.915 13:51:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:30.915 13:51:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:30.915 13:51:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:30.915 13:51:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:30.915 13:51:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:30.915 13:51:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:30.915 13:51:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:30.915 13:51:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:30.915 13:51:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:30.915 13:51:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:30.915 13:51:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.915 13:51:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.915 13:51:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.915 13:51:11 -- paths/export.sh@5 -- # export PATH 00:17:30.915 13:51:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.915 13:51:11 -- nvmf/common.sh@46 -- # : 0 00:17:30.915 13:51:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:30.915 13:51:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:30.915 13:51:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:30.915 13:51:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:30.915 13:51:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:30.915 13:51:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:30.915 13:51:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:30.915 13:51:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:30.915 13:51:11 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.915 13:51:11 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:30.915 13:51:11 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:30.915 13:51:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:30.915 13:51:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:30.915 13:51:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:30.915 13:51:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:30.915 13:51:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:30.915 13:51:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:30.915 13:51:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:30.915 13:51:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.915 13:51:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:30.915 13:51:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:30.915 13:51:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:30.915 13:51:11 -- common/autotest_common.sh@10 -- # set +x 00:17:32.820 13:51:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:32.820 13:51:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:32.820 13:51:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:32.820 13:51:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:32.820 13:51:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:32.820 13:51:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:32.820 13:51:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:32.820 13:51:13 -- nvmf/common.sh@294 -- # net_devs=() 00:17:32.820 13:51:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:32.820 13:51:13 -- nvmf/common.sh@295 -- # e810=() 00:17:32.820 13:51:13 -- nvmf/common.sh@295 -- # local -ga e810 00:17:32.820 13:51:13 -- nvmf/common.sh@296 -- # x722=() 00:17:32.820 13:51:13 -- nvmf/common.sh@296 -- # local -ga x722 00:17:32.820 13:51:13 -- nvmf/common.sh@297 -- # mlx=() 00:17:32.820 13:51:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:32.821 13:51:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:32.821 13:51:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:32.821 13:51:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:32.821 13:51:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:32.821 13:51:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:32.821 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:32.821 13:51:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:32.821 13:51:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:32.821 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:32.821 13:51:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:32.821 13:51:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.821 13:51:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.821 13:51:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:32.821 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:32.821 13:51:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.821 13:51:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:32.821 13:51:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.821 13:51:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.821 13:51:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:32.821 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:32.821 13:51:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.821 13:51:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:32.821 13:51:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:32.821 13:51:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:32.821 13:51:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:32.821 13:51:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:32.821 13:51:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:32.821 13:51:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:32.821 13:51:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:32.821 13:51:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:32.821 13:51:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:32.821 13:51:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:32.821 13:51:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:32.821 13:51:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:32.821 13:51:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:32.821 13:51:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:32.821 13:51:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:33.080 13:51:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:33.080 13:51:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:33.080 13:51:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:33.080 13:51:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:33.080 13:51:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:33.080 13:51:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:33.080 13:51:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:33.080 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:33.080 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:17:33.080 00:17:33.080 --- 10.0.0.2 ping statistics --- 00:17:33.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.080 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:17:33.080 13:51:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:33.080 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:33.080 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:17:33.080 00:17:33.080 --- 10.0.0.1 ping statistics --- 00:17:33.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.080 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:17:33.080 13:51:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:33.080 13:51:13 -- nvmf/common.sh@410 -- # return 0 00:17:33.080 13:51:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:33.080 13:51:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:33.080 13:51:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:33.080 13:51:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:33.080 13:51:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:33.080 13:51:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:33.080 13:51:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:33.080 13:51:13 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:33.080 13:51:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:33.080 13:51:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:33.080 13:51:13 -- common/autotest_common.sh@10 -- # set +x 00:17:33.080 13:51:13 -- nvmf/common.sh@469 -- # nvmfpid=2293090 00:17:33.080 13:51:13 -- nvmf/common.sh@470 -- # waitforlisten 2293090 00:17:33.080 13:51:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:33.080 13:51:13 -- common/autotest_common.sh@829 -- # '[' -z 2293090 ']' 00:17:33.080 13:51:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:33.080 13:51:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.080 13:51:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:33.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:33.080 13:51:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.080 13:51:13 -- common/autotest_common.sh@10 -- # set +x 00:17:33.080 [2024-11-29 13:51:13.247082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.080 [2024-11-29 13:51:13.247163] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:33.080 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.080 [2024-11-29 13:51:13.316989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.340 [2024-11-29 13:51:13.405543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:33.340 [2024-11-29 13:51:13.405704] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:33.340 [2024-11-29 13:51:13.405724] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:33.340 [2024-11-29 13:51:13.405740] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:33.340 [2024-11-29 13:51:13.405784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:34.278 13:51:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.278 13:51:14 -- common/autotest_common.sh@862 -- # return 0 00:17:34.278 13:51:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:34.278 13:51:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:34.278 13:51:14 -- common/autotest_common.sh@10 -- # set +x 00:17:34.278 13:51:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:34.278 [2024-11-29 13:51:14.462344] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:34.278 13:51:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:34.278 13:51:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:34.278 13:51:14 -- common/autotest_common.sh@10 -- # set +x 00:17:34.278 ************************************ 00:17:34.278 START TEST lvs_grow_clean 00:17:34.278 ************************************ 00:17:34.278 13:51:14 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.278 13:51:14 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:34.538 13:51:14 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:34.538 13:51:14 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:34.798 13:51:15 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ef506a91-8007-4518-aee8-ce718858dfcf 00:17:34.798 13:51:15 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:34.798 13:51:15 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:35.055 13:51:15 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:35.055 13:51:15 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:35.055 13:51:15 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ef506a91-8007-4518-aee8-ce718858dfcf lvol 150 00:17:35.314 13:51:15 -- target/nvmf_lvs_grow.sh@33 -- # lvol=1acc573e-a7f1-49b4-afee-69b1f9a5c145 00:17:35.314 13:51:15 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.314 13:51:15 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:35.573 [2024-11-29 13:51:15.750722] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:35.573 [2024-11-29 13:51:15.750836] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:35.573 true 00:17:35.573 13:51:15 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:35.573 13:51:15 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:35.832 13:51:16 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:35.832 13:51:16 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:36.091 13:51:16 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1acc573e-a7f1-49b4-afee-69b1f9a5c145 00:17:36.349 13:51:16 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:36.609 [2024-11-29 13:51:16.757835] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.609 13:51:16 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:36.868 13:51:17 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2293543 00:17:36.868 13:51:17 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:36.868 13:51:17 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:36.868 13:51:17 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2293543 /var/tmp/bdevperf.sock 00:17:36.868 13:51:17 -- common/autotest_common.sh@829 -- # '[' -z 2293543 ']' 00:17:36.868 13:51:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:36.868 13:51:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:36.868 13:51:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:36.868 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:36.868 13:51:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:36.868 13:51:17 -- common/autotest_common.sh@10 -- # set +x 00:17:36.868 [2024-11-29 13:51:17.069342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:36.868 [2024-11-29 13:51:17.069458] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2293543 ] 00:17:36.868 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.868 [2024-11-29 13:51:17.131861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.128 [2024-11-29 13:51:17.222758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:38.065 13:51:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.065 13:51:18 -- common/autotest_common.sh@862 -- # return 0 00:17:38.065 13:51:18 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:38.324 Nvme0n1 00:17:38.583 13:51:18 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:38.843 [ 00:17:38.843 { 00:17:38.843 "name": "Nvme0n1", 00:17:38.843 "aliases": [ 00:17:38.843 "1acc573e-a7f1-49b4-afee-69b1f9a5c145" 00:17:38.843 ], 00:17:38.843 "product_name": "NVMe disk", 00:17:38.843 "block_size": 4096, 00:17:38.843 "num_blocks": 38912, 00:17:38.843 "uuid": "1acc573e-a7f1-49b4-afee-69b1f9a5c145", 00:17:38.843 "assigned_rate_limits": { 00:17:38.843 "rw_ios_per_sec": 0, 00:17:38.843 "rw_mbytes_per_sec": 0, 00:17:38.843 "r_mbytes_per_sec": 0, 00:17:38.843 "w_mbytes_per_sec": 0 00:17:38.843 }, 00:17:38.843 "claimed": false, 00:17:38.843 "zoned": false, 00:17:38.843 "supported_io_types": { 00:17:38.843 "read": true, 00:17:38.843 "write": true, 00:17:38.843 "unmap": true, 00:17:38.843 "write_zeroes": true, 00:17:38.843 "flush": true, 00:17:38.843 "reset": true, 00:17:38.843 "compare": true, 00:17:38.843 "compare_and_write": true, 00:17:38.843 "abort": true, 00:17:38.843 "nvme_admin": true, 00:17:38.843 "nvme_io": true 00:17:38.843 }, 00:17:38.843 "driver_specific": { 00:17:38.843 "nvme": [ 00:17:38.843 { 00:17:38.843 "trid": { 00:17:38.843 "trtype": "TCP", 00:17:38.843 "adrfam": "IPv4", 00:17:38.843 "traddr": "10.0.0.2", 00:17:38.843 "trsvcid": "4420", 00:17:38.843 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:38.843 }, 00:17:38.843 "ctrlr_data": { 00:17:38.843 "cntlid": 1, 00:17:38.843 "vendor_id": "0x8086", 00:17:38.843 "model_number": "SPDK bdev Controller", 00:17:38.843 "serial_number": "SPDK0", 00:17:38.843 "firmware_revision": "24.01.1", 00:17:38.843 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:38.843 "oacs": { 00:17:38.843 "security": 0, 00:17:38.843 "format": 0, 00:17:38.843 "firmware": 0, 00:17:38.843 "ns_manage": 0 00:17:38.843 }, 00:17:38.843 "multi_ctrlr": true, 00:17:38.843 "ana_reporting": false 00:17:38.843 }, 00:17:38.843 "vs": { 00:17:38.843 "nvme_version": "1.3" 00:17:38.843 }, 00:17:38.843 "ns_data": { 00:17:38.843 "id": 1, 00:17:38.843 "can_share": true 00:17:38.843 } 00:17:38.843 } 00:17:38.843 ], 00:17:38.843 "mp_policy": "active_passive" 00:17:38.843 } 00:17:38.843 } 00:17:38.843 ] 00:17:38.843 13:51:18 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2293820 00:17:38.843 13:51:18 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:38.843 13:51:18 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:38.843 Running I/O for 10 seconds... 00:17:39.783 Latency(us) 00:17:39.783 [2024-11-29T12:51:20.065Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.783 [2024-11-29T12:51:20.065Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.783 Nvme0n1 : 1.00 14606.00 57.05 0.00 0.00 0.00 0.00 0.00 00:17:39.783 [2024-11-29T12:51:20.065Z] =================================================================================================================== 00:17:39.783 [2024-11-29T12:51:20.065Z] Total : 14606.00 57.05 0.00 0.00 0.00 0.00 0.00 00:17:39.783 00:17:40.715 13:51:20 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:40.973 [2024-11-29T12:51:21.255Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.973 Nvme0n1 : 2.00 14765.00 57.68 0.00 0.00 0.00 0.00 0.00 00:17:40.973 [2024-11-29T12:51:21.255Z] =================================================================================================================== 00:17:40.973 [2024-11-29T12:51:21.255Z] Total : 14765.00 57.68 0.00 0.00 0.00 0.00 0.00 00:17:40.973 00:17:40.973 true 00:17:40.973 13:51:21 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:40.973 13:51:21 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:41.231 13:51:21 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:41.231 13:51:21 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:41.231 13:51:21 -- target/nvmf_lvs_grow.sh@65 -- # wait 2293820 00:17:41.798 [2024-11-29T12:51:22.080Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.798 Nvme0n1 : 3.00 14928.00 58.31 0.00 0.00 0.00 0.00 0.00 00:17:41.798 [2024-11-29T12:51:22.080Z] =================================================================================================================== 00:17:41.798 [2024-11-29T12:51:22.080Z] Total : 14928.00 58.31 0.00 0.00 0.00 0.00 0.00 00:17:41.798 00:17:42.731 [2024-11-29T12:51:23.013Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.731 Nvme0n1 : 4.00 15022.25 58.68 0.00 0.00 0.00 0.00 0.00 00:17:42.731 [2024-11-29T12:51:23.013Z] =================================================================================================================== 00:17:42.731 [2024-11-29T12:51:23.013Z] Total : 15022.25 58.68 0.00 0.00 0.00 0.00 0.00 00:17:42.731 00:17:44.108 [2024-11-29T12:51:24.390Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.108 Nvme0n1 : 5.00 15117.80 59.05 0.00 0.00 0.00 0.00 0.00 00:17:44.108 [2024-11-29T12:51:24.390Z] =================================================================================================================== 00:17:44.108 [2024-11-29T12:51:24.390Z] Total : 15117.80 59.05 0.00 0.00 0.00 0.00 0.00 00:17:44.108 00:17:45.041 [2024-11-29T12:51:25.323Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.041 Nvme0n1 : 6.00 15173.33 59.27 0.00 0.00 0.00 0.00 0.00 00:17:45.041 [2024-11-29T12:51:25.323Z] =================================================================================================================== 00:17:45.041 [2024-11-29T12:51:25.323Z] Total : 15173.33 59.27 0.00 0.00 0.00 0.00 0.00 00:17:45.041 00:17:45.977 [2024-11-29T12:51:26.259Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.977 Nvme0n1 : 7.00 15222.00 59.46 0.00 0.00 0.00 0.00 0.00 00:17:45.977 [2024-11-29T12:51:26.259Z] =================================================================================================================== 00:17:45.977 [2024-11-29T12:51:26.259Z] Total : 15222.00 59.46 0.00 0.00 0.00 0.00 0.00 00:17:45.977 00:17:46.922 [2024-11-29T12:51:27.204Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.922 Nvme0n1 : 8.00 15249.00 59.57 0.00 0.00 0.00 0.00 0.00 00:17:46.922 [2024-11-29T12:51:27.204Z] =================================================================================================================== 00:17:46.922 [2024-11-29T12:51:27.204Z] Total : 15249.00 59.57 0.00 0.00 0.00 0.00 0.00 00:17:46.922 00:17:47.930 [2024-11-29T12:51:28.212Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.930 Nvme0n1 : 9.00 15286.00 59.71 0.00 0.00 0.00 0.00 0.00 00:17:47.930 [2024-11-29T12:51:28.212Z] =================================================================================================================== 00:17:47.930 [2024-11-29T12:51:28.212Z] Total : 15286.00 59.71 0.00 0.00 0.00 0.00 0.00 00:17:47.930 00:17:48.872 [2024-11-29T12:51:29.154Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.872 Nvme0n1 : 10.00 15307.10 59.79 0.00 0.00 0.00 0.00 0.00 00:17:48.872 [2024-11-29T12:51:29.154Z] =================================================================================================================== 00:17:48.872 [2024-11-29T12:51:29.154Z] Total : 15307.10 59.79 0.00 0.00 0.00 0.00 0.00 00:17:48.872 00:17:48.872 00:17:48.872 Latency(us) 00:17:48.872 [2024-11-29T12:51:29.154Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.872 [2024-11-29T12:51:29.154Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.872 Nvme0n1 : 10.01 15310.04 59.80 0.00 0.00 8356.20 4830.25 19126.80 00:17:48.872 [2024-11-29T12:51:29.154Z] =================================================================================================================== 00:17:48.872 [2024-11-29T12:51:29.154Z] Total : 15310.04 59.80 0.00 0.00 8356.20 4830.25 19126.80 00:17:48.872 0 00:17:48.872 13:51:29 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2293543 00:17:48.872 13:51:29 -- common/autotest_common.sh@936 -- # '[' -z 2293543 ']' 00:17:48.872 13:51:29 -- common/autotest_common.sh@940 -- # kill -0 2293543 00:17:48.872 13:51:29 -- common/autotest_common.sh@941 -- # uname 00:17:48.872 13:51:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:48.872 13:51:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2293543 00:17:48.872 13:51:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:48.872 13:51:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:48.872 13:51:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2293543' 00:17:48.872 killing process with pid 2293543 00:17:48.872 13:51:29 -- common/autotest_common.sh@955 -- # kill 2293543 00:17:48.872 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.872 00:17:48.872 Latency(us) 00:17:48.872 [2024-11-29T12:51:29.154Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.872 [2024-11-29T12:51:29.154Z] =================================================================================================================== 00:17:48.872 [2024-11-29T12:51:29.154Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:48.872 13:51:29 -- common/autotest_common.sh@960 -- # wait 2293543 00:17:49.131 13:51:29 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:49.388 13:51:29 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:49.388 13:51:29 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:49.647 13:51:29 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:49.647 13:51:29 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:49.647 13:51:29 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:49.908 [2024-11-29 13:51:30.111329] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:49.908 13:51:30 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:49.908 13:51:30 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.908 13:51:30 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:49.908 13:51:30 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.908 13:51:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.908 13:51:30 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.908 13:51:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.908 13:51:30 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.908 13:51:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.908 13:51:30 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.908 13:51:30 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:49.908 13:51:30 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:50.168 request: 00:17:50.168 { 00:17:50.168 "uuid": "ef506a91-8007-4518-aee8-ce718858dfcf", 00:17:50.168 "method": "bdev_lvol_get_lvstores", 00:17:50.168 "req_id": 1 00:17:50.168 } 00:17:50.168 Got JSON-RPC error response 00:17:50.168 response: 00:17:50.168 { 00:17:50.168 "code": -19, 00:17:50.168 "message": "No such device" 00:17:50.168 } 00:17:50.426 13:51:30 -- common/autotest_common.sh@653 -- # es=1 00:17:50.427 13:51:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:50.427 13:51:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:50.427 13:51:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:50.427 13:51:30 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:50.687 aio_bdev 00:17:50.687 13:51:30 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 1acc573e-a7f1-49b4-afee-69b1f9a5c145 00:17:50.687 13:51:30 -- common/autotest_common.sh@897 -- # local bdev_name=1acc573e-a7f1-49b4-afee-69b1f9a5c145 00:17:50.687 13:51:30 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:50.687 13:51:30 -- common/autotest_common.sh@899 -- # local i 00:17:50.687 13:51:30 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:50.687 13:51:30 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:50.687 13:51:30 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:50.947 13:51:31 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1acc573e-a7f1-49b4-afee-69b1f9a5c145 -t 2000 00:17:51.206 [ 00:17:51.206 { 00:17:51.206 "name": "1acc573e-a7f1-49b4-afee-69b1f9a5c145", 00:17:51.206 "aliases": [ 00:17:51.206 "lvs/lvol" 00:17:51.206 ], 00:17:51.206 "product_name": "Logical Volume", 00:17:51.206 "block_size": 4096, 00:17:51.206 "num_blocks": 38912, 00:17:51.206 "uuid": "1acc573e-a7f1-49b4-afee-69b1f9a5c145", 00:17:51.206 "assigned_rate_limits": { 00:17:51.206 "rw_ios_per_sec": 0, 00:17:51.206 "rw_mbytes_per_sec": 0, 00:17:51.206 "r_mbytes_per_sec": 0, 00:17:51.206 "w_mbytes_per_sec": 0 00:17:51.206 }, 00:17:51.206 "claimed": false, 00:17:51.206 "zoned": false, 00:17:51.206 "supported_io_types": { 00:17:51.206 "read": true, 00:17:51.206 "write": true, 00:17:51.206 "unmap": true, 00:17:51.206 "write_zeroes": true, 00:17:51.206 "flush": false, 00:17:51.206 "reset": true, 00:17:51.206 "compare": false, 00:17:51.206 "compare_and_write": false, 00:17:51.206 "abort": false, 00:17:51.206 "nvme_admin": false, 00:17:51.206 "nvme_io": false 00:17:51.206 }, 00:17:51.206 "driver_specific": { 00:17:51.206 "lvol": { 00:17:51.206 "lvol_store_uuid": "ef506a91-8007-4518-aee8-ce718858dfcf", 00:17:51.206 "base_bdev": "aio_bdev", 00:17:51.206 "thin_provision": false, 00:17:51.206 "snapshot": false, 00:17:51.206 "clone": false, 00:17:51.206 "esnap_clone": false 00:17:51.206 } 00:17:51.206 } 00:17:51.206 } 00:17:51.206 ] 00:17:51.206 13:51:31 -- common/autotest_common.sh@905 -- # return 0 00:17:51.206 13:51:31 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:51.206 13:51:31 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:51.465 13:51:31 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:51.465 13:51:31 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:51.465 13:51:31 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:51.726 13:51:31 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:51.726 13:51:31 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1acc573e-a7f1-49b4-afee-69b1f9a5c145 00:17:51.986 13:51:32 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ef506a91-8007-4518-aee8-ce718858dfcf 00:17:52.245 13:51:32 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.503 00:17:52.503 real 0m18.203s 00:17:52.503 user 0m18.070s 00:17:52.503 sys 0m1.806s 00:17:52.503 13:51:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:52.503 13:51:32 -- common/autotest_common.sh@10 -- # set +x 00:17:52.503 ************************************ 00:17:52.503 END TEST lvs_grow_clean 00:17:52.503 ************************************ 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:52.503 13:51:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:52.503 13:51:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:52.503 13:51:32 -- common/autotest_common.sh@10 -- # set +x 00:17:52.503 ************************************ 00:17:52.503 START TEST lvs_grow_dirty 00:17:52.503 ************************************ 00:17:52.503 13:51:32 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.503 13:51:32 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:52.763 13:51:32 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:52.763 13:51:32 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:53.023 13:51:33 -- target/nvmf_lvs_grow.sh@28 -- # lvs=4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:17:53.023 13:51:33 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:17:53.023 13:51:33 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:53.284 13:51:33 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:53.284 13:51:33 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:53.284 13:51:33 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 lvol 150 00:17:53.545 13:51:33 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:17:53.545 13:51:33 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:53.545 13:51:33 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:53.804 [2024-11-29 13:51:33.998798] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:53.804 [2024-11-29 13:51:33.998897] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:53.804 true 00:17:53.804 13:51:34 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:17:53.804 13:51:34 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:54.066 13:51:34 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:54.066 13:51:34 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:54.325 13:51:34 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:17:54.584 13:51:34 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:54.844 13:51:35 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:55.102 13:51:35 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2295787 00:17:55.102 13:51:35 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:55.102 13:51:35 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:55.102 13:51:35 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2295787 /var/tmp/bdevperf.sock 00:17:55.102 13:51:35 -- common/autotest_common.sh@829 -- # '[' -z 2295787 ']' 00:17:55.102 13:51:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.102 13:51:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.102 13:51:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.102 13:51:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.102 13:51:35 -- common/autotest_common.sh@10 -- # set +x 00:17:55.102 [2024-11-29 13:51:35.322206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:55.102 [2024-11-29 13:51:35.322289] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2295787 ] 00:17:55.102 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.360 [2024-11-29 13:51:35.384680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.360 [2024-11-29 13:51:35.473404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:56.299 13:51:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.299 13:51:36 -- common/autotest_common.sh@862 -- # return 0 00:17:56.299 13:51:36 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:56.558 Nvme0n1 00:17:56.558 13:51:36 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:56.817 [ 00:17:56.817 { 00:17:56.817 "name": "Nvme0n1", 00:17:56.817 "aliases": [ 00:17:56.817 "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd" 00:17:56.817 ], 00:17:56.817 "product_name": "NVMe disk", 00:17:56.817 "block_size": 4096, 00:17:56.817 "num_blocks": 38912, 00:17:56.817 "uuid": "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd", 00:17:56.817 "assigned_rate_limits": { 00:17:56.817 "rw_ios_per_sec": 0, 00:17:56.817 "rw_mbytes_per_sec": 0, 00:17:56.817 "r_mbytes_per_sec": 0, 00:17:56.817 "w_mbytes_per_sec": 0 00:17:56.817 }, 00:17:56.817 "claimed": false, 00:17:56.817 "zoned": false, 00:17:56.817 "supported_io_types": { 00:17:56.817 "read": true, 00:17:56.817 "write": true, 00:17:56.817 "unmap": true, 00:17:56.817 "write_zeroes": true, 00:17:56.817 "flush": true, 00:17:56.817 "reset": true, 00:17:56.817 "compare": true, 00:17:56.817 "compare_and_write": true, 00:17:56.817 "abort": true, 00:17:56.817 "nvme_admin": true, 00:17:56.817 "nvme_io": true 00:17:56.817 }, 00:17:56.817 "driver_specific": { 00:17:56.817 "nvme": [ 00:17:56.817 { 00:17:56.817 "trid": { 00:17:56.817 "trtype": "TCP", 00:17:56.817 "adrfam": "IPv4", 00:17:56.817 "traddr": "10.0.0.2", 00:17:56.817 "trsvcid": "4420", 00:17:56.817 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:56.817 }, 00:17:56.817 "ctrlr_data": { 00:17:56.817 "cntlid": 1, 00:17:56.817 "vendor_id": "0x8086", 00:17:56.817 "model_number": "SPDK bdev Controller", 00:17:56.817 "serial_number": "SPDK0", 00:17:56.817 "firmware_revision": "24.01.1", 00:17:56.817 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:56.817 "oacs": { 00:17:56.817 "security": 0, 00:17:56.817 "format": 0, 00:17:56.817 "firmware": 0, 00:17:56.817 "ns_manage": 0 00:17:56.817 }, 00:17:56.817 "multi_ctrlr": true, 00:17:56.817 "ana_reporting": false 00:17:56.817 }, 00:17:56.817 "vs": { 00:17:56.817 "nvme_version": "1.3" 00:17:56.817 }, 00:17:56.817 "ns_data": { 00:17:56.817 "id": 1, 00:17:56.817 "can_share": true 00:17:56.817 } 00:17:56.817 } 00:17:56.817 ], 00:17:56.817 "mp_policy": "active_passive" 00:17:56.817 } 00:17:56.817 } 00:17:56.817 ] 00:17:56.817 13:51:37 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2296054 00:17:56.817 13:51:37 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:56.817 13:51:37 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:57.078 Running I/O for 10 seconds... 00:17:58.017 Latency(us) 00:17:58.017 [2024-11-29T12:51:38.299Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.017 [2024-11-29T12:51:38.299Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.017 Nvme0n1 : 1.00 14290.00 55.82 0.00 0.00 0.00 0.00 0.00 00:17:58.017 [2024-11-29T12:51:38.299Z] =================================================================================================================== 00:17:58.017 [2024-11-29T12:51:38.299Z] Total : 14290.00 55.82 0.00 0.00 0.00 0.00 0.00 00:17:58.017 00:17:58.959 13:51:39 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:17:58.959 [2024-11-29T12:51:39.241Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.959 Nvme0n1 : 2.00 14578.50 56.95 0.00 0.00 0.00 0.00 0.00 00:17:58.959 [2024-11-29T12:51:39.241Z] =================================================================================================================== 00:17:58.959 [2024-11-29T12:51:39.241Z] Total : 14578.50 56.95 0.00 0.00 0.00 0.00 0.00 00:17:58.959 00:17:59.217 true 00:17:59.217 13:51:39 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:17:59.217 13:51:39 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:59.478 13:51:39 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:59.478 13:51:39 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:59.478 13:51:39 -- target/nvmf_lvs_grow.sh@65 -- # wait 2296054 00:18:00.045 [2024-11-29T12:51:40.327Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.045 Nvme0n1 : 3.00 14545.33 56.82 0.00 0.00 0.00 0.00 0.00 00:18:00.045 [2024-11-29T12:51:40.327Z] =================================================================================================================== 00:18:00.045 [2024-11-29T12:51:40.327Z] Total : 14545.33 56.82 0.00 0.00 0.00 0.00 0.00 00:18:00.045 00:18:00.984 [2024-11-29T12:51:41.266Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.984 Nvme0n1 : 4.00 14560.25 56.88 0.00 0.00 0.00 0.00 0.00 00:18:00.984 [2024-11-29T12:51:41.266Z] =================================================================================================================== 00:18:00.984 [2024-11-29T12:51:41.266Z] Total : 14560.25 56.88 0.00 0.00 0.00 0.00 0.00 00:18:00.984 00:18:01.922 [2024-11-29T12:51:42.204Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.922 Nvme0n1 : 5.00 14582.20 56.96 0.00 0.00 0.00 0.00 0.00 00:18:01.922 [2024-11-29T12:51:42.204Z] =================================================================================================================== 00:18:01.922 [2024-11-29T12:51:42.204Z] Total : 14582.20 56.96 0.00 0.00 0.00 0.00 0.00 00:18:01.922 00:18:02.860 [2024-11-29T12:51:43.142Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.860 Nvme0n1 : 6.00 14607.17 57.06 0.00 0.00 0.00 0.00 0.00 00:18:02.860 [2024-11-29T12:51:43.142Z] =================================================================================================================== 00:18:02.860 [2024-11-29T12:51:43.142Z] Total : 14607.17 57.06 0.00 0.00 0.00 0.00 0.00 00:18:02.860 00:18:04.240 [2024-11-29T12:51:44.522Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.240 Nvme0n1 : 7.00 14698.00 57.41 0.00 0.00 0.00 0.00 0.00 00:18:04.240 [2024-11-29T12:51:44.522Z] =================================================================================================================== 00:18:04.240 [2024-11-29T12:51:44.522Z] Total : 14698.00 57.41 0.00 0.00 0.00 0.00 0.00 00:18:04.240 00:18:05.177 [2024-11-29T12:51:45.459Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.177 Nvme0n1 : 8.00 14711.12 57.47 0.00 0.00 0.00 0.00 0.00 00:18:05.177 [2024-11-29T12:51:45.459Z] =================================================================================================================== 00:18:05.177 [2024-11-29T12:51:45.459Z] Total : 14711.12 57.47 0.00 0.00 0.00 0.00 0.00 00:18:05.177 00:18:06.115 [2024-11-29T12:51:46.397Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.115 Nvme0n1 : 9.00 14709.78 57.46 0.00 0.00 0.00 0.00 0.00 00:18:06.115 [2024-11-29T12:51:46.397Z] =================================================================================================================== 00:18:06.115 [2024-11-29T12:51:46.397Z] Total : 14709.78 57.46 0.00 0.00 0.00 0.00 0.00 00:18:06.115 00:18:07.055 [2024-11-29T12:51:47.337Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.055 Nvme0n1 : 10.00 14725.00 57.52 0.00 0.00 0.00 0.00 0.00 00:18:07.055 [2024-11-29T12:51:47.337Z] =================================================================================================================== 00:18:07.055 [2024-11-29T12:51:47.337Z] Total : 14725.00 57.52 0.00 0.00 0.00 0.00 0.00 00:18:07.055 00:18:07.055 00:18:07.055 Latency(us) 00:18:07.055 [2024-11-29T12:51:47.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.055 [2024-11-29T12:51:47.337Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.055 Nvme0n1 : 10.00 14732.80 57.55 0.00 0.00 8683.43 5218.61 17282.09 00:18:07.055 [2024-11-29T12:51:47.337Z] =================================================================================================================== 00:18:07.055 [2024-11-29T12:51:47.337Z] Total : 14732.80 57.55 0.00 0.00 8683.43 5218.61 17282.09 00:18:07.055 0 00:18:07.055 13:51:47 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2295787 00:18:07.055 13:51:47 -- common/autotest_common.sh@936 -- # '[' -z 2295787 ']' 00:18:07.055 13:51:47 -- common/autotest_common.sh@940 -- # kill -0 2295787 00:18:07.055 13:51:47 -- common/autotest_common.sh@941 -- # uname 00:18:07.055 13:51:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:07.055 13:51:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2295787 00:18:07.055 13:51:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:07.055 13:51:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:07.055 13:51:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2295787' 00:18:07.055 killing process with pid 2295787 00:18:07.055 13:51:47 -- common/autotest_common.sh@955 -- # kill 2295787 00:18:07.055 Received shutdown signal, test time was about 10.000000 seconds 00:18:07.055 00:18:07.055 Latency(us) 00:18:07.055 [2024-11-29T12:51:47.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.055 [2024-11-29T12:51:47.337Z] =================================================================================================================== 00:18:07.055 [2024-11-29T12:51:47.337Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:07.055 13:51:47 -- common/autotest_common.sh@960 -- # wait 2295787 00:18:07.314 13:51:47 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:07.572 13:51:47 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:07.572 13:51:47 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:07.831 13:51:47 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:07.831 13:51:47 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:07.831 13:51:47 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2293090 00:18:07.831 13:51:47 -- target/nvmf_lvs_grow.sh@74 -- # wait 2293090 00:18:07.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2293090 Killed "${NVMF_APP[@]}" "$@" 00:18:07.831 13:51:48 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:07.831 13:51:48 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:07.831 13:51:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:07.831 13:51:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:07.831 13:51:48 -- common/autotest_common.sh@10 -- # set +x 00:18:07.831 13:51:48 -- nvmf/common.sh@469 -- # nvmfpid=2297300 00:18:07.831 13:51:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:07.831 13:51:48 -- nvmf/common.sh@470 -- # waitforlisten 2297300 00:18:07.831 13:51:48 -- common/autotest_common.sh@829 -- # '[' -z 2297300 ']' 00:18:07.831 13:51:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:07.831 13:51:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:07.831 13:51:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:07.831 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:07.831 13:51:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:07.831 13:51:48 -- common/autotest_common.sh@10 -- # set +x 00:18:07.831 [2024-11-29 13:51:48.066848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:07.831 [2024-11-29 13:51:48.066939] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:07.831 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.091 [2024-11-29 13:51:48.133055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.091 [2024-11-29 13:51:48.219863] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.091 [2024-11-29 13:51:48.220023] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.091 [2024-11-29 13:51:48.220040] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.091 [2024-11-29 13:51:48.220053] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.091 [2024-11-29 13:51:48.220081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:09.033 13:51:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.033 13:51:49 -- common/autotest_common.sh@862 -- # return 0 00:18:09.033 13:51:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.033 13:51:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.033 13:51:49 -- common/autotest_common.sh@10 -- # set +x 00:18:09.033 13:51:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.033 13:51:49 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:09.292 [2024-11-29 13:51:49.334019] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:09.292 [2024-11-29 13:51:49.334155] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:09.292 [2024-11-29 13:51:49.334201] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:09.292 13:51:49 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:09.292 13:51:49 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:18:09.292 13:51:49 -- common/autotest_common.sh@897 -- # local bdev_name=c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:18:09.292 13:51:49 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:09.292 13:51:49 -- common/autotest_common.sh@899 -- # local i 00:18:09.292 13:51:49 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:09.292 13:51:49 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:09.292 13:51:49 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:09.549 13:51:49 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd -t 2000 00:18:09.809 [ 00:18:09.809 { 00:18:09.809 "name": "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd", 00:18:09.809 "aliases": [ 00:18:09.809 "lvs/lvol" 00:18:09.809 ], 00:18:09.809 "product_name": "Logical Volume", 00:18:09.809 "block_size": 4096, 00:18:09.809 "num_blocks": 38912, 00:18:09.809 "uuid": "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd", 00:18:09.809 "assigned_rate_limits": { 00:18:09.809 "rw_ios_per_sec": 0, 00:18:09.809 "rw_mbytes_per_sec": 0, 00:18:09.809 "r_mbytes_per_sec": 0, 00:18:09.809 "w_mbytes_per_sec": 0 00:18:09.809 }, 00:18:09.809 "claimed": false, 00:18:09.809 "zoned": false, 00:18:09.809 "supported_io_types": { 00:18:09.809 "read": true, 00:18:09.809 "write": true, 00:18:09.809 "unmap": true, 00:18:09.809 "write_zeroes": true, 00:18:09.809 "flush": false, 00:18:09.809 "reset": true, 00:18:09.809 "compare": false, 00:18:09.809 "compare_and_write": false, 00:18:09.809 "abort": false, 00:18:09.809 "nvme_admin": false, 00:18:09.809 "nvme_io": false 00:18:09.809 }, 00:18:09.809 "driver_specific": { 00:18:09.809 "lvol": { 00:18:09.809 "lvol_store_uuid": "4d8f47d4-3f5f-46a9-8780-026ae9d7e350", 00:18:09.809 "base_bdev": "aio_bdev", 00:18:09.809 "thin_provision": false, 00:18:09.809 "snapshot": false, 00:18:09.809 "clone": false, 00:18:09.809 "esnap_clone": false 00:18:09.809 } 00:18:09.809 } 00:18:09.809 } 00:18:09.809 ] 00:18:09.809 13:51:49 -- common/autotest_common.sh@905 -- # return 0 00:18:09.809 13:51:49 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:09.809 13:51:49 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:10.069 13:51:50 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:10.069 13:51:50 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:10.069 13:51:50 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:10.330 13:51:50 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:10.330 13:51:50 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:10.589 [2024-11-29 13:51:50.675494] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:10.589 13:51:50 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:10.589 13:51:50 -- common/autotest_common.sh@650 -- # local es=0 00:18:10.589 13:51:50 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:10.589 13:51:50 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.589 13:51:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.589 13:51:50 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.589 13:51:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.589 13:51:50 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.589 13:51:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.589 13:51:50 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.589 13:51:50 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:10.589 13:51:50 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:10.848 request: 00:18:10.848 { 00:18:10.848 "uuid": "4d8f47d4-3f5f-46a9-8780-026ae9d7e350", 00:18:10.848 "method": "bdev_lvol_get_lvstores", 00:18:10.848 "req_id": 1 00:18:10.848 } 00:18:10.848 Got JSON-RPC error response 00:18:10.848 response: 00:18:10.848 { 00:18:10.848 "code": -19, 00:18:10.848 "message": "No such device" 00:18:10.848 } 00:18:10.848 13:51:50 -- common/autotest_common.sh@653 -- # es=1 00:18:10.848 13:51:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:10.848 13:51:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:10.848 13:51:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:10.848 13:51:50 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:11.108 aio_bdev 00:18:11.108 13:51:51 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:18:11.108 13:51:51 -- common/autotest_common.sh@897 -- # local bdev_name=c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:18:11.108 13:51:51 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:11.108 13:51:51 -- common/autotest_common.sh@899 -- # local i 00:18:11.108 13:51:51 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:11.108 13:51:51 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:11.108 13:51:51 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:11.367 13:51:51 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd -t 2000 00:18:11.627 [ 00:18:11.627 { 00:18:11.627 "name": "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd", 00:18:11.627 "aliases": [ 00:18:11.627 "lvs/lvol" 00:18:11.627 ], 00:18:11.627 "product_name": "Logical Volume", 00:18:11.627 "block_size": 4096, 00:18:11.627 "num_blocks": 38912, 00:18:11.627 "uuid": "c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd", 00:18:11.627 "assigned_rate_limits": { 00:18:11.627 "rw_ios_per_sec": 0, 00:18:11.627 "rw_mbytes_per_sec": 0, 00:18:11.627 "r_mbytes_per_sec": 0, 00:18:11.627 "w_mbytes_per_sec": 0 00:18:11.627 }, 00:18:11.627 "claimed": false, 00:18:11.627 "zoned": false, 00:18:11.627 "supported_io_types": { 00:18:11.627 "read": true, 00:18:11.627 "write": true, 00:18:11.627 "unmap": true, 00:18:11.627 "write_zeroes": true, 00:18:11.627 "flush": false, 00:18:11.627 "reset": true, 00:18:11.627 "compare": false, 00:18:11.627 "compare_and_write": false, 00:18:11.627 "abort": false, 00:18:11.627 "nvme_admin": false, 00:18:11.627 "nvme_io": false 00:18:11.627 }, 00:18:11.627 "driver_specific": { 00:18:11.627 "lvol": { 00:18:11.627 "lvol_store_uuid": "4d8f47d4-3f5f-46a9-8780-026ae9d7e350", 00:18:11.627 "base_bdev": "aio_bdev", 00:18:11.627 "thin_provision": false, 00:18:11.627 "snapshot": false, 00:18:11.627 "clone": false, 00:18:11.627 "esnap_clone": false 00:18:11.627 } 00:18:11.627 } 00:18:11.627 } 00:18:11.627 ] 00:18:11.627 13:51:51 -- common/autotest_common.sh@905 -- # return 0 00:18:11.627 13:51:51 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:11.627 13:51:51 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:11.887 13:51:51 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:11.887 13:51:51 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:11.887 13:51:51 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:12.148 13:51:52 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:12.148 13:51:52 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c448eb1b-5f80-40bc-94ec-9d97a2a0c7fd 00:18:12.407 13:51:52 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 4d8f47d4-3f5f-46a9-8780-026ae9d7e350 00:18:12.668 13:51:52 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:12.928 13:51:53 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:12.928 00:18:12.928 real 0m20.364s 00:18:12.928 user 0m51.317s 00:18:12.928 sys 0m4.578s 00:18:12.928 13:51:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:12.928 13:51:53 -- common/autotest_common.sh@10 -- # set +x 00:18:12.928 ************************************ 00:18:12.928 END TEST lvs_grow_dirty 00:18:12.928 ************************************ 00:18:12.928 13:51:53 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:12.928 13:51:53 -- common/autotest_common.sh@806 -- # type=--id 00:18:12.928 13:51:53 -- common/autotest_common.sh@807 -- # id=0 00:18:12.928 13:51:53 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:12.928 13:51:53 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:12.928 13:51:53 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:12.928 13:51:53 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:12.928 13:51:53 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:12.928 13:51:53 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:12.928 nvmf_trace.0 00:18:12.928 13:51:53 -- common/autotest_common.sh@821 -- # return 0 00:18:12.928 13:51:53 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:12.928 13:51:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.928 13:51:53 -- nvmf/common.sh@116 -- # sync 00:18:12.928 13:51:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.928 13:51:53 -- nvmf/common.sh@119 -- # set +e 00:18:12.928 13:51:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.928 13:51:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.928 rmmod nvme_tcp 00:18:12.928 rmmod nvme_fabrics 00:18:12.928 rmmod nvme_keyring 00:18:12.928 13:51:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.928 13:51:53 -- nvmf/common.sh@123 -- # set -e 00:18:12.928 13:51:53 -- nvmf/common.sh@124 -- # return 0 00:18:12.928 13:51:53 -- nvmf/common.sh@477 -- # '[' -n 2297300 ']' 00:18:12.928 13:51:53 -- nvmf/common.sh@478 -- # killprocess 2297300 00:18:12.928 13:51:53 -- common/autotest_common.sh@936 -- # '[' -z 2297300 ']' 00:18:12.928 13:51:53 -- common/autotest_common.sh@940 -- # kill -0 2297300 00:18:12.928 13:51:53 -- common/autotest_common.sh@941 -- # uname 00:18:12.928 13:51:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.928 13:51:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2297300 00:18:13.189 13:51:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:13.189 13:51:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:13.189 13:51:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2297300' 00:18:13.189 killing process with pid 2297300 00:18:13.189 13:51:53 -- common/autotest_common.sh@955 -- # kill 2297300 00:18:13.189 13:51:53 -- common/autotest_common.sh@960 -- # wait 2297300 00:18:13.189 13:51:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:13.189 13:51:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:13.189 13:51:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:13.189 13:51:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:13.189 13:51:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:13.189 13:51:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.189 13:51:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.189 13:51:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.743 13:51:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:15.743 00:18:15.743 real 0m44.598s 00:18:15.743 user 1m16.077s 00:18:15.743 sys 0m8.330s 00:18:15.743 13:51:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:15.743 13:51:55 -- common/autotest_common.sh@10 -- # set +x 00:18:15.743 ************************************ 00:18:15.743 END TEST nvmf_lvs_grow 00:18:15.743 ************************************ 00:18:15.743 13:51:55 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:15.743 13:51:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:15.743 13:51:55 -- common/autotest_common.sh@10 -- # set +x 00:18:15.743 ************************************ 00:18:15.743 START TEST nvmf_bdev_io_wait 00:18:15.743 ************************************ 00:18:15.743 13:51:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:15.743 * Looking for test storage... 00:18:15.743 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:15.743 13:51:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:15.743 13:51:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:15.743 13:51:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:15.743 13:51:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:15.743 13:51:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:15.743 13:51:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:15.743 13:51:55 -- scripts/common.sh@335 -- # IFS=.-: 00:18:15.743 13:51:55 -- scripts/common.sh@335 -- # read -ra ver1 00:18:15.743 13:51:55 -- scripts/common.sh@336 -- # IFS=.-: 00:18:15.743 13:51:55 -- scripts/common.sh@336 -- # read -ra ver2 00:18:15.743 13:51:55 -- scripts/common.sh@337 -- # local 'op=<' 00:18:15.743 13:51:55 -- scripts/common.sh@339 -- # ver1_l=2 00:18:15.743 13:51:55 -- scripts/common.sh@340 -- # ver2_l=1 00:18:15.743 13:51:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:15.743 13:51:55 -- scripts/common.sh@343 -- # case "$op" in 00:18:15.743 13:51:55 -- scripts/common.sh@344 -- # : 1 00:18:15.743 13:51:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:15.743 13:51:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:15.743 13:51:55 -- scripts/common.sh@364 -- # decimal 1 00:18:15.743 13:51:55 -- scripts/common.sh@352 -- # local d=1 00:18:15.743 13:51:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:15.743 13:51:55 -- scripts/common.sh@354 -- # echo 1 00:18:15.743 13:51:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:15.743 13:51:55 -- scripts/common.sh@365 -- # decimal 2 00:18:15.743 13:51:55 -- scripts/common.sh@352 -- # local d=2 00:18:15.743 13:51:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:15.743 13:51:55 -- scripts/common.sh@354 -- # echo 2 00:18:15.743 13:51:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:15.743 13:51:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:15.743 13:51:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:15.743 13:51:55 -- scripts/common.sh@367 -- # return 0 00:18:15.743 13:51:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:15.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.743 --rc genhtml_branch_coverage=1 00:18:15.743 --rc genhtml_function_coverage=1 00:18:15.743 --rc genhtml_legend=1 00:18:15.743 --rc geninfo_all_blocks=1 00:18:15.743 --rc geninfo_unexecuted_blocks=1 00:18:15.743 00:18:15.743 ' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:15.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.743 --rc genhtml_branch_coverage=1 00:18:15.743 --rc genhtml_function_coverage=1 00:18:15.743 --rc genhtml_legend=1 00:18:15.743 --rc geninfo_all_blocks=1 00:18:15.743 --rc geninfo_unexecuted_blocks=1 00:18:15.743 00:18:15.743 ' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:15.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.743 --rc genhtml_branch_coverage=1 00:18:15.743 --rc genhtml_function_coverage=1 00:18:15.743 --rc genhtml_legend=1 00:18:15.743 --rc geninfo_all_blocks=1 00:18:15.743 --rc geninfo_unexecuted_blocks=1 00:18:15.743 00:18:15.743 ' 00:18:15.743 13:51:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:15.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.743 --rc genhtml_branch_coverage=1 00:18:15.743 --rc genhtml_function_coverage=1 00:18:15.743 --rc genhtml_legend=1 00:18:15.743 --rc geninfo_all_blocks=1 00:18:15.743 --rc geninfo_unexecuted_blocks=1 00:18:15.743 00:18:15.743 ' 00:18:15.743 13:51:55 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:15.743 13:51:55 -- nvmf/common.sh@7 -- # uname -s 00:18:15.743 13:51:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:15.743 13:51:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:15.743 13:51:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:15.743 13:51:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:15.743 13:51:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:15.743 13:51:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:15.743 13:51:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:15.743 13:51:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:15.743 13:51:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:15.743 13:51:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:15.743 13:51:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.743 13:51:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.743 13:51:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:15.743 13:51:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:15.743 13:51:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:15.743 13:51:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:15.743 13:51:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:15.743 13:51:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:15.743 13:51:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:15.744 13:51:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.744 13:51:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.744 13:51:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.744 13:51:55 -- paths/export.sh@5 -- # export PATH 00:18:15.744 13:51:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.744 13:51:55 -- nvmf/common.sh@46 -- # : 0 00:18:15.744 13:51:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:15.744 13:51:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:15.744 13:51:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:15.744 13:51:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:15.744 13:51:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:15.744 13:51:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:15.744 13:51:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:15.744 13:51:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:15.744 13:51:55 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:15.744 13:51:55 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:15.744 13:51:55 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:15.744 13:51:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:15.744 13:51:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:15.744 13:51:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:15.744 13:51:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:15.744 13:51:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:15.744 13:51:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.744 13:51:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.744 13:51:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.744 13:51:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:15.744 13:51:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:15.744 13:51:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:15.744 13:51:55 -- common/autotest_common.sh@10 -- # set +x 00:18:17.653 13:51:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:17.653 13:51:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:17.653 13:51:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:17.653 13:51:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:17.653 13:51:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:17.653 13:51:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:17.653 13:51:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:17.653 13:51:57 -- nvmf/common.sh@294 -- # net_devs=() 00:18:17.653 13:51:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:17.653 13:51:57 -- nvmf/common.sh@295 -- # e810=() 00:18:17.653 13:51:57 -- nvmf/common.sh@295 -- # local -ga e810 00:18:17.653 13:51:57 -- nvmf/common.sh@296 -- # x722=() 00:18:17.653 13:51:57 -- nvmf/common.sh@296 -- # local -ga x722 00:18:17.653 13:51:57 -- nvmf/common.sh@297 -- # mlx=() 00:18:17.653 13:51:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:17.653 13:51:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:17.653 13:51:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:17.653 13:51:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:17.653 13:51:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.653 13:51:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:17.653 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:17.653 13:51:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.653 13:51:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:17.653 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:17.653 13:51:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.653 13:51:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.653 13:51:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.653 13:51:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:17.653 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:17.653 13:51:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.653 13:51:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.653 13:51:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.653 13:51:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.653 13:51:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:17.653 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:17.653 13:51:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.653 13:51:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:17.653 13:51:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:17.653 13:51:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:17.653 13:51:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:17.653 13:51:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:17.653 13:51:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:17.653 13:51:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:17.653 13:51:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:17.653 13:51:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:17.653 13:51:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:17.653 13:51:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:17.653 13:51:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:17.653 13:51:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:17.653 13:51:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:17.653 13:51:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:17.653 13:51:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:17.653 13:51:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:17.653 13:51:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:17.653 13:51:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:17.653 13:51:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:17.654 13:51:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:17.654 13:51:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:17.654 13:51:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:17.654 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:17.654 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.310 ms 00:18:17.654 00:18:17.654 --- 10.0.0.2 ping statistics --- 00:18:17.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.654 rtt min/avg/max/mdev = 0.310/0.310/0.310/0.000 ms 00:18:17.654 13:51:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:17.654 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:17.654 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:18:17.654 00:18:17.654 --- 10.0.0.1 ping statistics --- 00:18:17.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.654 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:18:17.654 13:51:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:17.654 13:51:57 -- nvmf/common.sh@410 -- # return 0 00:18:17.654 13:51:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:17.654 13:51:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:17.654 13:51:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:17.654 13:51:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:17.654 13:51:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:17.654 13:51:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:17.654 13:51:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:17.654 13:51:57 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:17.654 13:51:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:17.654 13:51:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:17.654 13:51:57 -- common/autotest_common.sh@10 -- # set +x 00:18:17.654 13:51:57 -- nvmf/common.sh@469 -- # nvmfpid=2299983 00:18:17.654 13:51:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:17.654 13:51:57 -- nvmf/common.sh@470 -- # waitforlisten 2299983 00:18:17.654 13:51:57 -- common/autotest_common.sh@829 -- # '[' -z 2299983 ']' 00:18:17.654 13:51:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.654 13:51:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.654 13:51:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.654 13:51:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.654 13:51:57 -- common/autotest_common.sh@10 -- # set +x 00:18:17.654 [2024-11-29 13:51:57.916457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.654 [2024-11-29 13:51:57.916557] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.915 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.915 [2024-11-29 13:51:57.983089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:17.915 [2024-11-29 13:51:58.070294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:17.915 [2024-11-29 13:51:58.070478] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.915 [2024-11-29 13:51:58.070497] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.915 [2024-11-29 13:51:58.070509] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.915 [2024-11-29 13:51:58.070560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.915 [2024-11-29 13:51:58.070624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:17.915 [2024-11-29 13:51:58.070690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:17.915 [2024-11-29 13:51:58.070692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:17.915 13:51:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.915 13:51:58 -- common/autotest_common.sh@862 -- # return 0 00:18:17.915 13:51:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.915 13:51:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.915 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:17.915 13:51:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.915 13:51:58 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:17.915 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.915 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:17.915 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.915 13:51:58 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:17.915 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.915 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:18.177 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.177 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 [2024-11-29 13:51:58.244475] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:18.177 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.177 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 Malloc0 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:18.177 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.177 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:18.177 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.177 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:18.177 13:51:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.177 13:51:58 -- common/autotest_common.sh@10 -- # set +x 00:18:18.177 [2024-11-29 13:51:58.313972] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.177 13:51:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2300017 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@30 -- # READ_PID=2300020 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # config=() 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.177 13:51:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.177 13:51:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.177 { 00:18:18.177 "params": { 00:18:18.177 "name": "Nvme$subsystem", 00:18:18.177 "trtype": "$TEST_TRANSPORT", 00:18:18.177 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.177 "adrfam": "ipv4", 00:18:18.177 "trsvcid": "$NVMF_PORT", 00:18:18.177 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.177 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.177 "hdgst": ${hdgst:-false}, 00:18:18.177 "ddgst": ${ddgst:-false} 00:18:18.177 }, 00:18:18.177 "method": "bdev_nvme_attach_controller" 00:18:18.177 } 00:18:18.177 EOF 00:18:18.177 )") 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2300022 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # config=() 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.177 13:51:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:18.177 13:51:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.177 { 00:18:18.177 "params": { 00:18:18.177 "name": "Nvme$subsystem", 00:18:18.177 "trtype": "$TEST_TRANSPORT", 00:18:18.177 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.177 "adrfam": "ipv4", 00:18:18.177 "trsvcid": "$NVMF_PORT", 00:18:18.177 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.177 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.177 "hdgst": ${hdgst:-false}, 00:18:18.177 "ddgst": ${ddgst:-false} 00:18:18.177 }, 00:18:18.177 "method": "bdev_nvme_attach_controller" 00:18:18.177 } 00:18:18.177 EOF 00:18:18.177 )") 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2300025 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@35 -- # sync 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # config=() 00:18:18.177 13:51:58 -- nvmf/common.sh@542 -- # cat 00:18:18.177 13:51:58 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.177 13:51:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.177 13:51:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.177 { 00:18:18.177 "params": { 00:18:18.177 "name": "Nvme$subsystem", 00:18:18.177 "trtype": "$TEST_TRANSPORT", 00:18:18.177 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.177 "adrfam": "ipv4", 00:18:18.177 "trsvcid": "$NVMF_PORT", 00:18:18.177 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.177 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.177 "hdgst": ${hdgst:-false}, 00:18:18.177 "ddgst": ${ddgst:-false} 00:18:18.177 }, 00:18:18.177 "method": "bdev_nvme_attach_controller" 00:18:18.177 } 00:18:18.177 EOF 00:18:18.177 )") 00:18:18.177 13:51:58 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:18.178 13:51:58 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:18.178 13:51:58 -- nvmf/common.sh@520 -- # config=() 00:18:18.178 13:51:58 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.178 13:51:58 -- nvmf/common.sh@542 -- # cat 00:18:18.178 13:51:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.178 13:51:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.178 { 00:18:18.178 "params": { 00:18:18.178 "name": "Nvme$subsystem", 00:18:18.178 "trtype": "$TEST_TRANSPORT", 00:18:18.178 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.178 "adrfam": "ipv4", 00:18:18.178 "trsvcid": "$NVMF_PORT", 00:18:18.178 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.178 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.178 "hdgst": ${hdgst:-false}, 00:18:18.178 "ddgst": ${ddgst:-false} 00:18:18.178 }, 00:18:18.178 "method": "bdev_nvme_attach_controller" 00:18:18.178 } 00:18:18.178 EOF 00:18:18.178 )") 00:18:18.178 13:51:58 -- nvmf/common.sh@542 -- # cat 00:18:18.178 13:51:58 -- target/bdev_io_wait.sh@37 -- # wait 2300017 00:18:18.178 13:51:58 -- nvmf/common.sh@542 -- # cat 00:18:18.178 13:51:58 -- nvmf/common.sh@544 -- # jq . 00:18:18.178 13:51:58 -- nvmf/common.sh@544 -- # jq . 00:18:18.178 13:51:58 -- nvmf/common.sh@544 -- # jq . 00:18:18.178 13:51:58 -- nvmf/common.sh@544 -- # jq . 00:18:18.178 13:51:58 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.178 13:51:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.178 "params": { 00:18:18.178 "name": "Nvme1", 00:18:18.178 "trtype": "tcp", 00:18:18.178 "traddr": "10.0.0.2", 00:18:18.178 "adrfam": "ipv4", 00:18:18.178 "trsvcid": "4420", 00:18:18.178 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.178 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.178 "hdgst": false, 00:18:18.178 "ddgst": false 00:18:18.178 }, 00:18:18.178 "method": "bdev_nvme_attach_controller" 00:18:18.178 }' 00:18:18.178 13:51:58 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.178 13:51:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.178 "params": { 00:18:18.178 "name": "Nvme1", 00:18:18.178 "trtype": "tcp", 00:18:18.178 "traddr": "10.0.0.2", 00:18:18.178 "adrfam": "ipv4", 00:18:18.178 "trsvcid": "4420", 00:18:18.178 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.178 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.178 "hdgst": false, 00:18:18.178 "ddgst": false 00:18:18.178 }, 00:18:18.178 "method": "bdev_nvme_attach_controller" 00:18:18.178 }' 00:18:18.178 13:51:58 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.178 13:51:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.178 "params": { 00:18:18.178 "name": "Nvme1", 00:18:18.178 "trtype": "tcp", 00:18:18.178 "traddr": "10.0.0.2", 00:18:18.178 "adrfam": "ipv4", 00:18:18.178 "trsvcid": "4420", 00:18:18.178 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.178 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.178 "hdgst": false, 00:18:18.178 "ddgst": false 00:18:18.178 }, 00:18:18.178 "method": "bdev_nvme_attach_controller" 00:18:18.178 }' 00:18:18.178 13:51:58 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.178 13:51:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.178 "params": { 00:18:18.178 "name": "Nvme1", 00:18:18.178 "trtype": "tcp", 00:18:18.178 "traddr": "10.0.0.2", 00:18:18.178 "adrfam": "ipv4", 00:18:18.178 "trsvcid": "4420", 00:18:18.178 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.178 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.178 "hdgst": false, 00:18:18.178 "ddgst": false 00:18:18.178 }, 00:18:18.178 "method": "bdev_nvme_attach_controller" 00:18:18.178 }' 00:18:18.178 [2024-11-29 13:51:58.358963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.178 [2024-11-29 13:51:58.358976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.178 [2024-11-29 13:51:58.358976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.178 [2024-11-29 13:51:58.358982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.178 [2024-11-29 13:51:58.359044] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:18.178 [2024-11-29 13:51:58.359053] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 13:51:58.359053] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 13:51:58.359053] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:18.178 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:18.178 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:18.178 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.501 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.501 [2024-11-29 13:51:58.549172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.501 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.501 [2024-11-29 13:51:58.620646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:18.501 [2024-11-29 13:51:58.642339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.501 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.501 [2024-11-29 13:51:58.714286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:18.501 [2024-11-29 13:51:58.741110] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.788 [2024-11-29 13:51:58.808249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.788 [2024-11-29 13:51:58.815551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:18.788 [2024-11-29 13:51:58.873859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:18.788 Running I/O for 1 seconds... 00:18:18.788 Running I/O for 1 seconds... 00:18:18.788 Running I/O for 1 seconds... 00:18:18.788 Running I/O for 1 seconds... 00:18:19.723 00:18:19.723 Latency(us) 00:18:19.723 [2024-11-29T12:52:00.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.723 [2024-11-29T12:52:00.005Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:19.723 Nvme1n1 : 1.01 9770.50 38.17 0.00 0.00 13040.25 8398.32 25826.04 00:18:19.723 [2024-11-29T12:52:00.005Z] =================================================================================================================== 00:18:19.723 [2024-11-29T12:52:00.005Z] Total : 9770.50 38.17 0.00 0.00 13040.25 8398.32 25826.04 00:18:19.723 00:18:19.723 Latency(us) 00:18:19.723 [2024-11-29T12:52:00.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.723 [2024-11-29T12:52:00.005Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:19.723 Nvme1n1 : 1.01 6780.54 26.49 0.00 0.00 18815.63 9369.22 27962.03 00:18:19.723 [2024-11-29T12:52:00.005Z] =================================================================================================================== 00:18:19.723 [2024-11-29T12:52:00.005Z] Total : 6780.54 26.49 0.00 0.00 18815.63 9369.22 27962.03 00:18:19.981 00:18:19.981 Latency(us) 00:18:19.981 [2024-11-29T12:52:00.264Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.982 [2024-11-29T12:52:00.264Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:19.982 Nvme1n1 : 1.00 203001.27 792.97 0.00 0.00 628.20 253.35 1049.79 00:18:19.982 [2024-11-29T12:52:00.264Z] =================================================================================================================== 00:18:19.982 [2024-11-29T12:52:00.264Z] Total : 203001.27 792.97 0.00 0.00 628.20 253.35 1049.79 00:18:19.982 00:18:19.982 Latency(us) 00:18:19.982 [2024-11-29T12:52:00.264Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.982 [2024-11-29T12:52:00.264Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:19.982 Nvme1n1 : 1.00 6965.47 27.21 0.00 0.00 18327.25 4538.97 41554.68 00:18:19.982 [2024-11-29T12:52:00.264Z] =================================================================================================================== 00:18:19.982 [2024-11-29T12:52:00.264Z] Total : 6965.47 27.21 0.00 0.00 18327.25 4538.97 41554.68 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@38 -- # wait 2300020 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@39 -- # wait 2300022 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@40 -- # wait 2300025 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:20.241 13:52:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.241 13:52:00 -- common/autotest_common.sh@10 -- # set +x 00:18:20.241 13:52:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:20.241 13:52:00 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:20.241 13:52:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.241 13:52:00 -- nvmf/common.sh@116 -- # sync 00:18:20.241 13:52:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.241 13:52:00 -- nvmf/common.sh@119 -- # set +e 00:18:20.241 13:52:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.241 13:52:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.241 rmmod nvme_tcp 00:18:20.241 rmmod nvme_fabrics 00:18:20.241 rmmod nvme_keyring 00:18:20.241 13:52:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.241 13:52:00 -- nvmf/common.sh@123 -- # set -e 00:18:20.241 13:52:00 -- nvmf/common.sh@124 -- # return 0 00:18:20.241 13:52:00 -- nvmf/common.sh@477 -- # '[' -n 2299983 ']' 00:18:20.241 13:52:00 -- nvmf/common.sh@478 -- # killprocess 2299983 00:18:20.241 13:52:00 -- common/autotest_common.sh@936 -- # '[' -z 2299983 ']' 00:18:20.241 13:52:00 -- common/autotest_common.sh@940 -- # kill -0 2299983 00:18:20.241 13:52:00 -- common/autotest_common.sh@941 -- # uname 00:18:20.241 13:52:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.241 13:52:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2299983 00:18:20.241 13:52:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:20.241 13:52:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:20.241 13:52:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2299983' 00:18:20.241 killing process with pid 2299983 00:18:20.241 13:52:00 -- common/autotest_common.sh@955 -- # kill 2299983 00:18:20.241 13:52:00 -- common/autotest_common.sh@960 -- # wait 2299983 00:18:20.499 13:52:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.499 13:52:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.499 13:52:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.499 13:52:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.499 13:52:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.499 13:52:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.499 13:52:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.499 13:52:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.064 13:52:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.064 00:18:23.064 real 0m7.224s 00:18:23.064 user 0m16.264s 00:18:23.064 sys 0m3.348s 00:18:23.064 13:52:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.064 13:52:02 -- common/autotest_common.sh@10 -- # set +x 00:18:23.064 ************************************ 00:18:23.064 END TEST nvmf_bdev_io_wait 00:18:23.064 ************************************ 00:18:23.064 13:52:02 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:23.064 13:52:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.064 13:52:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.064 13:52:02 -- common/autotest_common.sh@10 -- # set +x 00:18:23.064 ************************************ 00:18:23.064 START TEST nvmf_queue_depth 00:18:23.064 ************************************ 00:18:23.064 13:52:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:23.064 * Looking for test storage... 00:18:23.064 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:23.064 13:52:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.064 13:52:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.064 13:52:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.064 13:52:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.064 13:52:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.064 13:52:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.064 13:52:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.064 13:52:02 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.064 13:52:02 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.064 13:52:02 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.064 13:52:02 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.064 13:52:02 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.064 13:52:02 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.064 13:52:02 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.064 13:52:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.064 13:52:02 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.064 13:52:02 -- scripts/common.sh@344 -- # : 1 00:18:23.064 13:52:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.064 13:52:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.065 13:52:02 -- scripts/common.sh@364 -- # decimal 1 00:18:23.065 13:52:02 -- scripts/common.sh@352 -- # local d=1 00:18:23.065 13:52:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.065 13:52:02 -- scripts/common.sh@354 -- # echo 1 00:18:23.065 13:52:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.065 13:52:02 -- scripts/common.sh@365 -- # decimal 2 00:18:23.065 13:52:02 -- scripts/common.sh@352 -- # local d=2 00:18:23.065 13:52:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.065 13:52:02 -- scripts/common.sh@354 -- # echo 2 00:18:23.065 13:52:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.065 13:52:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.065 13:52:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.065 13:52:02 -- scripts/common.sh@367 -- # return 0 00:18:23.065 13:52:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.065 13:52:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.065 --rc genhtml_branch_coverage=1 00:18:23.065 --rc genhtml_function_coverage=1 00:18:23.065 --rc genhtml_legend=1 00:18:23.065 --rc geninfo_all_blocks=1 00:18:23.065 --rc geninfo_unexecuted_blocks=1 00:18:23.065 00:18:23.065 ' 00:18:23.065 13:52:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.065 --rc genhtml_branch_coverage=1 00:18:23.065 --rc genhtml_function_coverage=1 00:18:23.065 --rc genhtml_legend=1 00:18:23.065 --rc geninfo_all_blocks=1 00:18:23.065 --rc geninfo_unexecuted_blocks=1 00:18:23.065 00:18:23.065 ' 00:18:23.065 13:52:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.065 --rc genhtml_branch_coverage=1 00:18:23.065 --rc genhtml_function_coverage=1 00:18:23.065 --rc genhtml_legend=1 00:18:23.065 --rc geninfo_all_blocks=1 00:18:23.065 --rc geninfo_unexecuted_blocks=1 00:18:23.065 00:18:23.065 ' 00:18:23.065 13:52:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.065 --rc genhtml_branch_coverage=1 00:18:23.065 --rc genhtml_function_coverage=1 00:18:23.065 --rc genhtml_legend=1 00:18:23.065 --rc geninfo_all_blocks=1 00:18:23.065 --rc geninfo_unexecuted_blocks=1 00:18:23.065 00:18:23.065 ' 00:18:23.065 13:52:02 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.065 13:52:02 -- nvmf/common.sh@7 -- # uname -s 00:18:23.065 13:52:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.065 13:52:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.065 13:52:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.065 13:52:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.065 13:52:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.065 13:52:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.065 13:52:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.065 13:52:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.065 13:52:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.065 13:52:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.065 13:52:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.065 13:52:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.065 13:52:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.065 13:52:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.065 13:52:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.065 13:52:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.065 13:52:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.065 13:52:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.065 13:52:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.065 13:52:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.065 13:52:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.065 13:52:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.065 13:52:02 -- paths/export.sh@5 -- # export PATH 00:18:23.065 13:52:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.065 13:52:02 -- nvmf/common.sh@46 -- # : 0 00:18:23.065 13:52:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.065 13:52:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.065 13:52:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.065 13:52:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.065 13:52:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.065 13:52:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.065 13:52:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.065 13:52:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.065 13:52:02 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:23.065 13:52:02 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:23.065 13:52:02 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:23.065 13:52:02 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:23.065 13:52:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.065 13:52:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.065 13:52:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.065 13:52:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.065 13:52:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.065 13:52:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.065 13:52:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.065 13:52:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.065 13:52:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.065 13:52:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.065 13:52:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.065 13:52:02 -- common/autotest_common.sh@10 -- # set +x 00:18:24.973 13:52:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.973 13:52:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:24.973 13:52:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:24.973 13:52:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:24.973 13:52:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:24.973 13:52:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:24.973 13:52:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:24.973 13:52:04 -- nvmf/common.sh@294 -- # net_devs=() 00:18:24.973 13:52:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:24.973 13:52:04 -- nvmf/common.sh@295 -- # e810=() 00:18:24.973 13:52:04 -- nvmf/common.sh@295 -- # local -ga e810 00:18:24.973 13:52:04 -- nvmf/common.sh@296 -- # x722=() 00:18:24.973 13:52:04 -- nvmf/common.sh@296 -- # local -ga x722 00:18:24.973 13:52:04 -- nvmf/common.sh@297 -- # mlx=() 00:18:24.973 13:52:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:24.973 13:52:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.973 13:52:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.974 13:52:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.974 13:52:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.974 13:52:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:24.974 13:52:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:24.974 13:52:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:24.974 13:52:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.974 13:52:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:24.974 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:24.974 13:52:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.974 13:52:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:24.974 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:24.974 13:52:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:24.974 13:52:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.974 13:52:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.974 13:52:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.974 13:52:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.974 13:52:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:24.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:24.974 13:52:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.974 13:52:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.974 13:52:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.974 13:52:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.974 13:52:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.974 13:52:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:24.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:24.974 13:52:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.974 13:52:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:24.974 13:52:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:24.974 13:52:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:24.974 13:52:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:24.974 13:52:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:24.974 13:52:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:24.974 13:52:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:24.975 13:52:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:24.975 13:52:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:24.975 13:52:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:24.975 13:52:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:24.975 13:52:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:24.975 13:52:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:24.975 13:52:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:24.975 13:52:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:24.975 13:52:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:24.975 13:52:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:24.975 13:52:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:24.975 13:52:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:24.975 13:52:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:24.975 13:52:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:24.975 13:52:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:24.975 13:52:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:24.975 13:52:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:24.975 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:24.975 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:18:24.975 00:18:24.975 --- 10.0.0.2 ping statistics --- 00:18:24.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.975 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:18:24.975 13:52:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:24.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:24.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.205 ms 00:18:24.975 00:18:24.975 --- 10.0.0.1 ping statistics --- 00:18:24.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.975 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:18:24.975 13:52:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:24.975 13:52:05 -- nvmf/common.sh@410 -- # return 0 00:18:24.975 13:52:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:24.975 13:52:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:24.975 13:52:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:24.975 13:52:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:24.975 13:52:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:24.975 13:52:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:24.975 13:52:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:24.975 13:52:05 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:24.975 13:52:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:24.975 13:52:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:24.975 13:52:05 -- common/autotest_common.sh@10 -- # set +x 00:18:24.975 13:52:05 -- nvmf/common.sh@469 -- # nvmfpid=2302267 00:18:24.975 13:52:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:24.975 13:52:05 -- nvmf/common.sh@470 -- # waitforlisten 2302267 00:18:24.975 13:52:05 -- common/autotest_common.sh@829 -- # '[' -z 2302267 ']' 00:18:24.975 13:52:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.975 13:52:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.975 13:52:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.976 13:52:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.976 13:52:05 -- common/autotest_common.sh@10 -- # set +x 00:18:24.976 [2024-11-29 13:52:05.158562] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.976 [2024-11-29 13:52:05.158635] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.976 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.976 [2024-11-29 13:52:05.230085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.236 [2024-11-29 13:52:05.325072] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:25.236 [2024-11-29 13:52:05.325231] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.236 [2024-11-29 13:52:05.325250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.236 [2024-11-29 13:52:05.325264] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.236 [2024-11-29 13:52:05.325303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:26.172 13:52:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:26.172 13:52:06 -- common/autotest_common.sh@862 -- # return 0 00:18:26.172 13:52:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:26.172 13:52:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 13:52:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:26.172 13:52:06 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:26.172 13:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 [2024-11-29 13:52:06.178014] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.172 13:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.172 13:52:06 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:26.172 13:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 Malloc0 00:18:26.172 13:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.172 13:52:06 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:26.172 13:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 13:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.172 13:52:06 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:26.172 13:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 13:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.172 13:52:06 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:26.172 13:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 [2024-11-29 13:52:06.243472] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:26.172 13:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.172 13:52:06 -- target/queue_depth.sh@30 -- # bdevperf_pid=2302425 00:18:26.172 13:52:06 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:26.172 13:52:06 -- target/queue_depth.sh@33 -- # waitforlisten 2302425 /var/tmp/bdevperf.sock 00:18:26.172 13:52:06 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:26.172 13:52:06 -- common/autotest_common.sh@829 -- # '[' -z 2302425 ']' 00:18:26.172 13:52:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:26.172 13:52:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.172 13:52:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:26.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:26.172 13:52:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.172 13:52:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.172 [2024-11-29 13:52:06.289464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.172 [2024-11-29 13:52:06.289535] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302425 ] 00:18:26.172 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.172 [2024-11-29 13:52:06.356339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.172 [2024-11-29 13:52:06.442222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:27.112 13:52:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.112 13:52:07 -- common/autotest_common.sh@862 -- # return 0 00:18:27.112 13:52:07 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:27.112 13:52:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.112 13:52:07 -- common/autotest_common.sh@10 -- # set +x 00:18:27.371 NVMe0n1 00:18:27.371 13:52:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.371 13:52:07 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:27.371 Running I/O for 10 seconds... 00:18:39.611 00:18:39.611 Latency(us) 00:18:39.611 [2024-11-29T12:52:19.893Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.611 [2024-11-29T12:52:19.893Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:39.611 Verification LBA range: start 0x0 length 0x4000 00:18:39.611 NVMe0n1 : 10.07 12023.15 46.97 0.00 0.00 84819.75 15049.01 64468.01 00:18:39.611 [2024-11-29T12:52:19.893Z] =================================================================================================================== 00:18:39.611 [2024-11-29T12:52:19.893Z] Total : 12023.15 46.97 0.00 0.00 84819.75 15049.01 64468.01 00:18:39.611 0 00:18:39.611 13:52:17 -- target/queue_depth.sh@39 -- # killprocess 2302425 00:18:39.611 13:52:17 -- common/autotest_common.sh@936 -- # '[' -z 2302425 ']' 00:18:39.611 13:52:17 -- common/autotest_common.sh@940 -- # kill -0 2302425 00:18:39.611 13:52:17 -- common/autotest_common.sh@941 -- # uname 00:18:39.611 13:52:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.611 13:52:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2302425 00:18:39.611 13:52:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:39.611 13:52:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:39.611 13:52:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2302425' 00:18:39.611 killing process with pid 2302425 00:18:39.611 13:52:17 -- common/autotest_common.sh@955 -- # kill 2302425 00:18:39.611 Received shutdown signal, test time was about 10.000000 seconds 00:18:39.611 00:18:39.611 Latency(us) 00:18:39.611 [2024-11-29T12:52:19.893Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.611 [2024-11-29T12:52:19.893Z] =================================================================================================================== 00:18:39.611 [2024-11-29T12:52:19.893Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:39.611 13:52:17 -- common/autotest_common.sh@960 -- # wait 2302425 00:18:39.611 13:52:18 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:39.611 13:52:18 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:39.611 13:52:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:39.611 13:52:18 -- nvmf/common.sh@116 -- # sync 00:18:39.611 13:52:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:39.611 13:52:18 -- nvmf/common.sh@119 -- # set +e 00:18:39.611 13:52:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:39.611 13:52:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:39.611 rmmod nvme_tcp 00:18:39.611 rmmod nvme_fabrics 00:18:39.611 rmmod nvme_keyring 00:18:39.611 13:52:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:39.611 13:52:18 -- nvmf/common.sh@123 -- # set -e 00:18:39.611 13:52:18 -- nvmf/common.sh@124 -- # return 0 00:18:39.611 13:52:18 -- nvmf/common.sh@477 -- # '[' -n 2302267 ']' 00:18:39.611 13:52:18 -- nvmf/common.sh@478 -- # killprocess 2302267 00:18:39.611 13:52:18 -- common/autotest_common.sh@936 -- # '[' -z 2302267 ']' 00:18:39.611 13:52:18 -- common/autotest_common.sh@940 -- # kill -0 2302267 00:18:39.611 13:52:18 -- common/autotest_common.sh@941 -- # uname 00:18:39.611 13:52:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.611 13:52:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2302267 00:18:39.611 13:52:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:39.611 13:52:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:39.611 13:52:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2302267' 00:18:39.611 killing process with pid 2302267 00:18:39.611 13:52:18 -- common/autotest_common.sh@955 -- # kill 2302267 00:18:39.611 13:52:18 -- common/autotest_common.sh@960 -- # wait 2302267 00:18:39.611 13:52:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:39.611 13:52:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:39.611 13:52:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:39.611 13:52:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:39.611 13:52:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:39.611 13:52:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.611 13:52:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.611 13:52:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.179 13:52:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:40.179 00:18:40.179 real 0m17.632s 00:18:40.179 user 0m25.212s 00:18:40.179 sys 0m3.267s 00:18:40.179 13:52:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:40.179 13:52:20 -- common/autotest_common.sh@10 -- # set +x 00:18:40.179 ************************************ 00:18:40.179 END TEST nvmf_queue_depth 00:18:40.179 ************************************ 00:18:40.179 13:52:20 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.179 13:52:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:40.179 13:52:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:40.179 13:52:20 -- common/autotest_common.sh@10 -- # set +x 00:18:40.179 ************************************ 00:18:40.179 START TEST nvmf_multipath 00:18:40.179 ************************************ 00:18:40.179 13:52:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.439 * Looking for test storage... 00:18:40.439 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:40.439 13:52:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:40.439 13:52:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:40.439 13:52:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:40.439 13:52:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:40.439 13:52:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:40.439 13:52:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:40.439 13:52:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:40.439 13:52:20 -- scripts/common.sh@335 -- # IFS=.-: 00:18:40.439 13:52:20 -- scripts/common.sh@335 -- # read -ra ver1 00:18:40.439 13:52:20 -- scripts/common.sh@336 -- # IFS=.-: 00:18:40.439 13:52:20 -- scripts/common.sh@336 -- # read -ra ver2 00:18:40.439 13:52:20 -- scripts/common.sh@337 -- # local 'op=<' 00:18:40.439 13:52:20 -- scripts/common.sh@339 -- # ver1_l=2 00:18:40.439 13:52:20 -- scripts/common.sh@340 -- # ver2_l=1 00:18:40.439 13:52:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:40.439 13:52:20 -- scripts/common.sh@343 -- # case "$op" in 00:18:40.439 13:52:20 -- scripts/common.sh@344 -- # : 1 00:18:40.439 13:52:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:40.439 13:52:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:40.439 13:52:20 -- scripts/common.sh@364 -- # decimal 1 00:18:40.439 13:52:20 -- scripts/common.sh@352 -- # local d=1 00:18:40.439 13:52:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:40.439 13:52:20 -- scripts/common.sh@354 -- # echo 1 00:18:40.439 13:52:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:40.439 13:52:20 -- scripts/common.sh@365 -- # decimal 2 00:18:40.439 13:52:20 -- scripts/common.sh@352 -- # local d=2 00:18:40.439 13:52:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:40.439 13:52:20 -- scripts/common.sh@354 -- # echo 2 00:18:40.439 13:52:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:40.439 13:52:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:40.439 13:52:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:40.439 13:52:20 -- scripts/common.sh@367 -- # return 0 00:18:40.439 13:52:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:40.439 13:52:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:40.439 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.439 --rc genhtml_branch_coverage=1 00:18:40.439 --rc genhtml_function_coverage=1 00:18:40.439 --rc genhtml_legend=1 00:18:40.439 --rc geninfo_all_blocks=1 00:18:40.439 --rc geninfo_unexecuted_blocks=1 00:18:40.439 00:18:40.439 ' 00:18:40.439 13:52:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:40.439 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.439 --rc genhtml_branch_coverage=1 00:18:40.439 --rc genhtml_function_coverage=1 00:18:40.439 --rc genhtml_legend=1 00:18:40.439 --rc geninfo_all_blocks=1 00:18:40.439 --rc geninfo_unexecuted_blocks=1 00:18:40.439 00:18:40.439 ' 00:18:40.439 13:52:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:40.439 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.439 --rc genhtml_branch_coverage=1 00:18:40.439 --rc genhtml_function_coverage=1 00:18:40.439 --rc genhtml_legend=1 00:18:40.439 --rc geninfo_all_blocks=1 00:18:40.439 --rc geninfo_unexecuted_blocks=1 00:18:40.439 00:18:40.439 ' 00:18:40.439 13:52:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:40.439 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.439 --rc genhtml_branch_coverage=1 00:18:40.439 --rc genhtml_function_coverage=1 00:18:40.439 --rc genhtml_legend=1 00:18:40.439 --rc geninfo_all_blocks=1 00:18:40.439 --rc geninfo_unexecuted_blocks=1 00:18:40.439 00:18:40.439 ' 00:18:40.439 13:52:20 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.439 13:52:20 -- nvmf/common.sh@7 -- # uname -s 00:18:40.439 13:52:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.439 13:52:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.439 13:52:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.439 13:52:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.439 13:52:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.439 13:52:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.439 13:52:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.439 13:52:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.439 13:52:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.439 13:52:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.439 13:52:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.439 13:52:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.439 13:52:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.439 13:52:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.439 13:52:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.439 13:52:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:40.439 13:52:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.439 13:52:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.439 13:52:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.439 13:52:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.439 13:52:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.439 13:52:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.439 13:52:20 -- paths/export.sh@5 -- # export PATH 00:18:40.439 13:52:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.439 13:52:20 -- nvmf/common.sh@46 -- # : 0 00:18:40.439 13:52:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:40.439 13:52:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:40.439 13:52:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:40.439 13:52:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.439 13:52:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.439 13:52:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:40.439 13:52:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:40.439 13:52:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:40.439 13:52:20 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:40.439 13:52:20 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:40.439 13:52:20 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:40.439 13:52:20 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.439 13:52:20 -- target/multipath.sh@43 -- # nvmftestinit 00:18:40.439 13:52:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:40.439 13:52:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.439 13:52:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:40.439 13:52:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:40.439 13:52:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:40.439 13:52:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.439 13:52:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.439 13:52:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.439 13:52:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:40.439 13:52:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:40.439 13:52:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:40.439 13:52:20 -- common/autotest_common.sh@10 -- # set +x 00:18:42.341 13:52:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:42.341 13:52:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:42.341 13:52:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:42.341 13:52:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:42.341 13:52:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:42.341 13:52:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:42.341 13:52:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:42.341 13:52:22 -- nvmf/common.sh@294 -- # net_devs=() 00:18:42.341 13:52:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:42.341 13:52:22 -- nvmf/common.sh@295 -- # e810=() 00:18:42.341 13:52:22 -- nvmf/common.sh@295 -- # local -ga e810 00:18:42.341 13:52:22 -- nvmf/common.sh@296 -- # x722=() 00:18:42.341 13:52:22 -- nvmf/common.sh@296 -- # local -ga x722 00:18:42.341 13:52:22 -- nvmf/common.sh@297 -- # mlx=() 00:18:42.341 13:52:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:42.341 13:52:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:42.341 13:52:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:42.341 13:52:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:42.341 13:52:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.341 13:52:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:42.341 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:42.341 13:52:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.341 13:52:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:42.341 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:42.341 13:52:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.341 13:52:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.341 13:52:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.341 13:52:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:42.341 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:42.341 13:52:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.341 13:52:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.341 13:52:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.341 13:52:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.341 13:52:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:42.341 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:42.341 13:52:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.341 13:52:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:42.341 13:52:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:42.341 13:52:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:42.341 13:52:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:42.341 13:52:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:42.341 13:52:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:42.341 13:52:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:42.341 13:52:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:42.341 13:52:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:42.342 13:52:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:42.342 13:52:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:42.342 13:52:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:42.342 13:52:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:42.342 13:52:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:42.342 13:52:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:42.342 13:52:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:42.342 13:52:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:42.342 13:52:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:42.342 13:52:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:42.601 13:52:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:42.601 13:52:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:42.601 13:52:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:42.601 13:52:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:42.601 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:42.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:18:42.601 00:18:42.601 --- 10.0.0.2 ping statistics --- 00:18:42.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.601 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:18:42.601 13:52:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:42.601 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:42.601 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:18:42.601 00:18:42.601 --- 10.0.0.1 ping statistics --- 00:18:42.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.601 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:18:42.601 13:52:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:42.601 13:52:22 -- nvmf/common.sh@410 -- # return 0 00:18:42.601 13:52:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:42.601 13:52:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:42.601 13:52:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:42.601 13:52:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:42.601 13:52:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:42.601 13:52:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:42.601 13:52:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:42.601 13:52:22 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:42.601 13:52:22 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:42.601 only one NIC for nvmf test 00:18:42.601 13:52:22 -- target/multipath.sh@47 -- # nvmftestfini 00:18:42.601 13:52:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:42.601 13:52:22 -- nvmf/common.sh@116 -- # sync 00:18:42.601 13:52:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:42.601 13:52:22 -- nvmf/common.sh@119 -- # set +e 00:18:42.601 13:52:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:42.601 13:52:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:42.601 rmmod nvme_tcp 00:18:42.601 rmmod nvme_fabrics 00:18:42.601 rmmod nvme_keyring 00:18:42.601 13:52:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:42.601 13:52:22 -- nvmf/common.sh@123 -- # set -e 00:18:42.601 13:52:22 -- nvmf/common.sh@124 -- # return 0 00:18:42.601 13:52:22 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:42.601 13:52:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:42.601 13:52:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:42.601 13:52:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:42.601 13:52:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:42.601 13:52:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:42.601 13:52:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.601 13:52:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.601 13:52:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.143 13:52:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.143 13:52:24 -- target/multipath.sh@48 -- # exit 0 00:18:45.143 13:52:24 -- target/multipath.sh@1 -- # nvmftestfini 00:18:45.143 13:52:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:45.143 13:52:24 -- nvmf/common.sh@116 -- # sync 00:18:45.143 13:52:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:45.143 13:52:24 -- nvmf/common.sh@119 -- # set +e 00:18:45.143 13:52:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:45.143 13:52:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:45.143 13:52:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:45.143 13:52:24 -- nvmf/common.sh@123 -- # set -e 00:18:45.143 13:52:24 -- nvmf/common.sh@124 -- # return 0 00:18:45.143 13:52:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:45.143 13:52:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:45.143 13:52:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:45.143 13:52:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:45.143 13:52:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:45.143 13:52:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:45.143 13:52:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.143 13:52:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.143 13:52:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.143 13:52:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.143 00:18:45.143 real 0m4.472s 00:18:45.143 user 0m0.887s 00:18:45.143 sys 0m1.499s 00:18:45.143 13:52:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:45.143 13:52:24 -- common/autotest_common.sh@10 -- # set +x 00:18:45.143 ************************************ 00:18:45.143 END TEST nvmf_multipath 00:18:45.143 ************************************ 00:18:45.143 13:52:24 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:45.143 13:52:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.143 13:52:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.143 13:52:24 -- common/autotest_common.sh@10 -- # set +x 00:18:45.143 ************************************ 00:18:45.143 START TEST nvmf_zcopy 00:18:45.143 ************************************ 00:18:45.143 13:52:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:45.143 * Looking for test storage... 00:18:45.143 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:45.143 13:52:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:45.143 13:52:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:45.143 13:52:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:45.143 13:52:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:45.143 13:52:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:45.143 13:52:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:45.143 13:52:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:45.143 13:52:25 -- scripts/common.sh@335 -- # IFS=.-: 00:18:45.143 13:52:25 -- scripts/common.sh@335 -- # read -ra ver1 00:18:45.143 13:52:25 -- scripts/common.sh@336 -- # IFS=.-: 00:18:45.143 13:52:25 -- scripts/common.sh@336 -- # read -ra ver2 00:18:45.143 13:52:25 -- scripts/common.sh@337 -- # local 'op=<' 00:18:45.143 13:52:25 -- scripts/common.sh@339 -- # ver1_l=2 00:18:45.143 13:52:25 -- scripts/common.sh@340 -- # ver2_l=1 00:18:45.143 13:52:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:45.143 13:52:25 -- scripts/common.sh@343 -- # case "$op" in 00:18:45.143 13:52:25 -- scripts/common.sh@344 -- # : 1 00:18:45.143 13:52:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:45.143 13:52:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:45.143 13:52:25 -- scripts/common.sh@364 -- # decimal 1 00:18:45.143 13:52:25 -- scripts/common.sh@352 -- # local d=1 00:18:45.143 13:52:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:45.143 13:52:25 -- scripts/common.sh@354 -- # echo 1 00:18:45.143 13:52:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:45.143 13:52:25 -- scripts/common.sh@365 -- # decimal 2 00:18:45.143 13:52:25 -- scripts/common.sh@352 -- # local d=2 00:18:45.143 13:52:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:45.143 13:52:25 -- scripts/common.sh@354 -- # echo 2 00:18:45.143 13:52:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:45.143 13:52:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:45.143 13:52:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:45.143 13:52:25 -- scripts/common.sh@367 -- # return 0 00:18:45.143 13:52:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:45.143 13:52:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:45.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.143 --rc genhtml_branch_coverage=1 00:18:45.143 --rc genhtml_function_coverage=1 00:18:45.143 --rc genhtml_legend=1 00:18:45.143 --rc geninfo_all_blocks=1 00:18:45.143 --rc geninfo_unexecuted_blocks=1 00:18:45.143 00:18:45.143 ' 00:18:45.143 13:52:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:45.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.143 --rc genhtml_branch_coverage=1 00:18:45.143 --rc genhtml_function_coverage=1 00:18:45.143 --rc genhtml_legend=1 00:18:45.143 --rc geninfo_all_blocks=1 00:18:45.143 --rc geninfo_unexecuted_blocks=1 00:18:45.143 00:18:45.143 ' 00:18:45.143 13:52:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:45.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.143 --rc genhtml_branch_coverage=1 00:18:45.143 --rc genhtml_function_coverage=1 00:18:45.143 --rc genhtml_legend=1 00:18:45.143 --rc geninfo_all_blocks=1 00:18:45.143 --rc geninfo_unexecuted_blocks=1 00:18:45.143 00:18:45.143 ' 00:18:45.143 13:52:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:45.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.143 --rc genhtml_branch_coverage=1 00:18:45.143 --rc genhtml_function_coverage=1 00:18:45.143 --rc genhtml_legend=1 00:18:45.143 --rc geninfo_all_blocks=1 00:18:45.143 --rc geninfo_unexecuted_blocks=1 00:18:45.143 00:18:45.143 ' 00:18:45.143 13:52:25 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.143 13:52:25 -- nvmf/common.sh@7 -- # uname -s 00:18:45.143 13:52:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.143 13:52:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.143 13:52:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.143 13:52:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.143 13:52:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.143 13:52:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.144 13:52:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.144 13:52:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.144 13:52:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.144 13:52:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.144 13:52:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.144 13:52:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.144 13:52:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.144 13:52:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.144 13:52:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.144 13:52:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:45.144 13:52:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.144 13:52:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.144 13:52:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.144 13:52:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.144 13:52:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.144 13:52:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.144 13:52:25 -- paths/export.sh@5 -- # export PATH 00:18:45.144 13:52:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.144 13:52:25 -- nvmf/common.sh@46 -- # : 0 00:18:45.144 13:52:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:45.144 13:52:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:45.144 13:52:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:45.144 13:52:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.144 13:52:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.144 13:52:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:45.144 13:52:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:45.144 13:52:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:45.144 13:52:25 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:45.144 13:52:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:45.144 13:52:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.144 13:52:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:45.144 13:52:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:45.144 13:52:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:45.144 13:52:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.144 13:52:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.144 13:52:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.144 13:52:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:45.144 13:52:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:45.144 13:52:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:45.144 13:52:25 -- common/autotest_common.sh@10 -- # set +x 00:18:47.052 13:52:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:47.052 13:52:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:47.052 13:52:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:47.052 13:52:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:47.052 13:52:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:47.052 13:52:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:47.052 13:52:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:47.052 13:52:27 -- nvmf/common.sh@294 -- # net_devs=() 00:18:47.052 13:52:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:47.052 13:52:27 -- nvmf/common.sh@295 -- # e810=() 00:18:47.052 13:52:27 -- nvmf/common.sh@295 -- # local -ga e810 00:18:47.052 13:52:27 -- nvmf/common.sh@296 -- # x722=() 00:18:47.052 13:52:27 -- nvmf/common.sh@296 -- # local -ga x722 00:18:47.052 13:52:27 -- nvmf/common.sh@297 -- # mlx=() 00:18:47.052 13:52:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:47.052 13:52:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:47.052 13:52:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.052 13:52:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:47.052 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:47.052 13:52:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.052 13:52:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:47.052 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:47.052 13:52:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.052 13:52:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.052 13:52:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.052 13:52:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:47.052 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:47.052 13:52:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.052 13:52:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.052 13:52:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.052 13:52:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:47.052 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:47.052 13:52:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:47.052 13:52:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:47.052 13:52:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:47.052 13:52:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:47.052 13:52:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:47.052 13:52:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:47.052 13:52:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:47.052 13:52:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:47.052 13:52:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:47.052 13:52:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:47.052 13:52:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:47.052 13:52:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:47.052 13:52:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:47.052 13:52:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:47.052 13:52:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:47.052 13:52:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:47.052 13:52:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:47.052 13:52:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:47.052 13:52:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:47.052 13:52:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:47.052 13:52:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:47.052 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:47.052 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:18:47.052 00:18:47.052 --- 10.0.0.2 ping statistics --- 00:18:47.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.052 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:18:47.052 13:52:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:47.052 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:47.052 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:18:47.052 00:18:47.052 --- 10.0.0.1 ping statistics --- 00:18:47.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.052 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:18:47.052 13:52:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:47.052 13:52:27 -- nvmf/common.sh@410 -- # return 0 00:18:47.052 13:52:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:47.052 13:52:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:47.052 13:52:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:47.052 13:52:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:47.052 13:52:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:47.052 13:52:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:47.052 13:52:27 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:47.052 13:52:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:47.052 13:52:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:47.052 13:52:27 -- common/autotest_common.sh@10 -- # set +x 00:18:47.052 13:52:27 -- nvmf/common.sh@469 -- # nvmfpid=2307805 00:18:47.052 13:52:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:47.052 13:52:27 -- nvmf/common.sh@470 -- # waitforlisten 2307805 00:18:47.052 13:52:27 -- common/autotest_common.sh@829 -- # '[' -z 2307805 ']' 00:18:47.052 13:52:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:47.052 13:52:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:47.052 13:52:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:47.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:47.052 13:52:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:47.052 13:52:27 -- common/autotest_common.sh@10 -- # set +x 00:18:47.052 [2024-11-29 13:52:27.241948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:47.052 [2024-11-29 13:52:27.242040] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:47.052 EAL: No free 2048 kB hugepages reported on node 1 00:18:47.052 [2024-11-29 13:52:27.317365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:47.311 [2024-11-29 13:52:27.404808] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:47.311 [2024-11-29 13:52:27.404970] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:47.311 [2024-11-29 13:52:27.404988] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:47.311 [2024-11-29 13:52:27.405000] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:47.311 [2024-11-29 13:52:27.405028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:48.247 13:52:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:48.247 13:52:28 -- common/autotest_common.sh@862 -- # return 0 00:18:48.247 13:52:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:48.247 13:52:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:48.247 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.247 13:52:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:48.247 13:52:28 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:48.248 13:52:28 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 [2024-11-29 13:52:28.242060] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 [2024-11-29 13:52:28.258279] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 malloc0 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:48.248 13:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.248 13:52:28 -- common/autotest_common.sh@10 -- # set +x 00:18:48.248 13:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.248 13:52:28 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:48.248 13:52:28 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:48.248 13:52:28 -- nvmf/common.sh@520 -- # config=() 00:18:48.248 13:52:28 -- nvmf/common.sh@520 -- # local subsystem config 00:18:48.248 13:52:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:48.248 13:52:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:48.248 { 00:18:48.248 "params": { 00:18:48.248 "name": "Nvme$subsystem", 00:18:48.248 "trtype": "$TEST_TRANSPORT", 00:18:48.248 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:48.248 "adrfam": "ipv4", 00:18:48.248 "trsvcid": "$NVMF_PORT", 00:18:48.248 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:48.248 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:48.248 "hdgst": ${hdgst:-false}, 00:18:48.248 "ddgst": ${ddgst:-false} 00:18:48.248 }, 00:18:48.248 "method": "bdev_nvme_attach_controller" 00:18:48.248 } 00:18:48.248 EOF 00:18:48.248 )") 00:18:48.248 13:52:28 -- nvmf/common.sh@542 -- # cat 00:18:48.248 13:52:28 -- nvmf/common.sh@544 -- # jq . 00:18:48.248 13:52:28 -- nvmf/common.sh@545 -- # IFS=, 00:18:48.248 13:52:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:48.248 "params": { 00:18:48.248 "name": "Nvme1", 00:18:48.248 "trtype": "tcp", 00:18:48.248 "traddr": "10.0.0.2", 00:18:48.248 "adrfam": "ipv4", 00:18:48.248 "trsvcid": "4420", 00:18:48.248 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:48.248 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:48.248 "hdgst": false, 00:18:48.248 "ddgst": false 00:18:48.248 }, 00:18:48.248 "method": "bdev_nvme_attach_controller" 00:18:48.248 }' 00:18:48.248 [2024-11-29 13:52:28.339583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:48.248 [2024-11-29 13:52:28.339669] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307963 ] 00:18:48.248 EAL: No free 2048 kB hugepages reported on node 1 00:18:48.248 [2024-11-29 13:52:28.409912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:48.248 [2024-11-29 13:52:28.502005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:48.816 Running I/O for 10 seconds... 00:18:58.800 00:18:58.800 Latency(us) 00:18:58.800 [2024-11-29T12:52:39.082Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:58.800 [2024-11-29T12:52:39.082Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:58.800 Verification LBA range: start 0x0 length 0x1000 00:18:58.800 Nvme1n1 : 10.01 8719.71 68.12 0.00 0.00 14644.29 1674.81 23107.51 00:18:58.800 [2024-11-29T12:52:39.082Z] =================================================================================================================== 00:18:58.800 [2024-11-29T12:52:39.082Z] Total : 8719.71 68.12 0.00 0.00 14644.29 1674.81 23107.51 00:18:59.058 13:52:39 -- target/zcopy.sh@39 -- # perfpid=2309193 00:18:59.058 13:52:39 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:59.058 13:52:39 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 13:52:39 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:59.058 13:52:39 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:59.058 13:52:39 -- nvmf/common.sh@520 -- # config=() 00:18:59.058 13:52:39 -- nvmf/common.sh@520 -- # local subsystem config 00:18:59.058 13:52:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:59.058 13:52:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:59.058 { 00:18:59.058 "params": { 00:18:59.058 "name": "Nvme$subsystem", 00:18:59.058 "trtype": "$TEST_TRANSPORT", 00:18:59.058 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:59.058 "adrfam": "ipv4", 00:18:59.058 "trsvcid": "$NVMF_PORT", 00:18:59.058 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:59.058 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:59.058 "hdgst": ${hdgst:-false}, 00:18:59.058 "ddgst": ${ddgst:-false} 00:18:59.058 }, 00:18:59.058 "method": "bdev_nvme_attach_controller" 00:18:59.058 } 00:18:59.058 EOF 00:18:59.058 )") 00:18:59.058 13:52:39 -- nvmf/common.sh@542 -- # cat 00:18:59.058 [2024-11-29 13:52:39.114657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.114705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 13:52:39 -- nvmf/common.sh@544 -- # jq . 00:18:59.058 13:52:39 -- nvmf/common.sh@545 -- # IFS=, 00:18:59.058 13:52:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:59.058 "params": { 00:18:59.058 "name": "Nvme1", 00:18:59.058 "trtype": "tcp", 00:18:59.058 "traddr": "10.0.0.2", 00:18:59.058 "adrfam": "ipv4", 00:18:59.058 "trsvcid": "4420", 00:18:59.058 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:59.058 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:59.058 "hdgst": false, 00:18:59.058 "ddgst": false 00:18:59.058 }, 00:18:59.058 "method": "bdev_nvme_attach_controller" 00:18:59.058 }' 00:18:59.058 [2024-11-29 13:52:39.122618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.122645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.130637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.130663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.138648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.138669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.146685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.146705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.150772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:59.058 [2024-11-29 13:52:39.150846] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2309193 ] 00:18:59.058 [2024-11-29 13:52:39.154712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.154732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.162737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.162756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.170746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.170766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.178784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.178805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.058 [2024-11-29 13:52:39.186807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.186832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.194827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.194852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.202850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.202875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.210873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.210898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.215215] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.058 [2024-11-29 13:52:39.218898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.218925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.226963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.227003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.234941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.234967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.242963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.242988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.250983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.251008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.259004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.259029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.267044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.267076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.275079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.275117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.283077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.283102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.291096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.058 [2024-11-29 13:52:39.291121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.058 [2024-11-29 13:52:39.299119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.059 [2024-11-29 13:52:39.299144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.059 [2024-11-29 13:52:39.306731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.059 [2024-11-29 13:52:39.307145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.059 [2024-11-29 13:52:39.307171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.059 [2024-11-29 13:52:39.315164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.059 [2024-11-29 13:52:39.315189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.059 [2024-11-29 13:52:39.323225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.059 [2024-11-29 13:52:39.323261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.059 [2024-11-29 13:52:39.331242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.059 [2024-11-29 13:52:39.331281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.339261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.339301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.347287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.347329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.355305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.355343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.363327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.363378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.371344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.371383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.379343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.379368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.387384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.387429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.395420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.395474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.403424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.403467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.411449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.411471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.419492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.419532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.427502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.427527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.435532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.435554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.443523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.443547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.451556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.451580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.459588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.459610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.467611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.467632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.475633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.475655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.483659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.483696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.491680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.491717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.499715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.499743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.507737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.507763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.515757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.515791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.523774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.523798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.531799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.531824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.539828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.539853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.547847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.547874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.555871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.555896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.563896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.563921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.571919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.571942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.579941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.579965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.587964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.587989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.317 [2024-11-29 13:52:39.595990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.317 [2024-11-29 13:52:39.596015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.604016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.604046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 Running I/O for 5 seconds... 00:18:59.577 [2024-11-29 13:52:39.612033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.612057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.624840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.624873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.635280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.635312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.647409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.647454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.658705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.658735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.670206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.670236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.683404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.683448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.694112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.694143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.705339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.705369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.718064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.718094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.728459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.728486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.740031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.740061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.751093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.751124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.764576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.764603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.775236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.775267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.577 [2024-11-29 13:52:39.786253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.577 [2024-11-29 13:52:39.786282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.799170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.799199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.810169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.810198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.821602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.821629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.834543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.834570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.845014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.845044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.578 [2024-11-29 13:52:39.855812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.578 [2024-11-29 13:52:39.855842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.868322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.868353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.878343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.878374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.889346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.889377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.902252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.902282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.912710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.912740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.923654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.923699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.936820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.936851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.946864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.946894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.957421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.957463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.970260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.970290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.980567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.980594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:39.990994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:39.991024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.002322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.002353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.014093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.014126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.027746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.027786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.043962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.044025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.056460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.056489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.067409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.067455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.078606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.078633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.091574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.091601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.102775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.102804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.838 [2024-11-29 13:52:40.113737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.838 [2024-11-29 13:52:40.113767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.126840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.126871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.136851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.136882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.148193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.148223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.158869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.158900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.170126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.170156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.182975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.183005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.193818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.193849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.204946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.204976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.217900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.217930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.228069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.228099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.239241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.239271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.249827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.249857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.260889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.260920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.097 [2024-11-29 13:52:40.271866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.097 [2024-11-29 13:52:40.271896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.282743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.282773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.295496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.295523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.305344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.305374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.316199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.316230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.327720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.327750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.338933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.338963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.351663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.351709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.361711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.361741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.098 [2024-11-29 13:52:40.372515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.098 [2024-11-29 13:52:40.372543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.384061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.384091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.395349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.395383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.406338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.406368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.419545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.419572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.430370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.430416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.441457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.441485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.454366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.454423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.464374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.464421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.475410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.475455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.486521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.486548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.497897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.497928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.509151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.509180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.520248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.520279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.531583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.531610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.544159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.544190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.554023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.554061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.565117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.565146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.577892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.577922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.587103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.587132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.598713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.598744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.611873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.611903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.622348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.622388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.356 [2024-11-29 13:52:40.633414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.356 [2024-11-29 13:52:40.633460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.646295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.646326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.656538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.656565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.667830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.667861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.681143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.681173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.691517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.691544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.702596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.702623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.715757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.715788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.726518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.726546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.616 [2024-11-29 13:52:40.737594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.616 [2024-11-29 13:52:40.737621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.748585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.748613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.760125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.760156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.771407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.771461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.782369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.782408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.793078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.793108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.805944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.805974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.816558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.816586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.827871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.827901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.841098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.841129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.851757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.851787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.862262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.862291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.873152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.873182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.886087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.886117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.617 [2024-11-29 13:52:40.896252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.617 [2024-11-29 13:52:40.896283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.907285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.907316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.920322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.920352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.931111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.931141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.942259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.942289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.955187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.955217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.965179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.965209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.976934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.976964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.988194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.988233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:40.999176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:40.999207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.009883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.009913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.020801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.020831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.033470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.033498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.043294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.043323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.054175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.054205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.067290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.067321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.077522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.077549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.087824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.087855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.098776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.098807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.109684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.109715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.122129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.122159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.131640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.131685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.143205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.143236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.877 [2024-11-29 13:52:41.155768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.877 [2024-11-29 13:52:41.155799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.165400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.165431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.176648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.176690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.187543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.187570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.198639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.198697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.209778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.209809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.220472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.220499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.231691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.231722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.242858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.242888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.255870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.137 [2024-11-29 13:52:41.255900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.137 [2024-11-29 13:52:41.265208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.265238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.276604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.276631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.287449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.287476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.298337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.298367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.311050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.311080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.320684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.320714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.332811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.332842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.343714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.343744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.354963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.354992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.367718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.367749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.378007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.378037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.388905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.388935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.399631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.399658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.138 [2024-11-29 13:52:41.410543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.138 [2024-11-29 13:52:41.410570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.421460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.421488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.432403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.432432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.445263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.445293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.454848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.454877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.466448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.466476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.479498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.479526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.489947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.489977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.500848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.500879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.511806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.511836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.522830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.522860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.535585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.535612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.544782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.544812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.558123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.558155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.568568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.568596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.579306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.579336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.590059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.590089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.601038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.601068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.613863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.613894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.623899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.623929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.635281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.635311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.646391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.646444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.657246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.657276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.398 [2024-11-29 13:52:41.668622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.398 [2024-11-29 13:52:41.668649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.657 [2024-11-29 13:52:41.681601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.681630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.692270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.692299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.703264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.703294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.716248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.716279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.726856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.726887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.737694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.737724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.750700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.750731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.760805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.760835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.772129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.772159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.785144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.785174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.795518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.795546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.806522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.806549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.819159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.819189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.828662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.828718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.839976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.840006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.853078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.853109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.863289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.863318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.874163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.874193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.885198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.885228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.896069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.896099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.908760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.908791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.918566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.918594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.658 [2024-11-29 13:52:41.929915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.658 [2024-11-29 13:52:41.929945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.940360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.940391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.951363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.951401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.963635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.963662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.972727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.972757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.984736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.984766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:41.997281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:41.997311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.007711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.007741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.018759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.018789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.029859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.029888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.040755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.040785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.053717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.053747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.064216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.064246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.075570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.075600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.088577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.088608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.099033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.099062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.110256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.110285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.123026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.123057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.133282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.133312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.144278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.144308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.155617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.155647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.166596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.166626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.179579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.179609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.916 [2024-11-29 13:52:42.189762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.916 [2024-11-29 13:52:42.189792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.201160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.201191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.212352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.212382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.223411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.223451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.234220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.234250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.246784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.246814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.256722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.256760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.267022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.267052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.278040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.278070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.288966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.288995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.301381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.301420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.311147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.311178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.322861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.322890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.333408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.333438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.344318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.344348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.356487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.356517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.365993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.366023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.379378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.379419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.389976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.390006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.400984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.401014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.413687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.413716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.424285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.424315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.435096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.435125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.176 [2024-11-29 13:52:42.447919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.176 [2024-11-29 13:52:42.447948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.457663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.457693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.468817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.468855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.481685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.481715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.491922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.491952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.502787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.502817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.513800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.513830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.524408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.524438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.537115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.537146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.547054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.547085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.558147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.558177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.568628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.568658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.579478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.579508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.592687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.592717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.602812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.602841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.613649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.613679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.624347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.624378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.635200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.635231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.647558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.647589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.657725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.657756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.668773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.668803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.681732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.681771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.691832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.691861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.702460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.702491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.435 [2024-11-29 13:52:42.715172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.435 [2024-11-29 13:52:42.715202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.725002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.725031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.735772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.735802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.748614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.748644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.759349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.759378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.770448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.770477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.783734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.783764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.794272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.794302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.804771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.804802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.815887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.815917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.828753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.828783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.839104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.839133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.850311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.850341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.861291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.861321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.872350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.872380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.885063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.885094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.895296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.694 [2024-11-29 13:52:42.895335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.694 [2024-11-29 13:52:42.906175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.906205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.695 [2024-11-29 13:52:42.917459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.917489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.695 [2024-11-29 13:52:42.928806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.928837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.695 [2024-11-29 13:52:42.941946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.941976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.695 [2024-11-29 13:52:42.952671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.952701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.695 [2024-11-29 13:52:42.963764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.695 [2024-11-29 13:52:42.963794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:42.976677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:42.976707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:42.987197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:42.987228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:42.997786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:42.997816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.010830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.010860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.021179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.021210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.032211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.032241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.043304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.043335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.054451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.054482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.067563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.067594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.077831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.077861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.088731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.088761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.101883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.101913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.112358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.112387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.123536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.123566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.136136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.136166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.145987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.146016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.157276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.157306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.170136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.170165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.179659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.179688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.191692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.191722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.202641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.202671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.213489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.213519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.953 [2024-11-29 13:52:43.223745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.953 [2024-11-29 13:52:43.223775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.211 [2024-11-29 13:52:43.234508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.211 [2024-11-29 13:52:43.234539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.211 [2024-11-29 13:52:43.245767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.211 [2024-11-29 13:52:43.245797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.211 [2024-11-29 13:52:43.256349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.211 [2024-11-29 13:52:43.256379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.211 [2024-11-29 13:52:43.267312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.211 [2024-11-29 13:52:43.267342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.211 [2024-11-29 13:52:43.278608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.278638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.291333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.291364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.301388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.301430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.311868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.311898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.322374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.322413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.333647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.333676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.346478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.346509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.357631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.357661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.368005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.368034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.378808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.378838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.389767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.389796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.401795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.401824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.411063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.411093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.422428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.422457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.433441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.433471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.444325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.444355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.457078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.457108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.467151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.467180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.478475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.478505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.212 [2024-11-29 13:52:43.491404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.212 [2024-11-29 13:52:43.491434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.501792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.501822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.512920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.512950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.525584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.525614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.535801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.535831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.546729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.546758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.559632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.559662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.569628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.569658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.580366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.580407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.593122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.593152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.603439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.603469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.614881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.614911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.625972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.626001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.636629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.636659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.647680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.647710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.660384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.470 [2024-11-29 13:52:43.660423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.470 [2024-11-29 13:52:43.669896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.669925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.681037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.681067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.691603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.691633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.702345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.702374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.714970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.715000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.725144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.725174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.736506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.736537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.471 [2024-11-29 13:52:43.747485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.471 [2024-11-29 13:52:43.747515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.758862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.758893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.769689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.769723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.780615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.780645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.792443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.792473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.803728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.803758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.817097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.817127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.827910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.827941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.839295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.839325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.850654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.850684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.861851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.861882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.874534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.874566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.884412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.884444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.895425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.895467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.908062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.908092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.918532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.918562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.929638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.929668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.940720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.940750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.952260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.952300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.963194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.963224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.975962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.975992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.986272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.986301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:43.998055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:43.998085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.731 [2024-11-29 13:52:44.008898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.731 [2024-11-29 13:52:44.008928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.019825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.019856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.030572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.030603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.041227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.041258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.051984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.052014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.064721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.064751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.074789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.074820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.085632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.085662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.096609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.096640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.107741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.107771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.120495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.120525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.131046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.131077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.142434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.142464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.155319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.155349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.165761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.165801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.176790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.176820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.189719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.189749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.200528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.200558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.211177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.211206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.224208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.224238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.234502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.234532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.245322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.245352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.258290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.258320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.992 [2024-11-29 13:52:44.269966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.992 [2024-11-29 13:52:44.269997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.278778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.278808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.290828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.290858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.303773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.303803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.314510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.314540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.325465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.325495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.338109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.338140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.347823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.347852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.358875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.358905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.371797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.371827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.381806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.381847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.392289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.392318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.402768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.402798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.413614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.413644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.426132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.426162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.435493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.435523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.449181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.449211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.459752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.459783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.470477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.470507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.481401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.481432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.491836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.491866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.502525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.502555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.513303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.513334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.253 [2024-11-29 13:52:44.526037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.253 [2024-11-29 13:52:44.526067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.535994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.536026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.550887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.550919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.560960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.560991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.571517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.571552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.582425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.582466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.593522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.593563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.604424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.604454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.615553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.615583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.626880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.626909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.633265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.633293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 00:19:04.514 Latency(us) 00:19:04.514 [2024-11-29T12:52:44.796Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:04.514 [2024-11-29T12:52:44.796Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:04.514 Nvme1n1 : 5.01 11580.28 90.47 0.00 0.00 11039.06 4927.34 21165.70 00:19:04.514 [2024-11-29T12:52:44.796Z] =================================================================================================================== 00:19:04.514 [2024-11-29T12:52:44.796Z] Total : 11580.28 90.47 0.00 0.00 11039.06 4927.34 21165.70 00:19:04.514 [2024-11-29 13:52:44.641284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.641312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.649341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.649369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.657419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.657466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.665442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.665495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.673459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.673509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.681481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.681531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.689506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.689558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.697528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.697581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.705549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.705598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.713566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.713616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.721591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.721641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.729618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.729671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.737641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.737692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.745664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.745717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.753673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.753723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.514 [2024-11-29 13:52:44.761697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.514 [2024-11-29 13:52:44.761748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.515 [2024-11-29 13:52:44.769723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.515 [2024-11-29 13:52:44.769774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.515 [2024-11-29 13:52:44.777732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.515 [2024-11-29 13:52:44.777779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.515 [2024-11-29 13:52:44.785726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.515 [2024-11-29 13:52:44.785753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.515 [2024-11-29 13:52:44.793753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.515 [2024-11-29 13:52:44.793784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.772 [2024-11-29 13:52:44.801811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.801859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.809840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.809883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.817831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.817871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.825829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.825854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.833891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.833936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.841923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.841970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.849918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.849954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.857916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.857941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 [2024-11-29 13:52:44.865937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.773 [2024-11-29 13:52:44.865961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.773 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2309193) - No such process 00:19:04.773 13:52:44 -- target/zcopy.sh@49 -- # wait 2309193 00:19:04.773 13:52:44 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:04.773 13:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.773 13:52:44 -- common/autotest_common.sh@10 -- # set +x 00:19:04.773 13:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.773 13:52:44 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:04.773 13:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.773 13:52:44 -- common/autotest_common.sh@10 -- # set +x 00:19:04.773 delay0 00:19:04.773 13:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.773 13:52:44 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:04.773 13:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.773 13:52:44 -- common/autotest_common.sh@10 -- # set +x 00:19:04.773 13:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.773 13:52:44 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:04.773 EAL: No free 2048 kB hugepages reported on node 1 00:19:04.773 [2024-11-29 13:52:44.984311] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:12.976 Initializing NVMe Controllers 00:19:12.976 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:12.976 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:12.976 Initialization complete. Launching workers. 00:19:12.976 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 261, failed: 16180 00:19:12.976 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 16356, failed to submit 85 00:19:12.976 success 16231, unsuccess 125, failed 0 00:19:12.976 13:52:52 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:12.976 13:52:52 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:12.976 13:52:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:12.976 13:52:52 -- nvmf/common.sh@116 -- # sync 00:19:12.976 13:52:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:12.976 13:52:52 -- nvmf/common.sh@119 -- # set +e 00:19:12.976 13:52:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:12.976 13:52:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:12.976 rmmod nvme_tcp 00:19:12.976 rmmod nvme_fabrics 00:19:12.976 rmmod nvme_keyring 00:19:12.976 13:52:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:12.976 13:52:52 -- nvmf/common.sh@123 -- # set -e 00:19:12.976 13:52:52 -- nvmf/common.sh@124 -- # return 0 00:19:12.976 13:52:52 -- nvmf/common.sh@477 -- # '[' -n 2307805 ']' 00:19:12.976 13:52:52 -- nvmf/common.sh@478 -- # killprocess 2307805 00:19:12.976 13:52:52 -- common/autotest_common.sh@936 -- # '[' -z 2307805 ']' 00:19:12.976 13:52:52 -- common/autotest_common.sh@940 -- # kill -0 2307805 00:19:12.976 13:52:52 -- common/autotest_common.sh@941 -- # uname 00:19:12.976 13:52:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:12.976 13:52:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2307805 00:19:12.976 13:52:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:12.976 13:52:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:12.976 13:52:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2307805' 00:19:12.976 killing process with pid 2307805 00:19:12.976 13:52:52 -- common/autotest_common.sh@955 -- # kill 2307805 00:19:12.976 13:52:52 -- common/autotest_common.sh@960 -- # wait 2307805 00:19:12.976 13:52:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:12.976 13:52:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:12.976 13:52:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:12.976 13:52:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:12.976 13:52:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:12.976 13:52:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:12.976 13:52:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:12.976 13:52:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.357 13:52:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:14.357 00:19:14.357 real 0m29.624s 00:19:14.357 user 0m43.350s 00:19:14.357 sys 0m9.060s 00:19:14.357 13:52:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:14.357 13:52:54 -- common/autotest_common.sh@10 -- # set +x 00:19:14.357 ************************************ 00:19:14.357 END TEST nvmf_zcopy 00:19:14.357 ************************************ 00:19:14.357 13:52:54 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:14.357 13:52:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:14.357 13:52:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:14.357 13:52:54 -- common/autotest_common.sh@10 -- # set +x 00:19:14.357 ************************************ 00:19:14.357 START TEST nvmf_nmic 00:19:14.357 ************************************ 00:19:14.357 13:52:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:14.357 * Looking for test storage... 00:19:14.357 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:14.357 13:52:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:14.357 13:52:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:14.357 13:52:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:14.616 13:52:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:14.616 13:52:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:14.616 13:52:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:14.616 13:52:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:14.616 13:52:54 -- scripts/common.sh@335 -- # IFS=.-: 00:19:14.616 13:52:54 -- scripts/common.sh@335 -- # read -ra ver1 00:19:14.616 13:52:54 -- scripts/common.sh@336 -- # IFS=.-: 00:19:14.616 13:52:54 -- scripts/common.sh@336 -- # read -ra ver2 00:19:14.616 13:52:54 -- scripts/common.sh@337 -- # local 'op=<' 00:19:14.616 13:52:54 -- scripts/common.sh@339 -- # ver1_l=2 00:19:14.616 13:52:54 -- scripts/common.sh@340 -- # ver2_l=1 00:19:14.616 13:52:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:14.616 13:52:54 -- scripts/common.sh@343 -- # case "$op" in 00:19:14.616 13:52:54 -- scripts/common.sh@344 -- # : 1 00:19:14.616 13:52:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:14.616 13:52:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:14.616 13:52:54 -- scripts/common.sh@364 -- # decimal 1 00:19:14.616 13:52:54 -- scripts/common.sh@352 -- # local d=1 00:19:14.616 13:52:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:14.616 13:52:54 -- scripts/common.sh@354 -- # echo 1 00:19:14.616 13:52:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:14.616 13:52:54 -- scripts/common.sh@365 -- # decimal 2 00:19:14.616 13:52:54 -- scripts/common.sh@352 -- # local d=2 00:19:14.616 13:52:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:14.616 13:52:54 -- scripts/common.sh@354 -- # echo 2 00:19:14.616 13:52:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:14.616 13:52:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:14.616 13:52:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:14.616 13:52:54 -- scripts/common.sh@367 -- # return 0 00:19:14.616 13:52:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:14.616 13:52:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:14.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.616 --rc genhtml_branch_coverage=1 00:19:14.616 --rc genhtml_function_coverage=1 00:19:14.616 --rc genhtml_legend=1 00:19:14.616 --rc geninfo_all_blocks=1 00:19:14.616 --rc geninfo_unexecuted_blocks=1 00:19:14.616 00:19:14.616 ' 00:19:14.616 13:52:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:14.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.616 --rc genhtml_branch_coverage=1 00:19:14.616 --rc genhtml_function_coverage=1 00:19:14.616 --rc genhtml_legend=1 00:19:14.616 --rc geninfo_all_blocks=1 00:19:14.616 --rc geninfo_unexecuted_blocks=1 00:19:14.616 00:19:14.616 ' 00:19:14.616 13:52:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:14.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.616 --rc genhtml_branch_coverage=1 00:19:14.616 --rc genhtml_function_coverage=1 00:19:14.616 --rc genhtml_legend=1 00:19:14.616 --rc geninfo_all_blocks=1 00:19:14.616 --rc geninfo_unexecuted_blocks=1 00:19:14.616 00:19:14.616 ' 00:19:14.616 13:52:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:14.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.616 --rc genhtml_branch_coverage=1 00:19:14.616 --rc genhtml_function_coverage=1 00:19:14.616 --rc genhtml_legend=1 00:19:14.616 --rc geninfo_all_blocks=1 00:19:14.616 --rc geninfo_unexecuted_blocks=1 00:19:14.616 00:19:14.616 ' 00:19:14.616 13:52:54 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:14.616 13:52:54 -- nvmf/common.sh@7 -- # uname -s 00:19:14.616 13:52:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:14.616 13:52:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:14.616 13:52:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:14.616 13:52:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:14.616 13:52:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:14.616 13:52:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:14.616 13:52:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:14.616 13:52:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:14.616 13:52:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:14.616 13:52:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:14.616 13:52:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:14.616 13:52:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:14.616 13:52:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:14.616 13:52:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:14.616 13:52:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:14.616 13:52:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:14.616 13:52:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:14.616 13:52:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:14.616 13:52:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:14.616 13:52:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.616 13:52:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.616 13:52:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.616 13:52:54 -- paths/export.sh@5 -- # export PATH 00:19:14.616 13:52:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.616 13:52:54 -- nvmf/common.sh@46 -- # : 0 00:19:14.616 13:52:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:14.616 13:52:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:14.616 13:52:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:14.616 13:52:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:14.616 13:52:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:14.616 13:52:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:14.617 13:52:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:14.617 13:52:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:14.617 13:52:54 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:14.617 13:52:54 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:14.617 13:52:54 -- target/nmic.sh@14 -- # nvmftestinit 00:19:14.617 13:52:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:14.617 13:52:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:14.617 13:52:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:14.617 13:52:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:14.617 13:52:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:14.617 13:52:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.617 13:52:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.617 13:52:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.617 13:52:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:14.617 13:52:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:14.617 13:52:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:14.617 13:52:54 -- common/autotest_common.sh@10 -- # set +x 00:19:17.150 13:52:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:17.150 13:52:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:17.150 13:52:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:17.150 13:52:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:17.150 13:52:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:17.150 13:52:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:17.150 13:52:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:17.150 13:52:56 -- nvmf/common.sh@294 -- # net_devs=() 00:19:17.150 13:52:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:17.150 13:52:56 -- nvmf/common.sh@295 -- # e810=() 00:19:17.150 13:52:56 -- nvmf/common.sh@295 -- # local -ga e810 00:19:17.150 13:52:56 -- nvmf/common.sh@296 -- # x722=() 00:19:17.150 13:52:56 -- nvmf/common.sh@296 -- # local -ga x722 00:19:17.150 13:52:56 -- nvmf/common.sh@297 -- # mlx=() 00:19:17.150 13:52:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:17.150 13:52:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:17.150 13:52:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:17.150 13:52:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:17.150 13:52:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:17.150 13:52:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:17.150 13:52:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:17.150 13:52:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:17.150 13:52:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:17.150 13:52:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:17.151 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:17.151 13:52:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:17.151 13:52:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:17.151 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:17.151 13:52:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:17.151 13:52:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:17.151 13:52:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.151 13:52:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:17.151 13:52:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.151 13:52:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:17.151 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:17.151 13:52:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.151 13:52:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:17.151 13:52:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.151 13:52:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:17.151 13:52:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.151 13:52:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:17.151 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:17.151 13:52:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.151 13:52:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:17.151 13:52:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:17.151 13:52:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:17.151 13:52:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:17.151 13:52:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:17.151 13:52:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:17.151 13:52:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:17.151 13:52:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:17.151 13:52:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:17.151 13:52:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:17.151 13:52:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:17.151 13:52:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:17.151 13:52:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:17.151 13:52:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:17.151 13:52:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:17.151 13:52:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:17.151 13:52:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:17.151 13:52:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:17.151 13:52:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:17.151 13:52:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:17.151 13:52:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:17.151 13:52:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:17.151 13:52:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:17.151 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:17.151 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:19:17.151 00:19:17.151 --- 10.0.0.2 ping statistics --- 00:19:17.151 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:17.151 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:19:17.151 13:52:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:17.151 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:17.151 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:19:17.151 00:19:17.151 --- 10.0.0.1 ping statistics --- 00:19:17.151 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:17.151 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:19:17.151 13:52:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:17.151 13:52:56 -- nvmf/common.sh@410 -- # return 0 00:19:17.151 13:52:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:17.151 13:52:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:17.151 13:52:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:17.151 13:52:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:17.151 13:52:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:17.151 13:52:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:17.151 13:52:56 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:17.151 13:52:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:17.151 13:52:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:17.151 13:52:56 -- common/autotest_common.sh@10 -- # set +x 00:19:17.151 13:52:56 -- nvmf/common.sh@469 -- # nvmfpid=2312767 00:19:17.151 13:52:56 -- nvmf/common.sh@470 -- # waitforlisten 2312767 00:19:17.151 13:52:56 -- common/autotest_common.sh@829 -- # '[' -z 2312767 ']' 00:19:17.151 13:52:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:17.151 13:52:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:17.151 13:52:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:17.151 13:52:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:17.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:17.151 13:52:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:17.151 13:52:56 -- common/autotest_common.sh@10 -- # set +x 00:19:17.151 [2024-11-29 13:52:57.004493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:17.151 [2024-11-29 13:52:57.004589] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:17.151 EAL: No free 2048 kB hugepages reported on node 1 00:19:17.151 [2024-11-29 13:52:57.075216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:17.151 [2024-11-29 13:52:57.170346] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:17.151 [2024-11-29 13:52:57.170512] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:17.151 [2024-11-29 13:52:57.170533] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:17.151 [2024-11-29 13:52:57.170547] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:17.151 [2024-11-29 13:52:57.170644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:17.151 [2024-11-29 13:52:57.170699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:17.151 [2024-11-29 13:52:57.170749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:17.151 [2024-11-29 13:52:57.170752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:17.719 13:52:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:17.719 13:52:57 -- common/autotest_common.sh@862 -- # return 0 00:19:17.719 13:52:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:17.719 13:52:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:17.719 13:52:57 -- common/autotest_common.sh@10 -- # set +x 00:19:17.719 13:52:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:17.719 13:52:57 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:17.719 13:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.719 13:52:57 -- common/autotest_common.sh@10 -- # set +x 00:19:17.719 [2024-11-29 13:52:57.987018] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:17.719 13:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.719 13:52:57 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:17.719 13:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.719 13:52:57 -- common/autotest_common.sh@10 -- # set +x 00:19:17.978 Malloc0 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 [2024-11-29 13:52:58.040406] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:17.979 test case1: single bdev can't be used in multiple subsystems 00:19:17.979 13:52:58 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@28 -- # nmic_status=0 00:19:17.979 13:52:58 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 [2024-11-29 13:52:58.064236] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:17.979 [2024-11-29 13:52:58.064265] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:17.979 [2024-11-29 13:52:58.064295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.979 request: 00:19:17.979 { 00:19:17.979 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:17.979 "namespace": { 00:19:17.979 "bdev_name": "Malloc0" 00:19:17.979 }, 00:19:17.979 "method": "nvmf_subsystem_add_ns", 00:19:17.979 "req_id": 1 00:19:17.979 } 00:19:17.979 Got JSON-RPC error response 00:19:17.979 response: 00:19:17.979 { 00:19:17.979 "code": -32602, 00:19:17.979 "message": "Invalid parameters" 00:19:17.979 } 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@29 -- # nmic_status=1 00:19:17.979 13:52:58 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:17.979 13:52:58 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:17.979 Adding namespace failed - expected result. 00:19:17.979 13:52:58 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:17.979 test case2: host connect to nvmf target in multiple paths 00:19:17.979 13:52:58 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:17.979 13:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.979 13:52:58 -- common/autotest_common.sh@10 -- # set +x 00:19:17.979 [2024-11-29 13:52:58.072347] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:17.979 13:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.979 13:52:58 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:18.545 13:52:58 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:19.111 13:52:59 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:19.111 13:52:59 -- common/autotest_common.sh@1187 -- # local i=0 00:19:19.111 13:52:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.111 13:52:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:19.111 13:52:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:21.013 13:53:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:21.013 13:53:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:21.013 13:53:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:21.273 13:53:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:21.273 13:53:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:21.273 13:53:01 -- common/autotest_common.sh@1197 -- # return 0 00:19:21.273 13:53:01 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:21.273 [global] 00:19:21.273 thread=1 00:19:21.273 invalidate=1 00:19:21.273 rw=write 00:19:21.273 time_based=1 00:19:21.273 runtime=1 00:19:21.273 ioengine=libaio 00:19:21.273 direct=1 00:19:21.273 bs=4096 00:19:21.273 iodepth=1 00:19:21.273 norandommap=0 00:19:21.273 numjobs=1 00:19:21.273 00:19:21.273 verify_dump=1 00:19:21.273 verify_backlog=512 00:19:21.273 verify_state_save=0 00:19:21.273 do_verify=1 00:19:21.273 verify=crc32c-intel 00:19:21.273 [job0] 00:19:21.273 filename=/dev/nvme0n1 00:19:21.273 Could not set queue depth (nvme0n1) 00:19:21.273 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.273 fio-3.35 00:19:21.273 Starting 1 thread 00:19:22.652 00:19:22.652 job0: (groupid=0, jobs=1): err= 0: pid=2313428: Fri Nov 29 13:53:02 2024 00:19:22.652 read: IOPS=21, BW=85.8KiB/s (87.8kB/s)(88.0KiB/1026msec) 00:19:22.652 slat (nsec): min=13334, max=33703, avg=18705.59, stdev=7172.28 00:19:22.652 clat (usec): min=40886, max=41122, avg=40980.64, stdev=46.36 00:19:22.652 lat (usec): min=40919, max=41137, avg=40999.35, stdev=43.23 00:19:22.652 clat percentiles (usec): 00:19:22.652 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:22.652 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:22.652 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:22.652 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:22.652 | 99.99th=[41157] 00:19:22.652 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:19:22.652 slat (usec): min=10, max=29731, avg=75.22, stdev=1313.21 00:19:22.652 clat (usec): min=139, max=383, avg=162.11, stdev=17.42 00:19:22.652 lat (usec): min=155, max=29940, avg=237.33, stdev=1315.40 00:19:22.652 clat percentiles (usec): 00:19:22.652 | 1.00th=[ 143], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 151], 00:19:22.652 | 30.00th=[ 155], 40.00th=[ 157], 50.00th=[ 159], 60.00th=[ 163], 00:19:22.652 | 70.00th=[ 167], 80.00th=[ 169], 90.00th=[ 178], 95.00th=[ 182], 00:19:22.652 | 99.00th=[ 212], 99.50th=[ 262], 99.90th=[ 383], 99.95th=[ 383], 00:19:22.652 | 99.99th=[ 383] 00:19:22.652 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:22.652 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:22.652 lat (usec) : 250=95.13%, 500=0.75% 00:19:22.652 lat (msec) : 50=4.12% 00:19:22.652 cpu : usr=0.29%, sys=0.88%, ctx=537, majf=0, minf=1 00:19:22.652 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.652 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.652 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.652 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.652 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.652 00:19:22.652 Run status group 0 (all jobs): 00:19:22.652 READ: bw=85.8KiB/s (87.8kB/s), 85.8KiB/s-85.8KiB/s (87.8kB/s-87.8kB/s), io=88.0KiB (90.1kB), run=1026-1026msec 00:19:22.652 WRITE: bw=1996KiB/s (2044kB/s), 1996KiB/s-1996KiB/s (2044kB/s-2044kB/s), io=2048KiB (2097kB), run=1026-1026msec 00:19:22.652 00:19:22.652 Disk stats (read/write): 00:19:22.652 nvme0n1: ios=45/512, merge=0/0, ticks=1728/80, in_queue=1808, util=98.70% 00:19:22.652 13:53:02 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:22.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:22.652 13:53:02 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:22.652 13:53:02 -- common/autotest_common.sh@1208 -- # local i=0 00:19:22.652 13:53:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:22.652 13:53:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.652 13:53:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:22.652 13:53:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.652 13:53:02 -- common/autotest_common.sh@1220 -- # return 0 00:19:22.652 13:53:02 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:22.652 13:53:02 -- target/nmic.sh@53 -- # nvmftestfini 00:19:22.652 13:53:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:22.652 13:53:02 -- nvmf/common.sh@116 -- # sync 00:19:22.652 13:53:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:22.652 13:53:02 -- nvmf/common.sh@119 -- # set +e 00:19:22.652 13:53:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:22.652 13:53:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:22.652 rmmod nvme_tcp 00:19:22.652 rmmod nvme_fabrics 00:19:22.652 rmmod nvme_keyring 00:19:22.652 13:53:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:22.652 13:53:02 -- nvmf/common.sh@123 -- # set -e 00:19:22.652 13:53:02 -- nvmf/common.sh@124 -- # return 0 00:19:22.653 13:53:02 -- nvmf/common.sh@477 -- # '[' -n 2312767 ']' 00:19:22.653 13:53:02 -- nvmf/common.sh@478 -- # killprocess 2312767 00:19:22.653 13:53:02 -- common/autotest_common.sh@936 -- # '[' -z 2312767 ']' 00:19:22.653 13:53:02 -- common/autotest_common.sh@940 -- # kill -0 2312767 00:19:22.653 13:53:02 -- common/autotest_common.sh@941 -- # uname 00:19:22.653 13:53:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:22.653 13:53:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2312767 00:19:22.653 13:53:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:22.653 13:53:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:22.653 13:53:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2312767' 00:19:22.653 killing process with pid 2312767 00:19:22.653 13:53:02 -- common/autotest_common.sh@955 -- # kill 2312767 00:19:22.653 13:53:02 -- common/autotest_common.sh@960 -- # wait 2312767 00:19:22.911 13:53:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:22.911 13:53:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:22.911 13:53:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:22.911 13:53:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:22.911 13:53:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:22.911 13:53:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:22.911 13:53:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:22.911 13:53:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.449 13:53:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.449 00:19:25.449 real 0m10.642s 00:19:25.449 user 0m25.221s 00:19:25.449 sys 0m2.418s 00:19:25.449 13:53:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:25.449 13:53:05 -- common/autotest_common.sh@10 -- # set +x 00:19:25.449 ************************************ 00:19:25.449 END TEST nvmf_nmic 00:19:25.449 ************************************ 00:19:25.449 13:53:05 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:25.449 13:53:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:25.449 13:53:05 -- common/autotest_common.sh@10 -- # set +x 00:19:25.449 ************************************ 00:19:25.449 START TEST nvmf_fio_target 00:19:25.449 ************************************ 00:19:25.449 13:53:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:25.449 * Looking for test storage... 00:19:25.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.449 13:53:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:25.449 13:53:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:25.449 13:53:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:25.449 13:53:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:25.449 13:53:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:25.449 13:53:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:25.449 13:53:05 -- scripts/common.sh@335 -- # IFS=.-: 00:19:25.449 13:53:05 -- scripts/common.sh@335 -- # read -ra ver1 00:19:25.449 13:53:05 -- scripts/common.sh@336 -- # IFS=.-: 00:19:25.449 13:53:05 -- scripts/common.sh@336 -- # read -ra ver2 00:19:25.449 13:53:05 -- scripts/common.sh@337 -- # local 'op=<' 00:19:25.449 13:53:05 -- scripts/common.sh@339 -- # ver1_l=2 00:19:25.449 13:53:05 -- scripts/common.sh@340 -- # ver2_l=1 00:19:25.449 13:53:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:25.449 13:53:05 -- scripts/common.sh@343 -- # case "$op" in 00:19:25.449 13:53:05 -- scripts/common.sh@344 -- # : 1 00:19:25.449 13:53:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:25.449 13:53:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:25.449 13:53:05 -- scripts/common.sh@364 -- # decimal 1 00:19:25.449 13:53:05 -- scripts/common.sh@352 -- # local d=1 00:19:25.449 13:53:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:25.449 13:53:05 -- scripts/common.sh@354 -- # echo 1 00:19:25.449 13:53:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:25.449 13:53:05 -- scripts/common.sh@365 -- # decimal 2 00:19:25.449 13:53:05 -- scripts/common.sh@352 -- # local d=2 00:19:25.449 13:53:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:25.449 13:53:05 -- scripts/common.sh@354 -- # echo 2 00:19:25.449 13:53:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:25.449 13:53:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:25.449 13:53:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:25.449 13:53:05 -- scripts/common.sh@367 -- # return 0 00:19:25.449 13:53:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:25.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.449 --rc genhtml_branch_coverage=1 00:19:25.449 --rc genhtml_function_coverage=1 00:19:25.449 --rc genhtml_legend=1 00:19:25.449 --rc geninfo_all_blocks=1 00:19:25.449 --rc geninfo_unexecuted_blocks=1 00:19:25.449 00:19:25.449 ' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:25.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.449 --rc genhtml_branch_coverage=1 00:19:25.449 --rc genhtml_function_coverage=1 00:19:25.449 --rc genhtml_legend=1 00:19:25.449 --rc geninfo_all_blocks=1 00:19:25.449 --rc geninfo_unexecuted_blocks=1 00:19:25.449 00:19:25.449 ' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:25.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.449 --rc genhtml_branch_coverage=1 00:19:25.449 --rc genhtml_function_coverage=1 00:19:25.449 --rc genhtml_legend=1 00:19:25.449 --rc geninfo_all_blocks=1 00:19:25.449 --rc geninfo_unexecuted_blocks=1 00:19:25.449 00:19:25.449 ' 00:19:25.449 13:53:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:25.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.449 --rc genhtml_branch_coverage=1 00:19:25.449 --rc genhtml_function_coverage=1 00:19:25.449 --rc genhtml_legend=1 00:19:25.449 --rc geninfo_all_blocks=1 00:19:25.449 --rc geninfo_unexecuted_blocks=1 00:19:25.449 00:19:25.449 ' 00:19:25.449 13:53:05 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.449 13:53:05 -- nvmf/common.sh@7 -- # uname -s 00:19:25.449 13:53:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.449 13:53:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.449 13:53:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.449 13:53:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.449 13:53:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.449 13:53:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.449 13:53:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.449 13:53:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.449 13:53:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.449 13:53:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.449 13:53:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.449 13:53:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.449 13:53:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.449 13:53:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.449 13:53:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.449 13:53:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.449 13:53:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.449 13:53:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.449 13:53:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.449 13:53:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.449 13:53:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.449 13:53:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.449 13:53:05 -- paths/export.sh@5 -- # export PATH 00:19:25.449 13:53:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.449 13:53:05 -- nvmf/common.sh@46 -- # : 0 00:19:25.449 13:53:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.449 13:53:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.449 13:53:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.449 13:53:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.449 13:53:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.449 13:53:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.449 13:53:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.449 13:53:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.449 13:53:05 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.450 13:53:05 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.450 13:53:05 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:25.450 13:53:05 -- target/fio.sh@16 -- # nvmftestinit 00:19:25.450 13:53:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.450 13:53:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.450 13:53:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.450 13:53:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.450 13:53:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.450 13:53:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.450 13:53:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.450 13:53:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.450 13:53:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.450 13:53:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.450 13:53:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.450 13:53:05 -- common/autotest_common.sh@10 -- # set +x 00:19:27.358 13:53:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.359 13:53:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.359 13:53:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.359 13:53:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.359 13:53:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.359 13:53:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.359 13:53:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.359 13:53:07 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.359 13:53:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.359 13:53:07 -- nvmf/common.sh@295 -- # e810=() 00:19:27.359 13:53:07 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.359 13:53:07 -- nvmf/common.sh@296 -- # x722=() 00:19:27.359 13:53:07 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.359 13:53:07 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.359 13:53:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.359 13:53:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.359 13:53:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.359 13:53:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.359 13:53:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.359 13:53:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.359 13:53:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.359 13:53:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.359 13:53:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.359 13:53:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:27.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:27.359 13:53:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.359 13:53:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.359 13:53:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.359 13:53:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:27.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:27.359 13:53:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:27.359 13:53:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:27.359 13:53:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.359 13:53:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:27.359 13:53:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:27.359 13:53:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:27.359 13:53:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:27.359 13:53:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:27.359 13:53:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:27.359 13:53:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.359 13:53:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:27.359 13:53:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:27.359 13:53:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:27.359 13:53:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:27.359 13:53:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:27.359 13:53:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:27.359 13:53:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:27.359 13:53:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:27.359 13:53:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:27.359 13:53:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:27.359 13:53:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:27.359 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:27.359 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.357 ms 00:19:27.359 00:19:27.359 --- 10.0.0.2 ping statistics --- 00:19:27.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.359 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:19:27.359 13:53:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:27.359 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:27.359 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:19:27.359 00:19:27.359 --- 10.0.0.1 ping statistics --- 00:19:27.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.359 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:19:27.359 13:53:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:27.359 13:53:07 -- nvmf/common.sh@410 -- # return 0 00:19:27.359 13:53:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:27.359 13:53:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:27.359 13:53:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:27.359 13:53:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:27.359 13:53:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:27.359 13:53:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:27.359 13:53:07 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:27.359 13:53:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:27.359 13:53:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:27.359 13:53:07 -- common/autotest_common.sh@10 -- # set +x 00:19:27.359 13:53:07 -- nvmf/common.sh@469 -- # nvmfpid=2315524 00:19:27.359 13:53:07 -- nvmf/common.sh@470 -- # waitforlisten 2315524 00:19:27.359 13:53:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:27.359 13:53:07 -- common/autotest_common.sh@829 -- # '[' -z 2315524 ']' 00:19:27.359 13:53:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:27.359 13:53:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:27.359 13:53:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:27.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:27.359 13:53:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:27.359 13:53:07 -- common/autotest_common.sh@10 -- # set +x 00:19:27.619 [2024-11-29 13:53:07.651791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:27.619 [2024-11-29 13:53:07.651897] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:27.619 EAL: No free 2048 kB hugepages reported on node 1 00:19:27.619 [2024-11-29 13:53:07.734754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:27.619 [2024-11-29 13:53:07.832842] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:27.619 [2024-11-29 13:53:07.833014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:27.619 [2024-11-29 13:53:07.833032] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:27.619 [2024-11-29 13:53:07.833046] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:27.619 [2024-11-29 13:53:07.833128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:27.619 [2024-11-29 13:53:07.833157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:27.619 [2024-11-29 13:53:07.833212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:27.619 [2024-11-29 13:53:07.833215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:28.553 13:53:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:28.553 13:53:08 -- common/autotest_common.sh@862 -- # return 0 00:19:28.553 13:53:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:28.553 13:53:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:28.553 13:53:08 -- common/autotest_common.sh@10 -- # set +x 00:19:28.553 13:53:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:28.553 13:53:08 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:28.810 [2024-11-29 13:53:08.914843] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:28.810 13:53:08 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.068 13:53:09 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:29.068 13:53:09 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.326 13:53:09 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:29.326 13:53:09 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.584 13:53:09 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:29.584 13:53:09 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.842 13:53:10 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:29.842 13:53:10 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:30.100 13:53:10 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.359 13:53:10 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:30.359 13:53:10 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.616 13:53:10 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:30.616 13:53:10 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.874 13:53:11 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:30.874 13:53:11 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:31.132 13:53:11 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:31.390 13:53:11 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:31.390 13:53:11 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:31.648 13:53:11 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:31.648 13:53:11 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:31.907 13:53:12 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.165 [2024-11-29 13:53:12.389539] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.165 13:53:12 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:32.424 13:53:12 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:32.681 13:53:12 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:33.617 13:53:13 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:33.617 13:53:13 -- common/autotest_common.sh@1187 -- # local i=0 00:19:33.617 13:53:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:33.617 13:53:13 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:33.617 13:53:13 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:33.617 13:53:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.522 13:53:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.522 13:53:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.522 13:53:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:35.522 13:53:15 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:35.522 13:53:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.522 13:53:15 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.522 13:53:15 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:35.522 [global] 00:19:35.522 thread=1 00:19:35.522 invalidate=1 00:19:35.522 rw=write 00:19:35.522 time_based=1 00:19:35.522 runtime=1 00:19:35.522 ioengine=libaio 00:19:35.522 direct=1 00:19:35.522 bs=4096 00:19:35.522 iodepth=1 00:19:35.522 norandommap=0 00:19:35.522 numjobs=1 00:19:35.522 00:19:35.522 verify_dump=1 00:19:35.522 verify_backlog=512 00:19:35.522 verify_state_save=0 00:19:35.522 do_verify=1 00:19:35.522 verify=crc32c-intel 00:19:35.522 [job0] 00:19:35.522 filename=/dev/nvme0n1 00:19:35.522 [job1] 00:19:35.522 filename=/dev/nvme0n2 00:19:35.522 [job2] 00:19:35.522 filename=/dev/nvme0n3 00:19:35.522 [job3] 00:19:35.522 filename=/dev/nvme0n4 00:19:35.522 Could not set queue depth (nvme0n1) 00:19:35.522 Could not set queue depth (nvme0n2) 00:19:35.522 Could not set queue depth (nvme0n3) 00:19:35.522 Could not set queue depth (nvme0n4) 00:19:35.777 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.777 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.777 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.777 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.777 fio-3.35 00:19:35.777 Starting 4 threads 00:19:37.150 00:19:37.150 job0: (groupid=0, jobs=1): err= 0: pid=2316767: Fri Nov 29 13:53:17 2024 00:19:37.150 read: IOPS=61, BW=244KiB/s (250kB/s)(252KiB/1032msec) 00:19:37.150 slat (nsec): min=4803, max=50951, avg=14508.06, stdev=11339.13 00:19:37.150 clat (usec): min=174, max=41140, avg=14455.41, stdev=19572.86 00:19:37.150 lat (usec): min=184, max=41161, avg=14469.92, stdev=19581.47 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 174], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 192], 00:19:37.150 | 30.00th=[ 196], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 404], 00:19:37.150 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:37.150 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:37.150 | 99.99th=[41157] 00:19:37.150 write: IOPS=496, BW=1984KiB/s (2032kB/s)(2048KiB/1032msec); 0 zone resets 00:19:37.150 slat (nsec): min=6831, max=35720, avg=8359.88, stdev=2451.49 00:19:37.150 clat (usec): min=143, max=1693, avg=224.50, stdev=93.50 00:19:37.150 lat (usec): min=151, max=1700, avg=232.86, stdev=93.70 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 151], 5.00th=[ 161], 10.00th=[ 174], 20.00th=[ 200], 00:19:37.150 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 219], 00:19:37.150 | 70.00th=[ 225], 80.00th=[ 235], 90.00th=[ 253], 95.00th=[ 285], 00:19:37.150 | 99.00th=[ 404], 99.50th=[ 791], 99.90th=[ 1696], 99.95th=[ 1696], 00:19:37.150 | 99.99th=[ 1696] 00:19:37.150 bw ( KiB/s): min= 4096, max= 4096, per=34.40%, avg=4096.00, stdev= 0.00, samples=1 00:19:37.150 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:37.150 lat (usec) : 250=84.87%, 500=10.43%, 750=0.17%, 1000=0.35% 00:19:37.150 lat (msec) : 2=0.35%, 50=3.83% 00:19:37.150 cpu : usr=0.19%, sys=0.48%, ctx=576, majf=0, minf=1 00:19:37.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 issued rwts: total=63,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.150 job1: (groupid=0, jobs=1): err= 0: pid=2316768: Fri Nov 29 13:53:17 2024 00:19:37.150 read: IOPS=144, BW=580KiB/s (594kB/s)(592KiB/1021msec) 00:19:37.150 slat (nsec): min=4390, max=36586, avg=9836.66, stdev=7814.78 00:19:37.150 clat (usec): min=187, max=41243, avg=6011.09, stdev=14146.73 00:19:37.150 lat (usec): min=192, max=41265, avg=6020.93, stdev=14152.55 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 196], 5.00th=[ 208], 10.00th=[ 221], 20.00th=[ 237], 00:19:37.150 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 262], 00:19:37.150 | 70.00th=[ 318], 80.00th=[ 465], 90.00th=[41157], 95.00th=[41157], 00:19:37.150 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:37.150 | 99.99th=[41157] 00:19:37.150 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:19:37.150 slat (nsec): min=6355, max=48073, avg=8943.89, stdev=4393.66 00:19:37.150 clat (usec): min=151, max=1218, avg=240.53, stdev=81.49 00:19:37.150 lat (usec): min=158, max=1230, avg=249.47, stdev=82.68 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 176], 5.00th=[ 194], 10.00th=[ 202], 20.00th=[ 208], 00:19:37.150 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 225], 00:19:37.150 | 70.00th=[ 231], 80.00th=[ 245], 90.00th=[ 318], 95.00th=[ 379], 00:19:37.150 | 99.00th=[ 457], 99.50th=[ 545], 99.90th=[ 1221], 99.95th=[ 1221], 00:19:37.150 | 99.99th=[ 1221] 00:19:37.150 bw ( KiB/s): min= 4096, max= 4096, per=34.40%, avg=4096.00, stdev= 0.00, samples=1 00:19:37.150 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:37.150 lat (usec) : 250=73.64%, 500=21.82%, 750=1.06% 00:19:37.150 lat (msec) : 2=0.30%, 50=3.18% 00:19:37.150 cpu : usr=0.20%, sys=0.69%, ctx=661, majf=0, minf=1 00:19:37.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 issued rwts: total=148,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.150 job2: (groupid=0, jobs=1): err= 0: pid=2316769: Fri Nov 29 13:53:17 2024 00:19:37.150 read: IOPS=1013, BW=4055KiB/s (4152kB/s)(4132KiB/1019msec) 00:19:37.150 slat (nsec): min=4443, max=72223, avg=11904.80, stdev=7622.06 00:19:37.150 clat (usec): min=210, max=41050, avg=659.19, stdev=3985.99 00:19:37.150 lat (usec): min=218, max=41055, avg=671.10, stdev=3987.21 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 221], 5.00th=[ 227], 10.00th=[ 231], 20.00th=[ 237], 00:19:37.150 | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 247], 60.00th=[ 251], 00:19:37.150 | 70.00th=[ 255], 80.00th=[ 269], 90.00th=[ 322], 95.00th=[ 379], 00:19:37.150 | 99.00th=[ 4080], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:37.150 | 99.99th=[41157] 00:19:37.150 write: IOPS=1507, BW=6029KiB/s (6174kB/s)(6144KiB/1019msec); 0 zone resets 00:19:37.150 slat (nsec): min=6599, max=53742, avg=12695.65, stdev=5799.52 00:19:37.150 clat (usec): min=131, max=561, avg=194.03, stdev=49.09 00:19:37.150 lat (usec): min=140, max=570, avg=206.72, stdev=48.88 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 139], 5.00th=[ 147], 10.00th=[ 155], 20.00th=[ 161], 00:19:37.150 | 30.00th=[ 165], 40.00th=[ 169], 50.00th=[ 178], 60.00th=[ 194], 00:19:37.150 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 237], 95.00th=[ 273], 00:19:37.150 | 99.00th=[ 400], 99.50th=[ 465], 99.90th=[ 553], 99.95th=[ 562], 00:19:37.150 | 99.99th=[ 562] 00:19:37.150 bw ( KiB/s): min= 4096, max= 8192, per=51.60%, avg=6144.00, stdev=2896.31, samples=2 00:19:37.150 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:37.150 lat (usec) : 250=79.64%, 500=19.70%, 750=0.19%, 1000=0.04% 00:19:37.150 lat (msec) : 10=0.04%, 50=0.39% 00:19:37.150 cpu : usr=1.67%, sys=3.05%, ctx=2570, majf=0, minf=2 00:19:37.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.150 issued rwts: total=1033,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.150 job3: (groupid=0, jobs=1): err= 0: pid=2316770: Fri Nov 29 13:53:17 2024 00:19:37.150 read: IOPS=176, BW=706KiB/s (723kB/s)(728KiB/1031msec) 00:19:37.150 slat (nsec): min=5292, max=38561, avg=13359.15, stdev=7377.15 00:19:37.150 clat (usec): min=218, max=42098, avg=4947.60, stdev=12983.18 00:19:37.150 lat (usec): min=226, max=42117, avg=4960.96, stdev=12987.87 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 229], 5.00th=[ 235], 10.00th=[ 243], 20.00th=[ 260], 00:19:37.150 | 30.00th=[ 310], 40.00th=[ 404], 50.00th=[ 461], 60.00th=[ 486], 00:19:37.150 | 70.00th=[ 502], 80.00th=[ 523], 90.00th=[41157], 95.00th=[42206], 00:19:37.150 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:37.150 | 99.99th=[42206] 00:19:37.150 write: IOPS=496, BW=1986KiB/s (2034kB/s)(2048KiB/1031msec); 0 zone resets 00:19:37.150 slat (nsec): min=7138, max=40669, avg=9208.66, stdev=3395.65 00:19:37.150 clat (usec): min=174, max=1163, avg=237.48, stdev=65.91 00:19:37.150 lat (usec): min=182, max=1171, avg=246.69, stdev=66.99 00:19:37.150 clat percentiles (usec): 00:19:37.150 | 1.00th=[ 188], 5.00th=[ 198], 10.00th=[ 206], 20.00th=[ 210], 00:19:37.150 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 219], 60.00th=[ 223], 00:19:37.150 | 70.00th=[ 229], 80.00th=[ 243], 90.00th=[ 289], 95.00th=[ 367], 00:19:37.150 | 99.00th=[ 453], 99.50th=[ 494], 99.90th=[ 1172], 99.95th=[ 1172], 00:19:37.150 | 99.99th=[ 1172] 00:19:37.150 bw ( KiB/s): min= 4096, max= 4096, per=34.40%, avg=4096.00, stdev= 0.00, samples=1 00:19:37.151 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:37.151 lat (usec) : 250=66.14%, 500=25.65%, 750=5.04% 00:19:37.151 lat (msec) : 2=0.29%, 50=2.88% 00:19:37.151 cpu : usr=0.39%, sys=0.58%, ctx=695, majf=0, minf=1 00:19:37.151 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.151 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.151 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.151 issued rwts: total=182,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.151 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.151 00:19:37.151 Run status group 0 (all jobs): 00:19:37.151 READ: bw=5527KiB/s (5660kB/s), 244KiB/s-4055KiB/s (250kB/s-4152kB/s), io=5704KiB (5841kB), run=1019-1032msec 00:19:37.151 WRITE: bw=11.6MiB/s (12.2MB/s), 1984KiB/s-6029KiB/s (2032kB/s-6174kB/s), io=12.0MiB (12.6MB), run=1019-1032msec 00:19:37.151 00:19:37.151 Disk stats (read/write): 00:19:37.151 nvme0n1: ios=107/512, merge=0/0, ticks=886/110, in_queue=996, util=85.67% 00:19:37.151 nvme0n2: ios=166/512, merge=0/0, ticks=1595/119, in_queue=1714, util=89.62% 00:19:37.151 nvme0n3: ios=1085/1536, merge=0/0, ticks=677/291, in_queue=968, util=93.61% 00:19:37.151 nvme0n4: ios=234/512, merge=0/0, ticks=865/119, in_queue=984, util=94.40% 00:19:37.151 13:53:17 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:37.151 [global] 00:19:37.151 thread=1 00:19:37.151 invalidate=1 00:19:37.151 rw=randwrite 00:19:37.151 time_based=1 00:19:37.151 runtime=1 00:19:37.151 ioengine=libaio 00:19:37.151 direct=1 00:19:37.151 bs=4096 00:19:37.151 iodepth=1 00:19:37.151 norandommap=0 00:19:37.151 numjobs=1 00:19:37.151 00:19:37.151 verify_dump=1 00:19:37.151 verify_backlog=512 00:19:37.151 verify_state_save=0 00:19:37.151 do_verify=1 00:19:37.151 verify=crc32c-intel 00:19:37.151 [job0] 00:19:37.151 filename=/dev/nvme0n1 00:19:37.151 [job1] 00:19:37.151 filename=/dev/nvme0n2 00:19:37.151 [job2] 00:19:37.151 filename=/dev/nvme0n3 00:19:37.151 [job3] 00:19:37.151 filename=/dev/nvme0n4 00:19:37.151 Could not set queue depth (nvme0n1) 00:19:37.151 Could not set queue depth (nvme0n2) 00:19:37.151 Could not set queue depth (nvme0n3) 00:19:37.151 Could not set queue depth (nvme0n4) 00:19:37.151 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.151 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.151 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.151 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.151 fio-3.35 00:19:37.151 Starting 4 threads 00:19:38.526 00:19:38.526 job0: (groupid=0, jobs=1): err= 0: pid=2317004: Fri Nov 29 13:53:18 2024 00:19:38.526 read: IOPS=1940, BW=7760KiB/s (7946kB/s)(7768KiB/1001msec) 00:19:38.526 slat (nsec): min=5254, max=62257, avg=12550.25, stdev=6070.42 00:19:38.526 clat (usec): min=198, max=40785, avg=288.02, stdev=922.36 00:19:38.526 lat (usec): min=203, max=40794, avg=300.57, stdev=922.46 00:19:38.526 clat percentiles (usec): 00:19:38.526 | 1.00th=[ 206], 5.00th=[ 212], 10.00th=[ 217], 20.00th=[ 223], 00:19:38.526 | 30.00th=[ 233], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 251], 00:19:38.526 | 70.00th=[ 258], 80.00th=[ 269], 90.00th=[ 400], 95.00th=[ 441], 00:19:38.526 | 99.00th=[ 502], 99.50th=[ 586], 99.90th=[ 1074], 99.95th=[40633], 00:19:38.526 | 99.99th=[40633] 00:19:38.526 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:38.526 slat (nsec): min=6533, max=56825, avg=13701.83, stdev=6819.65 00:19:38.526 clat (usec): min=132, max=1395, avg=180.37, stdev=52.56 00:19:38.526 lat (usec): min=140, max=1407, avg=194.08, stdev=54.75 00:19:38.526 clat percentiles (usec): 00:19:38.526 | 1.00th=[ 137], 5.00th=[ 141], 10.00th=[ 143], 20.00th=[ 149], 00:19:38.526 | 30.00th=[ 153], 40.00th=[ 163], 50.00th=[ 174], 60.00th=[ 180], 00:19:38.526 | 70.00th=[ 184], 80.00th=[ 200], 90.00th=[ 227], 95.00th=[ 281], 00:19:38.526 | 99.00th=[ 297], 99.50th=[ 310], 99.90th=[ 775], 99.95th=[ 906], 00:19:38.526 | 99.99th=[ 1401] 00:19:38.526 bw ( KiB/s): min= 8192, max= 8192, per=59.49%, avg=8192.00, stdev= 0.00, samples=1 00:19:38.526 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:38.526 lat (usec) : 250=75.44%, 500=23.91%, 750=0.50%, 1000=0.08% 00:19:38.526 lat (msec) : 2=0.05%, 50=0.03% 00:19:38.526 cpu : usr=2.90%, sys=8.20%, ctx=3991, majf=0, minf=1 00:19:38.526 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.526 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.526 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.526 issued rwts: total=1942,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.526 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.526 job1: (groupid=0, jobs=1): err= 0: pid=2317010: Fri Nov 29 13:53:18 2024 00:19:38.526 read: IOPS=149, BW=596KiB/s (610kB/s)(620KiB/1040msec) 00:19:38.526 slat (nsec): min=5115, max=34808, avg=9329.01, stdev=7380.78 00:19:38.526 clat (usec): min=182, max=41088, avg=5997.30, stdev=14263.09 00:19:38.526 lat (usec): min=187, max=41106, avg=6006.63, stdev=14268.44 00:19:38.526 clat percentiles (usec): 00:19:38.526 | 1.00th=[ 184], 5.00th=[ 188], 10.00th=[ 190], 20.00th=[ 194], 00:19:38.526 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 219], 00:19:38.526 | 70.00th=[ 245], 80.00th=[ 262], 90.00th=[41157], 95.00th=[41157], 00:19:38.526 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:38.526 | 99.99th=[41157] 00:19:38.526 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:38.527 slat (nsec): min=7567, max=32154, avg=9133.58, stdev=2542.74 00:19:38.527 clat (usec): min=154, max=256, avg=191.22, stdev=17.91 00:19:38.527 lat (usec): min=164, max=288, avg=200.35, stdev=18.18 00:19:38.527 clat percentiles (usec): 00:19:38.527 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 176], 00:19:38.527 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 192], 60.00th=[ 196], 00:19:38.527 | 70.00th=[ 200], 80.00th=[ 206], 90.00th=[ 215], 95.00th=[ 219], 00:19:38.527 | 99.00th=[ 235], 99.50th=[ 239], 99.90th=[ 258], 99.95th=[ 258], 00:19:38.527 | 99.99th=[ 258] 00:19:38.527 bw ( KiB/s): min= 4096, max= 4096, per=29.74%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.527 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.527 lat (usec) : 250=93.55%, 500=3.15% 00:19:38.527 lat (msec) : 50=3.30% 00:19:38.527 cpu : usr=0.48%, sys=0.58%, ctx=670, majf=0, minf=1 00:19:38.527 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.527 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 issued rwts: total=155,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.527 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.527 job2: (groupid=0, jobs=1): err= 0: pid=2317011: Fri Nov 29 13:53:18 2024 00:19:38.527 read: IOPS=22, BW=89.8KiB/s (92.0kB/s)(92.0KiB/1024msec) 00:19:38.527 slat (nsec): min=6052, max=35898, avg=23865.70, stdev=10846.17 00:19:38.527 clat (usec): min=410, max=41387, avg=39208.47, stdev=8458.93 00:19:38.527 lat (usec): min=426, max=41393, avg=39232.33, stdev=8460.66 00:19:38.527 clat percentiles (usec): 00:19:38.527 | 1.00th=[ 412], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:38.527 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:38.527 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:38.527 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:38.527 | 99.99th=[41157] 00:19:38.527 write: IOPS=500, BW=2000KiB/s (2048kB/s)(2048KiB/1024msec); 0 zone resets 00:19:38.527 slat (nsec): min=6555, max=32462, avg=7887.49, stdev=2566.89 00:19:38.527 clat (usec): min=146, max=2342, avg=218.48, stdev=101.19 00:19:38.527 lat (usec): min=152, max=2350, avg=226.37, stdev=101.25 00:19:38.527 clat percentiles (usec): 00:19:38.527 | 1.00th=[ 157], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 182], 00:19:38.527 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 219], 60.00th=[ 223], 00:19:38.527 | 70.00th=[ 227], 80.00th=[ 233], 90.00th=[ 243], 95.00th=[ 251], 00:19:38.527 | 99.00th=[ 388], 99.50th=[ 408], 99.90th=[ 2343], 99.95th=[ 2343], 00:19:38.527 | 99.99th=[ 2343] 00:19:38.527 bw ( KiB/s): min= 4096, max= 4096, per=29.74%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.527 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.527 lat (usec) : 250=90.47%, 500=5.23% 00:19:38.527 lat (msec) : 4=0.19%, 50=4.11% 00:19:38.527 cpu : usr=0.49%, sys=0.10%, ctx=536, majf=0, minf=1 00:19:38.527 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.527 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.527 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.527 job3: (groupid=0, jobs=1): err= 0: pid=2317012: Fri Nov 29 13:53:18 2024 00:19:38.527 read: IOPS=62, BW=250KiB/s (256kB/s)(260KiB/1041msec) 00:19:38.527 slat (nsec): min=5429, max=39457, avg=13350.38, stdev=10147.95 00:19:38.527 clat (usec): min=200, max=42038, avg=14175.98, stdev=19611.48 00:19:38.527 lat (usec): min=209, max=42052, avg=14189.33, stdev=19617.30 00:19:38.527 clat percentiles (usec): 00:19:38.527 | 1.00th=[ 200], 5.00th=[ 206], 10.00th=[ 210], 20.00th=[ 215], 00:19:38.527 | 30.00th=[ 265], 40.00th=[ 273], 50.00th=[ 281], 60.00th=[ 314], 00:19:38.527 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:19:38.527 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:38.527 | 99.99th=[42206] 00:19:38.527 write: IOPS=491, BW=1967KiB/s (2015kB/s)(2048KiB/1041msec); 0 zone resets 00:19:38.527 slat (nsec): min=6604, max=26344, avg=8611.20, stdev=2404.04 00:19:38.527 clat (usec): min=156, max=410, avg=213.32, stdev=34.82 00:19:38.527 lat (usec): min=165, max=419, avg=221.93, stdev=35.39 00:19:38.527 clat percentiles (usec): 00:19:38.527 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 186], 00:19:38.527 | 30.00th=[ 196], 40.00th=[ 204], 50.00th=[ 215], 60.00th=[ 221], 00:19:38.527 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 255], 00:19:38.527 | 99.00th=[ 388], 99.50th=[ 396], 99.90th=[ 412], 99.95th=[ 412], 00:19:38.527 | 99.99th=[ 412] 00:19:38.527 bw ( KiB/s): min= 4096, max= 4096, per=29.74%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.527 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.527 lat (usec) : 250=87.00%, 500=9.19% 00:19:38.527 lat (msec) : 50=3.81% 00:19:38.527 cpu : usr=0.10%, sys=0.58%, ctx=578, majf=0, minf=1 00:19:38.527 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.527 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.527 issued rwts: total=65,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.527 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.527 00:19:38.527 Run status group 0 (all jobs): 00:19:38.527 READ: bw=8396KiB/s (8597kB/s), 89.8KiB/s-7760KiB/s (92.0kB/s-7946kB/s), io=8740KiB (8950kB), run=1001-1041msec 00:19:38.527 WRITE: bw=13.4MiB/s (14.1MB/s), 1967KiB/s-8184KiB/s (2015kB/s-8380kB/s), io=14.0MiB (14.7MB), run=1001-1041msec 00:19:38.527 00:19:38.527 Disk stats (read/write): 00:19:38.527 nvme0n1: ios=1576/1769, merge=0/0, ticks=1345/313, in_queue=1658, util=99.40% 00:19:38.527 nvme0n2: ios=200/512, merge=0/0, ticks=1218/99, in_queue=1317, util=97.56% 00:19:38.527 nvme0n3: ios=42/512, merge=0/0, ticks=1684/111, in_queue=1795, util=97.49% 00:19:38.527 nvme0n4: ios=109/512, merge=0/0, ticks=879/108, in_queue=987, util=99.47% 00:19:38.527 13:53:18 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:38.527 [global] 00:19:38.527 thread=1 00:19:38.527 invalidate=1 00:19:38.527 rw=write 00:19:38.527 time_based=1 00:19:38.527 runtime=1 00:19:38.527 ioengine=libaio 00:19:38.527 direct=1 00:19:38.527 bs=4096 00:19:38.527 iodepth=128 00:19:38.527 norandommap=0 00:19:38.527 numjobs=1 00:19:38.527 00:19:38.527 verify_dump=1 00:19:38.527 verify_backlog=512 00:19:38.527 verify_state_save=0 00:19:38.527 do_verify=1 00:19:38.527 verify=crc32c-intel 00:19:38.527 [job0] 00:19:38.527 filename=/dev/nvme0n1 00:19:38.527 [job1] 00:19:38.527 filename=/dev/nvme0n2 00:19:38.527 [job2] 00:19:38.527 filename=/dev/nvme0n3 00:19:38.527 [job3] 00:19:38.527 filename=/dev/nvme0n4 00:19:38.527 Could not set queue depth (nvme0n1) 00:19:38.527 Could not set queue depth (nvme0n2) 00:19:38.527 Could not set queue depth (nvme0n3) 00:19:38.527 Could not set queue depth (nvme0n4) 00:19:38.786 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.786 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.786 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.786 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.786 fio-3.35 00:19:38.786 Starting 4 threads 00:19:40.165 00:19:40.165 job0: (groupid=0, jobs=1): err= 0: pid=2317238: Fri Nov 29 13:53:20 2024 00:19:40.165 read: IOPS=4665, BW=18.2MiB/s (19.1MB/s)(18.3MiB/1002msec) 00:19:40.165 slat (usec): min=3, max=9125, avg=95.38, stdev=523.70 00:19:40.165 clat (usec): min=563, max=35544, avg=12212.80, stdev=3601.77 00:19:40.165 lat (usec): min=5441, max=35557, avg=12308.18, stdev=3645.70 00:19:40.165 clat percentiles (usec): 00:19:40.165 | 1.00th=[ 8356], 5.00th=[ 9372], 10.00th=[10421], 20.00th=[10945], 00:19:40.165 | 30.00th=[11076], 40.00th=[11207], 50.00th=[11338], 60.00th=[11469], 00:19:40.165 | 70.00th=[11731], 80.00th=[12125], 90.00th=[13698], 95.00th=[21627], 00:19:40.165 | 99.00th=[28443], 99.50th=[28705], 99.90th=[31065], 99.95th=[31065], 00:19:40.165 | 99.99th=[35390] 00:19:40.165 write: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec); 0 zone resets 00:19:40.165 slat (usec): min=3, max=4341, avg=100.63, stdev=464.01 00:19:40.165 clat (usec): min=7727, max=37961, avg=13596.78, stdev=5261.20 00:19:40.165 lat (usec): min=7737, max=38000, avg=13697.41, stdev=5300.30 00:19:40.165 clat percentiles (usec): 00:19:40.165 | 1.00th=[ 8979], 5.00th=[10945], 10.00th=[11207], 20.00th=[11600], 00:19:40.165 | 30.00th=[11731], 40.00th=[11863], 50.00th=[11994], 60.00th=[12125], 00:19:40.165 | 70.00th=[12125], 80.00th=[12387], 90.00th=[17433], 95.00th=[26346], 00:19:40.165 | 99.00th=[35914], 99.50th=[36439], 99.90th=[38011], 99.95th=[38011], 00:19:40.165 | 99.99th=[38011] 00:19:40.165 bw ( KiB/s): min=18192, max=22288, per=25.89%, avg=20240.00, stdev=2896.31, samples=2 00:19:40.165 iops : min= 4548, max= 5572, avg=5060.00, stdev=724.08, samples=2 00:19:40.165 lat (usec) : 750=0.01% 00:19:40.165 lat (msec) : 10=5.15%, 20=86.69%, 50=8.16% 00:19:40.165 cpu : usr=5.09%, sys=8.29%, ctx=583, majf=0, minf=1 00:19:40.165 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:40.165 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.165 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.165 issued rwts: total=4675,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.165 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.165 job1: (groupid=0, jobs=1): err= 0: pid=2317239: Fri Nov 29 13:53:20 2024 00:19:40.165 read: IOPS=5063, BW=19.8MiB/s (20.7MB/s)(20.7MiB/1048msec) 00:19:40.165 slat (usec): min=2, max=7458, avg=90.05, stdev=544.47 00:19:40.165 clat (usec): min=6401, max=54223, avg=12316.72, stdev=6505.25 00:19:40.165 lat (usec): min=6407, max=58851, avg=12406.78, stdev=6525.07 00:19:40.165 clat percentiles (usec): 00:19:40.165 | 1.00th=[ 7177], 5.00th=[ 8291], 10.00th=[ 9241], 20.00th=[10421], 00:19:40.165 | 30.00th=[10552], 40.00th=[10683], 50.00th=[10683], 60.00th=[10945], 00:19:40.165 | 70.00th=[11469], 80.00th=[13042], 90.00th=[15664], 95.00th=[16581], 00:19:40.165 | 99.00th=[53216], 99.50th=[53740], 99.90th=[54264], 99.95th=[54264], 00:19:40.165 | 99.99th=[54264] 00:19:40.165 write: IOPS=5374, BW=21.0MiB/s (22.0MB/s)(22.0MiB/1048msec); 0 zone resets 00:19:40.165 slat (usec): min=3, max=6260, avg=85.97, stdev=419.96 00:19:40.165 clat (usec): min=5403, max=22374, avg=11968.32, stdev=1885.00 00:19:40.165 lat (usec): min=5412, max=22383, avg=12054.28, stdev=1926.30 00:19:40.165 clat percentiles (usec): 00:19:40.165 | 1.00th=[ 6915], 5.00th=[ 8979], 10.00th=[10290], 20.00th=[11207], 00:19:40.165 | 30.00th=[11469], 40.00th=[11600], 50.00th=[11731], 60.00th=[11731], 00:19:40.165 | 70.00th=[11994], 80.00th=[13304], 90.00th=[14484], 95.00th=[16057], 00:19:40.165 | 99.00th=[17695], 99.50th=[18220], 99.90th=[19792], 99.95th=[21365], 00:19:40.165 | 99.99th=[22414] 00:19:40.165 bw ( KiB/s): min=21000, max=24056, per=28.82%, avg=22528.00, stdev=2160.92, samples=2 00:19:40.165 iops : min= 5250, max= 6014, avg=5632.00, stdev=540.23, samples=2 00:19:40.165 lat (msec) : 10=11.29%, 20=87.45%, 50=0.69%, 100=0.58% 00:19:40.165 cpu : usr=5.92%, sys=7.64%, ctx=619, majf=0, minf=1 00:19:40.165 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:40.165 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.165 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.165 issued rwts: total=5307,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.165 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.165 job2: (groupid=0, jobs=1): err= 0: pid=2317249: Fri Nov 29 13:53:20 2024 00:19:40.165 read: IOPS=4318, BW=16.9MiB/s (17.7MB/s)(17.0MiB/1007msec) 00:19:40.165 slat (usec): min=2, max=12871, avg=123.73, stdev=861.91 00:19:40.165 clat (usec): min=4705, max=27853, avg=14993.07, stdev=4255.65 00:19:40.165 lat (usec): min=4721, max=27867, avg=15116.79, stdev=4304.14 00:19:40.166 clat percentiles (usec): 00:19:40.166 | 1.00th=[ 5735], 5.00th=[10159], 10.00th=[10945], 20.00th=[12518], 00:19:40.166 | 30.00th=[12911], 40.00th=[13304], 50.00th=[13698], 60.00th=[13960], 00:19:40.166 | 70.00th=[14615], 80.00th=[18482], 90.00th=[21890], 95.00th=[24249], 00:19:40.166 | 99.00th=[26346], 99.50th=[26870], 99.90th=[27919], 99.95th=[27919], 00:19:40.166 | 99.99th=[27919] 00:19:40.166 write: IOPS=4575, BW=17.9MiB/s (18.7MB/s)(18.0MiB/1007msec); 0 zone resets 00:19:40.166 slat (usec): min=4, max=3015, avg=90.90, stdev=258.93 00:19:40.166 clat (usec): min=1082, max=27798, avg=13561.63, stdev=3260.06 00:19:40.166 lat (usec): min=1118, max=27806, avg=13652.53, stdev=3282.61 00:19:40.166 clat percentiles (usec): 00:19:40.166 | 1.00th=[ 3720], 5.00th=[ 5735], 10.00th=[ 7898], 20.00th=[12125], 00:19:40.166 | 30.00th=[13829], 40.00th=[14615], 50.00th=[15008], 60.00th=[15139], 00:19:40.166 | 70.00th=[15270], 80.00th=[15401], 90.00th=[15664], 95.00th=[15926], 00:19:40.166 | 99.00th=[16581], 99.50th=[16712], 99.90th=[27395], 99.95th=[27395], 00:19:40.166 | 99.99th=[27919] 00:19:40.166 bw ( KiB/s): min=18352, max=18512, per=23.58%, avg=18432.00, stdev=113.14, samples=2 00:19:40.166 iops : min= 4588, max= 4628, avg=4608.00, stdev=28.28, samples=2 00:19:40.166 lat (msec) : 2=0.10%, 4=0.56%, 10=9.05%, 20=82.49%, 50=7.79% 00:19:40.166 cpu : usr=6.06%, sys=7.16%, ctx=641, majf=0, minf=1 00:19:40.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:40.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.166 issued rwts: total=4349,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.166 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.166 job3: (groupid=0, jobs=1): err= 0: pid=2317259: Fri Nov 29 13:53:20 2024 00:19:40.166 read: IOPS=4548, BW=17.8MiB/s (18.6MB/s)(18.6MiB/1048msec) 00:19:40.166 slat (usec): min=2, max=12110, avg=106.00, stdev=769.23 00:19:40.166 clat (usec): min=4465, max=68454, avg=14611.25, stdev=7944.12 00:19:40.166 lat (usec): min=4472, max=68473, avg=14717.25, stdev=7975.30 00:19:40.166 clat percentiles (usec): 00:19:40.166 | 1.00th=[ 6456], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[11338], 00:19:40.166 | 30.00th=[11863], 40.00th=[12387], 50.00th=[12649], 60.00th=[13173], 00:19:40.166 | 70.00th=[14222], 80.00th=[15795], 90.00th=[19268], 95.00th=[22676], 00:19:40.166 | 99.00th=[56886], 99.50th=[67634], 99.90th=[68682], 99.95th=[68682], 00:19:40.166 | 99.99th=[68682] 00:19:40.166 write: IOPS=4885, BW=19.1MiB/s (20.0MB/s)(20.0MiB/1048msec); 0 zone resets 00:19:40.166 slat (usec): min=4, max=11541, avg=89.78, stdev=633.01 00:19:40.166 clat (usec): min=1010, max=25550, avg=12354.98, stdev=2460.92 00:19:40.166 lat (usec): min=1033, max=25574, avg=12444.76, stdev=2536.19 00:19:40.166 clat percentiles (usec): 00:19:40.166 | 1.00th=[ 4080], 5.00th=[ 6915], 10.00th=[ 8586], 20.00th=[11076], 00:19:40.166 | 30.00th=[12256], 40.00th=[12649], 50.00th=[13173], 60.00th=[13304], 00:19:40.166 | 70.00th=[13566], 80.00th=[13960], 90.00th=[14091], 95.00th=[14222], 00:19:40.166 | 99.00th=[17957], 99.50th=[19268], 99.90th=[25035], 99.95th=[25560], 00:19:40.166 | 99.99th=[25560] 00:19:40.166 bw ( KiB/s): min=20480, max=20480, per=26.20%, avg=20480.00, stdev= 0.00, samples=2 00:19:40.166 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:19:40.166 lat (msec) : 2=0.01%, 4=0.37%, 10=11.16%, 20=84.31%, 50=2.87% 00:19:40.166 lat (msec) : 100=1.27% 00:19:40.166 cpu : usr=4.11%, sys=9.07%, ctx=429, majf=0, minf=1 00:19:40.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:40.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.166 issued rwts: total=4767,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.166 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.166 00:19:40.166 Run status group 0 (all jobs): 00:19:40.166 READ: bw=71.2MiB/s (74.6MB/s), 16.9MiB/s-19.8MiB/s (17.7MB/s-20.7MB/s), io=74.6MiB (78.2MB), run=1002-1048msec 00:19:40.166 WRITE: bw=76.3MiB/s (80.0MB/s), 17.9MiB/s-21.0MiB/s (18.7MB/s-22.0MB/s), io=80.0MiB (83.9MB), run=1002-1048msec 00:19:40.166 00:19:40.166 Disk stats (read/write): 00:19:40.166 nvme0n1: ios=3916/4096, merge=0/0, ticks=15750/17962, in_queue=33712, util=84.87% 00:19:40.166 nvme0n2: ios=4390/4608, merge=0/0, ticks=23210/24029, in_queue=47239, util=85.06% 00:19:40.166 nvme0n3: ios=3584/3871, merge=0/0, ticks=51135/51078, in_queue=102213, util=88.20% 00:19:40.166 nvme0n4: ios=4081/4103, merge=0/0, ticks=53441/48795, in_queue=102236, util=99.68% 00:19:40.166 13:53:20 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:40.166 [global] 00:19:40.166 thread=1 00:19:40.166 invalidate=1 00:19:40.166 rw=randwrite 00:19:40.166 time_based=1 00:19:40.166 runtime=1 00:19:40.166 ioengine=libaio 00:19:40.166 direct=1 00:19:40.166 bs=4096 00:19:40.166 iodepth=128 00:19:40.166 norandommap=0 00:19:40.166 numjobs=1 00:19:40.166 00:19:40.166 verify_dump=1 00:19:40.166 verify_backlog=512 00:19:40.166 verify_state_save=0 00:19:40.166 do_verify=1 00:19:40.166 verify=crc32c-intel 00:19:40.166 [job0] 00:19:40.166 filename=/dev/nvme0n1 00:19:40.166 [job1] 00:19:40.166 filename=/dev/nvme0n2 00:19:40.166 [job2] 00:19:40.166 filename=/dev/nvme0n3 00:19:40.166 [job3] 00:19:40.166 filename=/dev/nvme0n4 00:19:40.166 Could not set queue depth (nvme0n1) 00:19:40.166 Could not set queue depth (nvme0n2) 00:19:40.166 Could not set queue depth (nvme0n3) 00:19:40.166 Could not set queue depth (nvme0n4) 00:19:40.166 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.166 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.166 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.166 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.166 fio-3.35 00:19:40.166 Starting 4 threads 00:19:41.545 00:19:41.545 job0: (groupid=0, jobs=1): err= 0: pid=2317592: Fri Nov 29 13:53:21 2024 00:19:41.545 read: IOPS=2021, BW=8087KiB/s (8281kB/s)(8192KiB/1013msec) 00:19:41.545 slat (usec): min=2, max=29550, avg=210.37, stdev=1505.08 00:19:41.545 clat (usec): min=12773, max=92908, avg=28264.51, stdev=14409.53 00:19:41.545 lat (usec): min=12783, max=92912, avg=28474.88, stdev=14534.73 00:19:41.545 clat percentiles (usec): 00:19:41.545 | 1.00th=[14484], 5.00th=[15008], 10.00th=[15533], 20.00th=[16581], 00:19:41.545 | 30.00th=[21103], 40.00th=[23725], 50.00th=[24511], 60.00th=[25822], 00:19:41.545 | 70.00th=[27657], 80.00th=[31589], 90.00th=[55837], 95.00th=[62129], 00:19:41.545 | 99.00th=[72877], 99.50th=[72877], 99.90th=[81265], 99.95th=[92799], 00:19:41.545 | 99.99th=[92799] 00:19:41.545 write: IOPS=2376, BW=9504KiB/s (9733kB/s)(9628KiB/1013msec); 0 zone resets 00:19:41.545 slat (usec): min=2, max=17711, avg=229.94, stdev=1297.17 00:19:41.545 clat (usec): min=8076, max=69021, avg=28960.65, stdev=13041.65 00:19:41.545 lat (usec): min=8081, max=69033, avg=29190.59, stdev=13142.93 00:19:41.545 clat percentiles (usec): 00:19:41.545 | 1.00th=[12256], 5.00th=[13435], 10.00th=[15926], 20.00th=[18482], 00:19:41.545 | 30.00th=[20055], 40.00th=[23200], 50.00th=[25035], 60.00th=[28181], 00:19:41.545 | 70.00th=[28967], 80.00th=[42730], 90.00th=[50070], 95.00th=[54789], 00:19:41.545 | 99.00th=[63177], 99.50th=[66847], 99.90th=[68682], 99.95th=[68682], 00:19:41.545 | 99.99th=[68682] 00:19:41.545 bw ( KiB/s): min= 8192, max=10048, per=16.40%, avg=9120.00, stdev=1312.39, samples=2 00:19:41.545 iops : min= 2048, max= 2512, avg=2280.00, stdev=328.10, samples=2 00:19:41.545 lat (msec) : 10=0.31%, 20=28.93%, 50=59.91%, 100=10.84% 00:19:41.545 cpu : usr=2.08%, sys=3.06%, ctx=182, majf=0, minf=2 00:19:41.545 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:41.545 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.545 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.545 issued rwts: total=2048,2407,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.545 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.545 job1: (groupid=0, jobs=1): err= 0: pid=2317593: Fri Nov 29 13:53:21 2024 00:19:41.545 read: IOPS=2527, BW=9.87MiB/s (10.4MB/s)(10.0MiB/1013msec) 00:19:41.545 slat (usec): min=2, max=16057, avg=186.11, stdev=1134.74 00:19:41.545 clat (usec): min=12127, max=45675, avg=23761.28, stdev=6668.06 00:19:41.545 lat (usec): min=12133, max=45684, avg=23947.39, stdev=6757.08 00:19:41.545 clat percentiles (usec): 00:19:41.545 | 1.00th=[14746], 5.00th=[15401], 10.00th=[15795], 20.00th=[17695], 00:19:41.545 | 30.00th=[18482], 40.00th=[20841], 50.00th=[23462], 60.00th=[25035], 00:19:41.545 | 70.00th=[27132], 80.00th=[30278], 90.00th=[33424], 95.00th=[35390], 00:19:41.545 | 99.00th=[40633], 99.50th=[44303], 99.90th=[45876], 99.95th=[45876], 00:19:41.545 | 99.99th=[45876] 00:19:41.545 write: IOPS=2613, BW=10.2MiB/s (10.7MB/s)(10.3MiB/1013msec); 0 zone resets 00:19:41.545 slat (usec): min=3, max=14194, avg=188.47, stdev=1227.17 00:19:41.545 clat (usec): min=7612, max=53082, avg=25255.86, stdev=7930.84 00:19:41.545 lat (usec): min=7618, max=53095, avg=25444.33, stdev=8051.66 00:19:41.545 clat percentiles (usec): 00:19:41.545 | 1.00th=[13173], 5.00th=[14746], 10.00th=[15926], 20.00th=[17957], 00:19:41.545 | 30.00th=[19530], 40.00th=[22152], 50.00th=[26346], 60.00th=[27657], 00:19:41.545 | 70.00th=[28443], 80.00th=[28967], 90.00th=[38011], 95.00th=[42730], 00:19:41.545 | 99.00th=[46400], 99.50th=[48497], 99.90th=[53216], 99.95th=[53216], 00:19:41.545 | 99.99th=[53216] 00:19:41.545 bw ( KiB/s): min= 9400, max=11080, per=18.41%, avg=10240.00, stdev=1187.94, samples=2 00:19:41.545 iops : min= 2350, max= 2770, avg=2560.00, stdev=296.98, samples=2 00:19:41.545 lat (msec) : 10=0.12%, 20=35.86%, 50=63.89%, 100=0.13% 00:19:41.545 cpu : usr=2.87%, sys=4.84%, ctx=191, majf=0, minf=1 00:19:41.545 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:41.545 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.545 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.545 issued rwts: total=2560,2647,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.545 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.545 job2: (groupid=0, jobs=1): err= 0: pid=2317594: Fri Nov 29 13:53:21 2024 00:19:41.545 read: IOPS=2031, BW=8127KiB/s (8322kB/s)(8192KiB/1008msec) 00:19:41.545 slat (usec): min=3, max=16609, avg=229.66, stdev=1420.54 00:19:41.545 clat (usec): min=9897, max=57552, avg=29152.14, stdev=8064.36 00:19:41.545 lat (usec): min=9909, max=57568, avg=29381.79, stdev=8193.72 00:19:41.545 clat percentiles (usec): 00:19:41.545 | 1.00th=[10421], 5.00th=[19006], 10.00th=[20055], 20.00th=[22676], 00:19:41.545 | 30.00th=[23987], 40.00th=[26346], 50.00th=[27919], 60.00th=[29230], 00:19:41.545 | 70.00th=[33162], 80.00th=[36439], 90.00th=[40109], 95.00th=[43779], 00:19:41.545 | 99.00th=[49546], 99.50th=[54264], 99.90th=[55313], 99.95th=[55313], 00:19:41.545 | 99.99th=[57410] 00:19:41.545 write: IOPS=2367, BW=9468KiB/s (9695kB/s)(9544KiB/1008msec); 0 zone resets 00:19:41.545 slat (usec): min=4, max=14088, avg=215.32, stdev=1275.49 00:19:41.545 clat (usec): min=2637, max=64908, avg=28199.58, stdev=10011.52 00:19:41.545 lat (usec): min=7838, max=64926, avg=28414.90, stdev=10113.47 00:19:41.546 clat percentiles (usec): 00:19:41.546 | 1.00th=[ 8225], 5.00th=[16450], 10.00th=[19006], 20.00th=[20317], 00:19:41.546 | 30.00th=[21627], 40.00th=[26608], 50.00th=[27657], 60.00th=[28443], 00:19:41.546 | 70.00th=[28705], 80.00th=[33424], 90.00th=[42206], 95.00th=[51119], 00:19:41.546 | 99.00th=[58459], 99.50th=[63701], 99.90th=[64750], 99.95th=[64750], 00:19:41.546 | 99.99th=[64750] 00:19:41.546 bw ( KiB/s): min= 7048, max=11016, per=16.24%, avg=9032.00, stdev=2805.80, samples=2 00:19:41.546 iops : min= 1762, max= 2754, avg=2258.00, stdev=701.45, samples=2 00:19:41.546 lat (msec) : 4=0.02%, 10=1.06%, 20=12.81%, 50=83.02%, 100=3.09% 00:19:41.546 cpu : usr=2.28%, sys=4.47%, ctx=189, majf=0, minf=1 00:19:41.546 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:41.546 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.546 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.546 issued rwts: total=2048,2386,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.546 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.546 job3: (groupid=0, jobs=1): err= 0: pid=2317596: Fri Nov 29 13:53:21 2024 00:19:41.546 read: IOPS=6077, BW=23.7MiB/s (24.9MB/s)(24.0MiB/1011msec) 00:19:41.546 slat (usec): min=2, max=9271, avg=79.04, stdev=567.18 00:19:41.546 clat (usec): min=2641, max=27867, avg=10343.73, stdev=2578.17 00:19:41.546 lat (usec): min=2671, max=27873, avg=10422.77, stdev=2617.26 00:19:41.546 clat percentiles (usec): 00:19:41.546 | 1.00th=[ 5866], 5.00th=[ 7111], 10.00th=[ 8029], 20.00th=[ 8979], 00:19:41.546 | 30.00th=[ 9241], 40.00th=[ 9372], 50.00th=[ 9634], 60.00th=[10028], 00:19:41.546 | 70.00th=[10814], 80.00th=[11731], 90.00th=[13435], 95.00th=[15008], 00:19:41.546 | 99.00th=[19006], 99.50th=[22676], 99.90th=[27657], 99.95th=[27657], 00:19:41.546 | 99.99th=[27919] 00:19:41.546 write: IOPS=6573, BW=25.7MiB/s (26.9MB/s)(26.0MiB/1011msec); 0 zone resets 00:19:41.546 slat (usec): min=4, max=9878, avg=64.65, stdev=517.63 00:19:41.546 clat (usec): min=1177, max=21333, avg=9742.97, stdev=2818.73 00:19:41.546 lat (usec): min=1186, max=21355, avg=9807.62, stdev=2857.64 00:19:41.546 clat percentiles (usec): 00:19:41.546 | 1.00th=[ 3261], 5.00th=[ 5407], 10.00th=[ 6390], 20.00th=[ 7701], 00:19:41.546 | 30.00th=[ 8848], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[10159], 00:19:41.546 | 70.00th=[10421], 80.00th=[10945], 90.00th=[13566], 95.00th=[14353], 00:19:41.546 | 99.00th=[19530], 99.50th=[20317], 99.90th=[21103], 99.95th=[21365], 00:19:41.546 | 99.99th=[21365] 00:19:41.546 bw ( KiB/s): min=24816, max=27336, per=46.88%, avg=26076.00, stdev=1781.91, samples=2 00:19:41.546 iops : min= 6204, max= 6834, avg=6519.00, stdev=445.48, samples=2 00:19:41.546 lat (msec) : 2=0.09%, 4=1.06%, 10=56.96%, 20=41.18%, 50=0.71% 00:19:41.546 cpu : usr=7.72%, sys=10.30%, ctx=380, majf=0, minf=2 00:19:41.546 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:41.546 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.546 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.546 issued rwts: total=6144,6646,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.546 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.546 00:19:41.546 Run status group 0 (all jobs): 00:19:41.546 READ: bw=49.4MiB/s (51.8MB/s), 8087KiB/s-23.7MiB/s (8281kB/s-24.9MB/s), io=50.0MiB (52.4MB), run=1008-1013msec 00:19:41.546 WRITE: bw=54.3MiB/s (57.0MB/s), 9468KiB/s-25.7MiB/s (9695kB/s-26.9MB/s), io=55.0MiB (57.7MB), run=1008-1013msec 00:19:41.546 00:19:41.546 Disk stats (read/write): 00:19:41.546 nvme0n1: ios=1930/2048, merge=0/0, ticks=24248/26131, in_queue=50379, util=91.08% 00:19:41.546 nvme0n2: ios=2048/2049, merge=0/0, ticks=25411/26626, in_queue=52037, util=86.79% 00:19:41.546 nvme0n3: ios=1817/2048, merge=0/0, ticks=21905/24574, in_queue=46479, util=99.06% 00:19:41.546 nvme0n4: ios=5144/5539, merge=0/0, ticks=51037/50918, in_queue=101955, util=98.22% 00:19:41.546 13:53:21 -- target/fio.sh@55 -- # sync 00:19:41.546 13:53:21 -- target/fio.sh@59 -- # fio_pid=2317743 00:19:41.546 13:53:21 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:41.546 13:53:21 -- target/fio.sh@61 -- # sleep 3 00:19:41.546 [global] 00:19:41.546 thread=1 00:19:41.546 invalidate=1 00:19:41.546 rw=read 00:19:41.546 time_based=1 00:19:41.546 runtime=10 00:19:41.546 ioengine=libaio 00:19:41.546 direct=1 00:19:41.546 bs=4096 00:19:41.546 iodepth=1 00:19:41.546 norandommap=1 00:19:41.546 numjobs=1 00:19:41.546 00:19:41.546 [job0] 00:19:41.546 filename=/dev/nvme0n1 00:19:41.546 [job1] 00:19:41.546 filename=/dev/nvme0n2 00:19:41.546 [job2] 00:19:41.546 filename=/dev/nvme0n3 00:19:41.546 [job3] 00:19:41.546 filename=/dev/nvme0n4 00:19:41.546 Could not set queue depth (nvme0n1) 00:19:41.546 Could not set queue depth (nvme0n2) 00:19:41.546 Could not set queue depth (nvme0n3) 00:19:41.546 Could not set queue depth (nvme0n4) 00:19:41.546 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.546 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.546 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.546 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.546 fio-3.35 00:19:41.546 Starting 4 threads 00:19:44.836 13:53:24 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:44.836 13:53:24 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:44.836 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=1040384, buflen=4096 00:19:44.836 fio: pid=2317836, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.093 13:53:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.093 13:53:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:45.093 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=16871424, buflen=4096 00:19:45.093 fio: pid=2317835, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.351 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=1826816, buflen=4096 00:19:45.351 fio: pid=2317831, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.351 13:53:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.351 13:53:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:45.673 13:53:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.673 13:53:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:45.673 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=12091392, buflen=4096 00:19:45.673 fio: pid=2317832, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.673 00:19:45.673 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2317831: Fri Nov 29 13:53:25 2024 00:19:45.673 read: IOPS=128, BW=514KiB/s (526kB/s)(1784KiB/3471msec) 00:19:45.673 slat (usec): min=5, max=31925, avg=83.28, stdev=1509.46 00:19:45.673 clat (usec): min=189, max=42166, avg=7642.48, stdev=15900.17 00:19:45.673 lat (usec): min=198, max=72987, avg=7725.93, stdev=16124.74 00:19:45.673 clat percentiles (usec): 00:19:45.673 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 204], 20.00th=[ 208], 00:19:45.673 | 30.00th=[ 212], 40.00th=[ 215], 50.00th=[ 219], 60.00th=[ 223], 00:19:45.673 | 70.00th=[ 229], 80.00th=[ 245], 90.00th=[42206], 95.00th=[42206], 00:19:45.673 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:45.673 | 99.99th=[42206] 00:19:45.673 bw ( KiB/s): min= 96, max= 2640, per=6.93%, avg=574.67, stdev=1019.77, samples=6 00:19:45.673 iops : min= 24, max= 660, avg=143.67, stdev=254.94, samples=6 00:19:45.673 lat (usec) : 250=80.09%, 500=1.79% 00:19:45.673 lat (msec) : 50=17.90% 00:19:45.673 cpu : usr=0.03%, sys=0.20%, ctx=449, majf=0, minf=2 00:19:45.673 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.673 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.673 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.673 issued rwts: total=447,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.674 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.674 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2317832: Fri Nov 29 13:53:25 2024 00:19:45.674 read: IOPS=786, BW=3145KiB/s (3220kB/s)(11.5MiB/3755msec) 00:19:45.674 slat (usec): min=4, max=11894, avg=19.85, stdev=309.94 00:19:45.674 clat (usec): min=186, max=41540, avg=1241.23, stdev=6280.64 00:19:45.674 lat (usec): min=194, max=52960, avg=1257.40, stdev=6322.20 00:19:45.674 clat percentiles (usec): 00:19:45.674 | 1.00th=[ 198], 5.00th=[ 206], 10.00th=[ 212], 20.00th=[ 221], 00:19:45.674 | 30.00th=[ 231], 40.00th=[ 237], 50.00th=[ 243], 60.00th=[ 249], 00:19:45.674 | 70.00th=[ 255], 80.00th=[ 269], 90.00th=[ 293], 95.00th=[ 367], 00:19:45.674 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:45.674 | 99.99th=[41681] 00:19:45.674 bw ( KiB/s): min= 96, max= 6360, per=39.48%, avg=3268.71, stdev=2439.22, samples=7 00:19:45.674 iops : min= 24, max= 1590, avg=817.14, stdev=609.80, samples=7 00:19:45.674 lat (usec) : 250=62.75%, 500=34.47%, 750=0.30% 00:19:45.674 lat (msec) : 50=2.44% 00:19:45.674 cpu : usr=0.48%, sys=1.23%, ctx=2959, majf=0, minf=2 00:19:45.674 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.674 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 issued rwts: total=2953,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.674 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.674 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2317835: Fri Nov 29 13:53:25 2024 00:19:45.674 read: IOPS=1289, BW=5158KiB/s (5282kB/s)(16.1MiB/3194msec) 00:19:45.674 slat (nsec): min=5351, max=53087, avg=8843.68, stdev=4995.27 00:19:45.674 clat (usec): min=193, max=41204, avg=758.38, stdev=4501.51 00:19:45.674 lat (usec): min=200, max=41223, avg=767.22, stdev=4502.89 00:19:45.674 clat percentiles (usec): 00:19:45.674 | 1.00th=[ 208], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 229], 00:19:45.674 | 30.00th=[ 235], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 255], 00:19:45.674 | 70.00th=[ 262], 80.00th=[ 273], 90.00th=[ 289], 95.00th=[ 318], 00:19:45.674 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:45.674 | 99.99th=[41157] 00:19:45.674 bw ( KiB/s): min= 96, max= 9360, per=55.96%, avg=4632.00, stdev=3205.34, samples=6 00:19:45.674 iops : min= 24, max= 2340, avg=1158.00, stdev=801.33, samples=6 00:19:45.674 lat (usec) : 250=53.62%, 500=44.42%, 750=0.68% 00:19:45.674 lat (msec) : 2=0.02%, 50=1.24% 00:19:45.674 cpu : usr=0.63%, sys=1.88%, ctx=4121, majf=0, minf=1 00:19:45.674 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.674 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 issued rwts: total=4120,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.674 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.674 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2317836: Fri Nov 29 13:53:25 2024 00:19:45.674 read: IOPS=86, BW=343KiB/s (351kB/s)(1016KiB/2960msec) 00:19:45.674 slat (nsec): min=5157, max=39423, avg=14205.24, stdev=7091.09 00:19:45.674 clat (usec): min=206, max=41366, avg=11524.27, stdev=18184.16 00:19:45.674 lat (usec): min=214, max=41377, avg=11538.47, stdev=18187.96 00:19:45.674 clat percentiles (usec): 00:19:45.674 | 1.00th=[ 217], 5.00th=[ 229], 10.00th=[ 245], 20.00th=[ 255], 00:19:45.674 | 30.00th=[ 293], 40.00th=[ 330], 50.00th=[ 355], 60.00th=[ 367], 00:19:45.674 | 70.00th=[ 416], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:45.674 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:45.674 | 99.99th=[41157] 00:19:45.674 bw ( KiB/s): min= 96, max= 1544, per=4.65%, avg=385.60, stdev=647.57, samples=5 00:19:45.674 iops : min= 24, max= 386, avg=96.40, stdev=161.89, samples=5 00:19:45.674 lat (usec) : 250=16.08%, 500=55.69% 00:19:45.674 lat (msec) : 10=0.39%, 50=27.45% 00:19:45.674 cpu : usr=0.20%, sys=0.00%, ctx=255, majf=0, minf=1 00:19:45.674 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.674 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 complete : 0=0.4%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.674 issued rwts: total=255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.674 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.674 00:19:45.674 Run status group 0 (all jobs): 00:19:45.674 READ: bw=8278KiB/s (8477kB/s), 343KiB/s-5158KiB/s (351kB/s-5282kB/s), io=30.4MiB (31.8MB), run=2960-3755msec 00:19:45.674 00:19:45.674 Disk stats (read/write): 00:19:45.674 nvme0n1: ios=438/0, merge=0/0, ticks=3284/0, in_queue=3284, util=95.08% 00:19:45.674 nvme0n2: ios=2989/0, merge=0/0, ticks=4055/0, in_queue=4055, util=98.82% 00:19:45.674 nvme0n3: ios=3861/0, merge=0/0, ticks=2997/0, in_queue=2997, util=96.79% 00:19:45.674 nvme0n4: ios=252/0, merge=0/0, ticks=2847/0, in_queue=2847, util=96.75% 00:19:45.953 13:53:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.953 13:53:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:46.214 13:53:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.214 13:53:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:46.498 13:53:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.498 13:53:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:46.498 13:53:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.498 13:53:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:47.064 13:53:27 -- target/fio.sh@69 -- # fio_status=0 00:19:47.064 13:53:27 -- target/fio.sh@70 -- # wait 2317743 00:19:47.064 13:53:27 -- target/fio.sh@70 -- # fio_status=4 00:19:47.064 13:53:27 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:47.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:47.064 13:53:27 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:47.064 13:53:27 -- common/autotest_common.sh@1208 -- # local i=0 00:19:47.064 13:53:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:47.064 13:53:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:47.064 13:53:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:47.064 13:53:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:47.064 13:53:27 -- common/autotest_common.sh@1220 -- # return 0 00:19:47.064 13:53:27 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:47.064 13:53:27 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:47.064 nvmf hotplug test: fio failed as expected 00:19:47.064 13:53:27 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:47.323 13:53:27 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:47.323 13:53:27 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:47.323 13:53:27 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:47.323 13:53:27 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:47.323 13:53:27 -- target/fio.sh@91 -- # nvmftestfini 00:19:47.323 13:53:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:47.323 13:53:27 -- nvmf/common.sh@116 -- # sync 00:19:47.323 13:53:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:47.323 13:53:27 -- nvmf/common.sh@119 -- # set +e 00:19:47.323 13:53:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:47.323 13:53:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:47.323 rmmod nvme_tcp 00:19:47.323 rmmod nvme_fabrics 00:19:47.323 rmmod nvme_keyring 00:19:47.323 13:53:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:47.323 13:53:27 -- nvmf/common.sh@123 -- # set -e 00:19:47.323 13:53:27 -- nvmf/common.sh@124 -- # return 0 00:19:47.323 13:53:27 -- nvmf/common.sh@477 -- # '[' -n 2315524 ']' 00:19:47.323 13:53:27 -- nvmf/common.sh@478 -- # killprocess 2315524 00:19:47.323 13:53:27 -- common/autotest_common.sh@936 -- # '[' -z 2315524 ']' 00:19:47.323 13:53:27 -- common/autotest_common.sh@940 -- # kill -0 2315524 00:19:47.323 13:53:27 -- common/autotest_common.sh@941 -- # uname 00:19:47.323 13:53:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:47.323 13:53:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2315524 00:19:47.323 13:53:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:47.323 13:53:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:47.323 13:53:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2315524' 00:19:47.323 killing process with pid 2315524 00:19:47.323 13:53:27 -- common/autotest_common.sh@955 -- # kill 2315524 00:19:47.323 13:53:27 -- common/autotest_common.sh@960 -- # wait 2315524 00:19:47.584 13:53:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:47.584 13:53:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:47.584 13:53:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:47.584 13:53:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:47.584 13:53:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:47.584 13:53:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:47.584 13:53:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:47.584 13:53:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:50.120 13:53:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:50.120 00:19:50.120 real 0m24.571s 00:19:50.120 user 1m27.211s 00:19:50.120 sys 0m5.958s 00:19:50.120 13:53:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:50.120 13:53:29 -- common/autotest_common.sh@10 -- # set +x 00:19:50.120 ************************************ 00:19:50.120 END TEST nvmf_fio_target 00:19:50.120 ************************************ 00:19:50.120 13:53:29 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:50.120 13:53:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:50.120 13:53:29 -- common/autotest_common.sh@10 -- # set +x 00:19:50.120 ************************************ 00:19:50.120 START TEST nvmf_bdevio 00:19:50.120 ************************************ 00:19:50.120 13:53:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:50.120 * Looking for test storage... 00:19:50.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:50.120 13:53:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:50.120 13:53:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:50.120 13:53:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:50.120 13:53:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:50.120 13:53:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:50.120 13:53:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:50.120 13:53:29 -- scripts/common.sh@335 -- # IFS=.-: 00:19:50.120 13:53:29 -- scripts/common.sh@335 -- # read -ra ver1 00:19:50.120 13:53:29 -- scripts/common.sh@336 -- # IFS=.-: 00:19:50.120 13:53:29 -- scripts/common.sh@336 -- # read -ra ver2 00:19:50.120 13:53:29 -- scripts/common.sh@337 -- # local 'op=<' 00:19:50.120 13:53:29 -- scripts/common.sh@339 -- # ver1_l=2 00:19:50.120 13:53:29 -- scripts/common.sh@340 -- # ver2_l=1 00:19:50.120 13:53:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:50.120 13:53:29 -- scripts/common.sh@343 -- # case "$op" in 00:19:50.120 13:53:29 -- scripts/common.sh@344 -- # : 1 00:19:50.120 13:53:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:50.120 13:53:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:50.120 13:53:29 -- scripts/common.sh@364 -- # decimal 1 00:19:50.120 13:53:29 -- scripts/common.sh@352 -- # local d=1 00:19:50.120 13:53:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:50.120 13:53:29 -- scripts/common.sh@354 -- # echo 1 00:19:50.120 13:53:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:50.120 13:53:29 -- scripts/common.sh@365 -- # decimal 2 00:19:50.120 13:53:29 -- scripts/common.sh@352 -- # local d=2 00:19:50.120 13:53:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:50.120 13:53:29 -- scripts/common.sh@354 -- # echo 2 00:19:50.120 13:53:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:50.120 13:53:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:50.120 13:53:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:50.120 13:53:29 -- scripts/common.sh@367 -- # return 0 00:19:50.120 13:53:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:50.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.120 --rc genhtml_branch_coverage=1 00:19:50.120 --rc genhtml_function_coverage=1 00:19:50.120 --rc genhtml_legend=1 00:19:50.120 --rc geninfo_all_blocks=1 00:19:50.120 --rc geninfo_unexecuted_blocks=1 00:19:50.120 00:19:50.120 ' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:50.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.120 --rc genhtml_branch_coverage=1 00:19:50.120 --rc genhtml_function_coverage=1 00:19:50.120 --rc genhtml_legend=1 00:19:50.120 --rc geninfo_all_blocks=1 00:19:50.120 --rc geninfo_unexecuted_blocks=1 00:19:50.120 00:19:50.120 ' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:50.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.120 --rc genhtml_branch_coverage=1 00:19:50.120 --rc genhtml_function_coverage=1 00:19:50.120 --rc genhtml_legend=1 00:19:50.120 --rc geninfo_all_blocks=1 00:19:50.120 --rc geninfo_unexecuted_blocks=1 00:19:50.120 00:19:50.120 ' 00:19:50.120 13:53:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:50.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.120 --rc genhtml_branch_coverage=1 00:19:50.120 --rc genhtml_function_coverage=1 00:19:50.120 --rc genhtml_legend=1 00:19:50.120 --rc geninfo_all_blocks=1 00:19:50.120 --rc geninfo_unexecuted_blocks=1 00:19:50.120 00:19:50.120 ' 00:19:50.120 13:53:29 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:50.120 13:53:29 -- nvmf/common.sh@7 -- # uname -s 00:19:50.120 13:53:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:50.120 13:53:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:50.120 13:53:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:50.120 13:53:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:50.120 13:53:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:50.120 13:53:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:50.120 13:53:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:50.120 13:53:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:50.120 13:53:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:50.120 13:53:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:50.120 13:53:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:50.120 13:53:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:50.120 13:53:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:50.120 13:53:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:50.120 13:53:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:50.120 13:53:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:50.120 13:53:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:50.120 13:53:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:50.120 13:53:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:50.120 13:53:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.120 13:53:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.120 13:53:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.120 13:53:30 -- paths/export.sh@5 -- # export PATH 00:19:50.120 13:53:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.120 13:53:30 -- nvmf/common.sh@46 -- # : 0 00:19:50.120 13:53:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:50.120 13:53:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:50.120 13:53:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:50.120 13:53:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:50.120 13:53:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:50.120 13:53:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:50.120 13:53:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:50.121 13:53:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:50.121 13:53:30 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:50.121 13:53:30 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:50.121 13:53:30 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:50.121 13:53:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:50.121 13:53:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:50.121 13:53:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:50.121 13:53:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:50.121 13:53:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:50.121 13:53:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:50.121 13:53:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:50.121 13:53:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:50.121 13:53:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:50.121 13:53:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:50.121 13:53:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:50.121 13:53:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.026 13:53:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:52.026 13:53:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:52.026 13:53:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:52.026 13:53:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:52.026 13:53:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:52.026 13:53:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:52.026 13:53:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:52.026 13:53:32 -- nvmf/common.sh@294 -- # net_devs=() 00:19:52.026 13:53:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:52.026 13:53:32 -- nvmf/common.sh@295 -- # e810=() 00:19:52.026 13:53:32 -- nvmf/common.sh@295 -- # local -ga e810 00:19:52.026 13:53:32 -- nvmf/common.sh@296 -- # x722=() 00:19:52.026 13:53:32 -- nvmf/common.sh@296 -- # local -ga x722 00:19:52.026 13:53:32 -- nvmf/common.sh@297 -- # mlx=() 00:19:52.026 13:53:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:52.026 13:53:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:52.026 13:53:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:52.026 13:53:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:52.026 13:53:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:52.026 13:53:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:52.026 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:52.026 13:53:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:52.026 13:53:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:52.026 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:52.026 13:53:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:52.026 13:53:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.026 13:53:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.026 13:53:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:52.026 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:52.026 13:53:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.026 13:53:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:52.026 13:53:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.026 13:53:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.026 13:53:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:52.026 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:52.026 13:53:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.026 13:53:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:52.026 13:53:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:52.026 13:53:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:52.026 13:53:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:52.026 13:53:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:52.026 13:53:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:52.026 13:53:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:52.026 13:53:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:52.026 13:53:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:52.026 13:53:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:52.026 13:53:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:52.026 13:53:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:52.026 13:53:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:52.026 13:53:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:52.026 13:53:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:52.026 13:53:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:52.026 13:53:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:52.027 13:53:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:52.027 13:53:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:52.027 13:53:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:52.027 13:53:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:52.027 13:53:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:52.027 13:53:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:52.027 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:52.027 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.399 ms 00:19:52.027 00:19:52.027 --- 10.0.0.2 ping statistics --- 00:19:52.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:52.027 rtt min/avg/max/mdev = 0.399/0.399/0.399/0.000 ms 00:19:52.027 13:53:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:52.027 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:52.027 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:19:52.027 00:19:52.027 --- 10.0.0.1 ping statistics --- 00:19:52.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:52.027 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:19:52.027 13:53:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:52.027 13:53:32 -- nvmf/common.sh@410 -- # return 0 00:19:52.027 13:53:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:52.027 13:53:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:52.027 13:53:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:52.027 13:53:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:52.027 13:53:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:52.027 13:53:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:52.027 13:53:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:52.027 13:53:32 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:52.027 13:53:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:52.027 13:53:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:52.027 13:53:32 -- common/autotest_common.sh@10 -- # set +x 00:19:52.027 13:53:32 -- nvmf/common.sh@469 -- # nvmfpid=2320497 00:19:52.027 13:53:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:52.027 13:53:32 -- nvmf/common.sh@470 -- # waitforlisten 2320497 00:19:52.027 13:53:32 -- common/autotest_common.sh@829 -- # '[' -z 2320497 ']' 00:19:52.027 13:53:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:52.027 13:53:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:52.027 13:53:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:52.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:52.027 13:53:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:52.027 13:53:32 -- common/autotest_common.sh@10 -- # set +x 00:19:52.286 [2024-11-29 13:53:32.314728] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:52.286 [2024-11-29 13:53:32.314822] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:52.286 EAL: No free 2048 kB hugepages reported on node 1 00:19:52.286 [2024-11-29 13:53:32.377738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:52.286 [2024-11-29 13:53:32.470773] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:52.286 [2024-11-29 13:53:32.470933] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:52.286 [2024-11-29 13:53:32.470952] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:52.286 [2024-11-29 13:53:32.470974] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:52.286 [2024-11-29 13:53:32.471057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:52.286 [2024-11-29 13:53:32.471119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:52.286 [2024-11-29 13:53:32.471173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:52.286 [2024-11-29 13:53:32.471175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:53.222 13:53:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:53.222 13:53:33 -- common/autotest_common.sh@862 -- # return 0 00:19:53.222 13:53:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:53.222 13:53:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 13:53:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:53.222 13:53:33 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:53.222 13:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 [2024-11-29 13:53:33.299051] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:53.222 13:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.222 13:53:33 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:53.222 13:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 Malloc0 00:19:53.222 13:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.222 13:53:33 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:53.222 13:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 13:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.222 13:53:33 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:53.222 13:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 13:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.222 13:53:33 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:53.222 13:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.222 13:53:33 -- common/autotest_common.sh@10 -- # set +x 00:19:53.222 [2024-11-29 13:53:33.350274] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:53.222 13:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.222 13:53:33 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:53.222 13:53:33 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:53.222 13:53:33 -- nvmf/common.sh@520 -- # config=() 00:19:53.222 13:53:33 -- nvmf/common.sh@520 -- # local subsystem config 00:19:53.222 13:53:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:53.222 13:53:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:53.222 { 00:19:53.222 "params": { 00:19:53.222 "name": "Nvme$subsystem", 00:19:53.222 "trtype": "$TEST_TRANSPORT", 00:19:53.222 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:53.222 "adrfam": "ipv4", 00:19:53.222 "trsvcid": "$NVMF_PORT", 00:19:53.222 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:53.223 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:53.223 "hdgst": ${hdgst:-false}, 00:19:53.223 "ddgst": ${ddgst:-false} 00:19:53.223 }, 00:19:53.223 "method": "bdev_nvme_attach_controller" 00:19:53.223 } 00:19:53.223 EOF 00:19:53.223 )") 00:19:53.223 13:53:33 -- nvmf/common.sh@542 -- # cat 00:19:53.223 13:53:33 -- nvmf/common.sh@544 -- # jq . 00:19:53.223 13:53:33 -- nvmf/common.sh@545 -- # IFS=, 00:19:53.223 13:53:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:53.223 "params": { 00:19:53.223 "name": "Nvme1", 00:19:53.223 "trtype": "tcp", 00:19:53.223 "traddr": "10.0.0.2", 00:19:53.223 "adrfam": "ipv4", 00:19:53.223 "trsvcid": "4420", 00:19:53.223 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:53.223 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:53.223 "hdgst": false, 00:19:53.223 "ddgst": false 00:19:53.223 }, 00:19:53.223 "method": "bdev_nvme_attach_controller" 00:19:53.223 }' 00:19:53.223 [2024-11-29 13:53:33.392262] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:53.223 [2024-11-29 13:53:33.392357] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2320657 ] 00:19:53.223 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.223 [2024-11-29 13:53:33.454438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:53.480 [2024-11-29 13:53:33.541679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:53.481 [2024-11-29 13:53:33.541732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:53.481 [2024-11-29 13:53:33.541735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:53.481 [2024-11-29 13:53:33.711552] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:53.481 [2024-11-29 13:53:33.711603] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:53.481 I/O targets: 00:19:53.481 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:53.481 00:19:53.481 00:19:53.481 CUnit - A unit testing framework for C - Version 2.1-3 00:19:53.481 http://cunit.sourceforge.net/ 00:19:53.481 00:19:53.481 00:19:53.481 Suite: bdevio tests on: Nvme1n1 00:19:53.740 Test: blockdev write read block ...passed 00:19:53.740 Test: blockdev write zeroes read block ...passed 00:19:53.740 Test: blockdev write zeroes read no split ...passed 00:19:53.740 Test: blockdev write zeroes read split ...passed 00:19:53.740 Test: blockdev write zeroes read split partial ...passed 00:19:53.740 Test: blockdev reset ...[2024-11-29 13:53:33.907219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:53.740 [2024-11-29 13:53:33.907324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc6670 (9): Bad file descriptor 00:19:54.001 [2024-11-29 13:53:34.042416] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:54.001 passed 00:19:54.001 Test: blockdev write read 8 blocks ...passed 00:19:54.001 Test: blockdev write read size > 128k ...passed 00:19:54.001 Test: blockdev write read invalid size ...passed 00:19:54.001 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:54.001 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:54.001 Test: blockdev write read max offset ...passed 00:19:54.001 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:54.001 Test: blockdev writev readv 8 blocks ...passed 00:19:54.001 Test: blockdev writev readv 30 x 1block ...passed 00:19:54.001 Test: blockdev writev readv block ...passed 00:19:54.001 Test: blockdev writev readv size > 128k ...passed 00:19:54.001 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:54.001 Test: blockdev comparev and writev ...[2024-11-29 13:53:34.258534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.258572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.258596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.258612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.258956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.258981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.259002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.259017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.259355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.259378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.259417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.259435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.259767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.259790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:54.001 [2024-11-29 13:53:34.259811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.001 [2024-11-29 13:53:34.259826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:54.260 passed 00:19:54.260 Test: blockdev nvme passthru rw ...passed 00:19:54.260 Test: blockdev nvme passthru vendor specific ...[2024-11-29 13:53:34.342664] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.260 [2024-11-29 13:53:34.342690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:54.260 [2024-11-29 13:53:34.342844] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.260 [2024-11-29 13:53:34.342867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:54.260 [2024-11-29 13:53:34.343014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.260 [2024-11-29 13:53:34.343036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:54.260 [2024-11-29 13:53:34.343181] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.260 [2024-11-29 13:53:34.343204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:54.260 passed 00:19:54.260 Test: blockdev nvme admin passthru ...passed 00:19:54.260 Test: blockdev copy ...passed 00:19:54.260 00:19:54.260 Run Summary: Type Total Ran Passed Failed Inactive 00:19:54.260 suites 1 1 n/a 0 0 00:19:54.260 tests 23 23 23 0 0 00:19:54.260 asserts 152 152 152 0 n/a 00:19:54.260 00:19:54.260 Elapsed time = 1.376 seconds 00:19:54.518 13:53:34 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:54.518 13:53:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.518 13:53:34 -- common/autotest_common.sh@10 -- # set +x 00:19:54.518 13:53:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.518 13:53:34 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:54.518 13:53:34 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:54.518 13:53:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.518 13:53:34 -- nvmf/common.sh@116 -- # sync 00:19:54.518 13:53:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.518 13:53:34 -- nvmf/common.sh@119 -- # set +e 00:19:54.518 13:53:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.518 13:53:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.518 rmmod nvme_tcp 00:19:54.518 rmmod nvme_fabrics 00:19:54.518 rmmod nvme_keyring 00:19:54.518 13:53:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.518 13:53:34 -- nvmf/common.sh@123 -- # set -e 00:19:54.518 13:53:34 -- nvmf/common.sh@124 -- # return 0 00:19:54.518 13:53:34 -- nvmf/common.sh@477 -- # '[' -n 2320497 ']' 00:19:54.518 13:53:34 -- nvmf/common.sh@478 -- # killprocess 2320497 00:19:54.518 13:53:34 -- common/autotest_common.sh@936 -- # '[' -z 2320497 ']' 00:19:54.518 13:53:34 -- common/autotest_common.sh@940 -- # kill -0 2320497 00:19:54.518 13:53:34 -- common/autotest_common.sh@941 -- # uname 00:19:54.518 13:53:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.518 13:53:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2320497 00:19:54.518 13:53:34 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:54.518 13:53:34 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:54.518 13:53:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2320497' 00:19:54.518 killing process with pid 2320497 00:19:54.518 13:53:34 -- common/autotest_common.sh@955 -- # kill 2320497 00:19:54.518 13:53:34 -- common/autotest_common.sh@960 -- # wait 2320497 00:19:54.777 13:53:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:54.777 13:53:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:54.777 13:53:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:54.777 13:53:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:54.777 13:53:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:54.777 13:53:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:54.777 13:53:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:54.777 13:53:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.682 13:53:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:56.682 00:19:56.682 real 0m7.102s 00:19:56.682 user 0m13.005s 00:19:56.682 sys 0m2.118s 00:19:56.682 13:53:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:56.682 13:53:36 -- common/autotest_common.sh@10 -- # set +x 00:19:56.682 ************************************ 00:19:56.682 END TEST nvmf_bdevio 00:19:56.682 ************************************ 00:19:56.941 13:53:36 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:56.941 13:53:36 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:56.941 13:53:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:56.941 13:53:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:56.941 13:53:36 -- common/autotest_common.sh@10 -- # set +x 00:19:56.941 ************************************ 00:19:56.941 START TEST nvmf_bdevio_no_huge 00:19:56.941 ************************************ 00:19:56.941 13:53:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:56.941 * Looking for test storage... 00:19:56.941 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:56.942 13:53:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:56.942 13:53:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:56.942 13:53:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:56.942 13:53:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:56.942 13:53:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:56.942 13:53:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:56.942 13:53:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:56.942 13:53:37 -- scripts/common.sh@335 -- # IFS=.-: 00:19:56.942 13:53:37 -- scripts/common.sh@335 -- # read -ra ver1 00:19:56.942 13:53:37 -- scripts/common.sh@336 -- # IFS=.-: 00:19:56.942 13:53:37 -- scripts/common.sh@336 -- # read -ra ver2 00:19:56.942 13:53:37 -- scripts/common.sh@337 -- # local 'op=<' 00:19:56.942 13:53:37 -- scripts/common.sh@339 -- # ver1_l=2 00:19:56.942 13:53:37 -- scripts/common.sh@340 -- # ver2_l=1 00:19:56.942 13:53:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:56.942 13:53:37 -- scripts/common.sh@343 -- # case "$op" in 00:19:56.942 13:53:37 -- scripts/common.sh@344 -- # : 1 00:19:56.942 13:53:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:56.942 13:53:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:56.942 13:53:37 -- scripts/common.sh@364 -- # decimal 1 00:19:56.942 13:53:37 -- scripts/common.sh@352 -- # local d=1 00:19:56.942 13:53:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:56.942 13:53:37 -- scripts/common.sh@354 -- # echo 1 00:19:56.942 13:53:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:56.942 13:53:37 -- scripts/common.sh@365 -- # decimal 2 00:19:56.942 13:53:37 -- scripts/common.sh@352 -- # local d=2 00:19:56.942 13:53:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:56.942 13:53:37 -- scripts/common.sh@354 -- # echo 2 00:19:56.942 13:53:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:56.942 13:53:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:56.942 13:53:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:56.942 13:53:37 -- scripts/common.sh@367 -- # return 0 00:19:56.942 13:53:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:56.942 13:53:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:56.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.942 --rc genhtml_branch_coverage=1 00:19:56.942 --rc genhtml_function_coverage=1 00:19:56.942 --rc genhtml_legend=1 00:19:56.942 --rc geninfo_all_blocks=1 00:19:56.942 --rc geninfo_unexecuted_blocks=1 00:19:56.942 00:19:56.942 ' 00:19:56.942 13:53:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:56.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.942 --rc genhtml_branch_coverage=1 00:19:56.942 --rc genhtml_function_coverage=1 00:19:56.942 --rc genhtml_legend=1 00:19:56.942 --rc geninfo_all_blocks=1 00:19:56.942 --rc geninfo_unexecuted_blocks=1 00:19:56.942 00:19:56.942 ' 00:19:56.942 13:53:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:56.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.942 --rc genhtml_branch_coverage=1 00:19:56.942 --rc genhtml_function_coverage=1 00:19:56.942 --rc genhtml_legend=1 00:19:56.942 --rc geninfo_all_blocks=1 00:19:56.942 --rc geninfo_unexecuted_blocks=1 00:19:56.942 00:19:56.942 ' 00:19:56.942 13:53:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:56.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.942 --rc genhtml_branch_coverage=1 00:19:56.942 --rc genhtml_function_coverage=1 00:19:56.942 --rc genhtml_legend=1 00:19:56.942 --rc geninfo_all_blocks=1 00:19:56.942 --rc geninfo_unexecuted_blocks=1 00:19:56.942 00:19:56.942 ' 00:19:56.942 13:53:37 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:56.942 13:53:37 -- nvmf/common.sh@7 -- # uname -s 00:19:56.942 13:53:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:56.942 13:53:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:56.942 13:53:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:56.942 13:53:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:56.942 13:53:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:56.942 13:53:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:56.942 13:53:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:56.942 13:53:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:56.942 13:53:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:56.942 13:53:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:56.942 13:53:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.942 13:53:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.942 13:53:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:56.942 13:53:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:56.942 13:53:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:56.942 13:53:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:56.942 13:53:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:56.942 13:53:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:56.942 13:53:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:56.942 13:53:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.942 13:53:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.942 13:53:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.942 13:53:37 -- paths/export.sh@5 -- # export PATH 00:19:56.942 13:53:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.942 13:53:37 -- nvmf/common.sh@46 -- # : 0 00:19:56.942 13:53:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:56.942 13:53:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:56.942 13:53:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:56.942 13:53:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:56.942 13:53:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:56.942 13:53:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:56.942 13:53:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:56.942 13:53:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:56.942 13:53:37 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:56.942 13:53:37 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:56.942 13:53:37 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:56.942 13:53:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:56.942 13:53:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:56.942 13:53:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:56.943 13:53:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:56.943 13:53:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:56.943 13:53:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:56.943 13:53:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:56.943 13:53:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.943 13:53:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:56.943 13:53:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:56.943 13:53:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:56.943 13:53:37 -- common/autotest_common.sh@10 -- # set +x 00:19:58.850 13:53:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:58.850 13:53:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:58.850 13:53:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:58.850 13:53:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:58.850 13:53:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:58.850 13:53:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:58.850 13:53:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:58.850 13:53:39 -- nvmf/common.sh@294 -- # net_devs=() 00:19:58.850 13:53:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:58.850 13:53:39 -- nvmf/common.sh@295 -- # e810=() 00:19:58.850 13:53:39 -- nvmf/common.sh@295 -- # local -ga e810 00:19:58.850 13:53:39 -- nvmf/common.sh@296 -- # x722=() 00:19:58.850 13:53:39 -- nvmf/common.sh@296 -- # local -ga x722 00:19:58.850 13:53:39 -- nvmf/common.sh@297 -- # mlx=() 00:19:58.850 13:53:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:58.850 13:53:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:58.850 13:53:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:58.850 13:53:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:58.850 13:53:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.850 13:53:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:58.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:58.850 13:53:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.850 13:53:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:58.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:58.850 13:53:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.850 13:53:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.850 13:53:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.850 13:53:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:58.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:58.850 13:53:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.850 13:53:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.850 13:53:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.850 13:53:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.850 13:53:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:58.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:58.850 13:53:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.850 13:53:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:58.850 13:53:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:58.850 13:53:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:58.850 13:53:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:58.850 13:53:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:58.850 13:53:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:58.850 13:53:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:58.850 13:53:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:58.850 13:53:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:58.850 13:53:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:58.850 13:53:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:58.850 13:53:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:58.850 13:53:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:58.850 13:53:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:58.850 13:53:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:59.109 13:53:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:59.109 13:53:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:59.109 13:53:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:59.109 13:53:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:59.109 13:53:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:59.109 13:53:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:59.109 13:53:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:59.109 13:53:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:59.109 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:59.109 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.334 ms 00:19:59.109 00:19:59.109 --- 10.0.0.2 ping statistics --- 00:19:59.109 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.109 rtt min/avg/max/mdev = 0.334/0.334/0.334/0.000 ms 00:19:59.109 13:53:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:59.109 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:59.109 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:19:59.109 00:19:59.109 --- 10.0.0.1 ping statistics --- 00:19:59.109 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.109 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:19:59.109 13:53:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:59.109 13:53:39 -- nvmf/common.sh@410 -- # return 0 00:19:59.109 13:53:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:59.109 13:53:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:59.109 13:53:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:59.109 13:53:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:59.109 13:53:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:59.109 13:53:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:59.109 13:53:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:59.109 13:53:39 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:59.109 13:53:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:59.109 13:53:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:59.109 13:53:39 -- common/autotest_common.sh@10 -- # set +x 00:19:59.109 13:53:39 -- nvmf/common.sh@469 -- # nvmfpid=2322746 00:19:59.109 13:53:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:59.109 13:53:39 -- nvmf/common.sh@470 -- # waitforlisten 2322746 00:19:59.109 13:53:39 -- common/autotest_common.sh@829 -- # '[' -z 2322746 ']' 00:19:59.109 13:53:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.109 13:53:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.109 13:53:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.109 13:53:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.109 13:53:39 -- common/autotest_common.sh@10 -- # set +x 00:19:59.109 [2024-11-29 13:53:39.330795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.109 [2024-11-29 13:53:39.330883] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:59.367 [2024-11-29 13:53:39.404914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.367 [2024-11-29 13:53:39.488307] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:59.367 [2024-11-29 13:53:39.488484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.367 [2024-11-29 13:53:39.488504] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.367 [2024-11-29 13:53:39.488516] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.367 [2024-11-29 13:53:39.488611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:59.367 [2024-11-29 13:53:39.488666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:59.367 [2024-11-29 13:53:39.488717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:59.367 [2024-11-29 13:53:39.488719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:00.304 13:53:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:00.304 13:53:40 -- common/autotest_common.sh@862 -- # return 0 00:20:00.304 13:53:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:00.304 13:53:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 13:53:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:00.304 13:53:40 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:00.304 13:53:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 [2024-11-29 13:53:40.366122] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:00.304 13:53:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.304 13:53:40 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:00.304 13:53:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 Malloc0 00:20:00.304 13:53:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.304 13:53:40 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:00.304 13:53:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 13:53:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.304 13:53:40 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:00.304 13:53:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 13:53:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.304 13:53:40 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:00.304 13:53:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.304 13:53:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.304 [2024-11-29 13:53:40.404745] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:00.304 13:53:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.304 13:53:40 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:00.304 13:53:40 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:00.304 13:53:40 -- nvmf/common.sh@520 -- # config=() 00:20:00.304 13:53:40 -- nvmf/common.sh@520 -- # local subsystem config 00:20:00.304 13:53:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:00.304 13:53:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:00.304 { 00:20:00.304 "params": { 00:20:00.304 "name": "Nvme$subsystem", 00:20:00.304 "trtype": "$TEST_TRANSPORT", 00:20:00.304 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:00.304 "adrfam": "ipv4", 00:20:00.304 "trsvcid": "$NVMF_PORT", 00:20:00.304 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:00.304 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:00.304 "hdgst": ${hdgst:-false}, 00:20:00.304 "ddgst": ${ddgst:-false} 00:20:00.304 }, 00:20:00.304 "method": "bdev_nvme_attach_controller" 00:20:00.304 } 00:20:00.304 EOF 00:20:00.304 )") 00:20:00.304 13:53:40 -- nvmf/common.sh@542 -- # cat 00:20:00.304 13:53:40 -- nvmf/common.sh@544 -- # jq . 00:20:00.304 13:53:40 -- nvmf/common.sh@545 -- # IFS=, 00:20:00.304 13:53:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:00.304 "params": { 00:20:00.304 "name": "Nvme1", 00:20:00.304 "trtype": "tcp", 00:20:00.304 "traddr": "10.0.0.2", 00:20:00.304 "adrfam": "ipv4", 00:20:00.304 "trsvcid": "4420", 00:20:00.304 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:00.304 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:00.304 "hdgst": false, 00:20:00.304 "ddgst": false 00:20:00.304 }, 00:20:00.304 "method": "bdev_nvme_attach_controller" 00:20:00.304 }' 00:20:00.304 [2024-11-29 13:53:40.450606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:00.304 [2024-11-29 13:53:40.450673] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2322907 ] 00:20:00.304 [2024-11-29 13:53:40.517274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:00.563 [2024-11-29 13:53:40.605240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:00.563 [2024-11-29 13:53:40.605293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:00.563 [2024-11-29 13:53:40.605296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:00.821 [2024-11-29 13:53:40.880560] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:00.821 [2024-11-29 13:53:40.880613] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:00.821 I/O targets: 00:20:00.821 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:00.821 00:20:00.821 00:20:00.821 CUnit - A unit testing framework for C - Version 2.1-3 00:20:00.821 http://cunit.sourceforge.net/ 00:20:00.821 00:20:00.821 00:20:00.821 Suite: bdevio tests on: Nvme1n1 00:20:00.821 Test: blockdev write read block ...passed 00:20:00.821 Test: blockdev write zeroes read block ...passed 00:20:00.821 Test: blockdev write zeroes read no split ...passed 00:20:00.821 Test: blockdev write zeroes read split ...passed 00:20:00.821 Test: blockdev write zeroes read split partial ...passed 00:20:00.821 Test: blockdev reset ...[2024-11-29 13:53:41.083813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:00.821 [2024-11-29 13:53:41.083926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x55f150 (9): Bad file descriptor 00:20:01.080 [2024-11-29 13:53:41.179049] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:01.080 passed 00:20:01.080 Test: blockdev write read 8 blocks ...passed 00:20:01.080 Test: blockdev write read size > 128k ...passed 00:20:01.080 Test: blockdev write read invalid size ...passed 00:20:01.080 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:01.080 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:01.080 Test: blockdev write read max offset ...passed 00:20:01.080 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:01.338 Test: blockdev writev readv 8 blocks ...passed 00:20:01.338 Test: blockdev writev readv 30 x 1block ...passed 00:20:01.338 Test: blockdev writev readv block ...passed 00:20:01.338 Test: blockdev writev readv size > 128k ...passed 00:20:01.339 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:01.339 Test: blockdev comparev and writev ...[2024-11-29 13:53:41.434711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.434747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.434771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.434787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.435846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.339 [2024-11-29 13:53:41.435862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:01.339 passed 00:20:01.339 Test: blockdev nvme passthru rw ...passed 00:20:01.339 Test: blockdev nvme passthru vendor specific ...[2024-11-29 13:53:41.519634] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.339 [2024-11-29 13:53:41.519661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.519806] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.339 [2024-11-29 13:53:41.519834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.519972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.339 [2024-11-29 13:53:41.519994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:01.339 [2024-11-29 13:53:41.520138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.339 [2024-11-29 13:53:41.520160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:01.339 passed 00:20:01.339 Test: blockdev nvme admin passthru ...passed 00:20:01.339 Test: blockdev copy ...passed 00:20:01.339 00:20:01.339 Run Summary: Type Total Ran Passed Failed Inactive 00:20:01.339 suites 1 1 n/a 0 0 00:20:01.339 tests 23 23 23 0 0 00:20:01.339 asserts 152 152 152 0 n/a 00:20:01.339 00:20:01.339 Elapsed time = 1.391 seconds 00:20:01.909 13:53:41 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:01.909 13:53:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.909 13:53:41 -- common/autotest_common.sh@10 -- # set +x 00:20:01.909 13:53:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.909 13:53:41 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:01.909 13:53:41 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:01.909 13:53:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:01.909 13:53:41 -- nvmf/common.sh@116 -- # sync 00:20:01.909 13:53:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:01.909 13:53:41 -- nvmf/common.sh@119 -- # set +e 00:20:01.909 13:53:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:01.909 13:53:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:01.909 rmmod nvme_tcp 00:20:01.909 rmmod nvme_fabrics 00:20:01.909 rmmod nvme_keyring 00:20:01.909 13:53:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:01.909 13:53:41 -- nvmf/common.sh@123 -- # set -e 00:20:01.909 13:53:41 -- nvmf/common.sh@124 -- # return 0 00:20:01.909 13:53:41 -- nvmf/common.sh@477 -- # '[' -n 2322746 ']' 00:20:01.909 13:53:41 -- nvmf/common.sh@478 -- # killprocess 2322746 00:20:01.909 13:53:41 -- common/autotest_common.sh@936 -- # '[' -z 2322746 ']' 00:20:01.909 13:53:41 -- common/autotest_common.sh@940 -- # kill -0 2322746 00:20:01.909 13:53:41 -- common/autotest_common.sh@941 -- # uname 00:20:01.909 13:53:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.909 13:53:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2322746 00:20:01.909 13:53:42 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:01.909 13:53:42 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:01.909 13:53:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2322746' 00:20:01.909 killing process with pid 2322746 00:20:01.909 13:53:42 -- common/autotest_common.sh@955 -- # kill 2322746 00:20:01.909 13:53:42 -- common/autotest_common.sh@960 -- # wait 2322746 00:20:02.167 13:53:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:02.167 13:53:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:02.167 13:53:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:02.167 13:53:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:02.167 13:53:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:02.167 13:53:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:02.167 13:53:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:02.167 13:53:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.712 13:53:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:04.712 00:20:04.712 real 0m7.471s 00:20:04.712 user 0m14.886s 00:20:04.712 sys 0m2.619s 00:20:04.712 13:53:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:04.712 13:53:44 -- common/autotest_common.sh@10 -- # set +x 00:20:04.712 ************************************ 00:20:04.712 END TEST nvmf_bdevio_no_huge 00:20:04.712 ************************************ 00:20:04.712 13:53:44 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.712 13:53:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:04.712 13:53:44 -- common/autotest_common.sh@10 -- # set +x 00:20:04.712 ************************************ 00:20:04.712 START TEST nvmf_tls 00:20:04.712 ************************************ 00:20:04.712 13:53:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.712 * Looking for test storage... 00:20:04.712 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:04.712 13:53:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:04.712 13:53:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:04.712 13:53:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:04.712 13:53:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:04.712 13:53:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:04.712 13:53:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:04.712 13:53:44 -- scripts/common.sh@335 -- # IFS=.-: 00:20:04.712 13:53:44 -- scripts/common.sh@335 -- # read -ra ver1 00:20:04.712 13:53:44 -- scripts/common.sh@336 -- # IFS=.-: 00:20:04.712 13:53:44 -- scripts/common.sh@336 -- # read -ra ver2 00:20:04.712 13:53:44 -- scripts/common.sh@337 -- # local 'op=<' 00:20:04.712 13:53:44 -- scripts/common.sh@339 -- # ver1_l=2 00:20:04.712 13:53:44 -- scripts/common.sh@340 -- # ver2_l=1 00:20:04.712 13:53:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:04.712 13:53:44 -- scripts/common.sh@343 -- # case "$op" in 00:20:04.712 13:53:44 -- scripts/common.sh@344 -- # : 1 00:20:04.712 13:53:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:04.712 13:53:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:04.712 13:53:44 -- scripts/common.sh@364 -- # decimal 1 00:20:04.712 13:53:44 -- scripts/common.sh@352 -- # local d=1 00:20:04.712 13:53:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:04.712 13:53:44 -- scripts/common.sh@354 -- # echo 1 00:20:04.712 13:53:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:04.712 13:53:44 -- scripts/common.sh@365 -- # decimal 2 00:20:04.712 13:53:44 -- scripts/common.sh@352 -- # local d=2 00:20:04.712 13:53:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:04.712 13:53:44 -- scripts/common.sh@354 -- # echo 2 00:20:04.712 13:53:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:04.712 13:53:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:04.712 13:53:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:04.712 13:53:44 -- scripts/common.sh@367 -- # return 0 00:20:04.712 13:53:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:04.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.712 --rc genhtml_branch_coverage=1 00:20:04.712 --rc genhtml_function_coverage=1 00:20:04.712 --rc genhtml_legend=1 00:20:04.712 --rc geninfo_all_blocks=1 00:20:04.712 --rc geninfo_unexecuted_blocks=1 00:20:04.712 00:20:04.712 ' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:04.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.712 --rc genhtml_branch_coverage=1 00:20:04.712 --rc genhtml_function_coverage=1 00:20:04.712 --rc genhtml_legend=1 00:20:04.712 --rc geninfo_all_blocks=1 00:20:04.712 --rc geninfo_unexecuted_blocks=1 00:20:04.712 00:20:04.712 ' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:04.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.712 --rc genhtml_branch_coverage=1 00:20:04.712 --rc genhtml_function_coverage=1 00:20:04.712 --rc genhtml_legend=1 00:20:04.712 --rc geninfo_all_blocks=1 00:20:04.712 --rc geninfo_unexecuted_blocks=1 00:20:04.712 00:20:04.712 ' 00:20:04.712 13:53:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:04.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.712 --rc genhtml_branch_coverage=1 00:20:04.713 --rc genhtml_function_coverage=1 00:20:04.713 --rc genhtml_legend=1 00:20:04.713 --rc geninfo_all_blocks=1 00:20:04.713 --rc geninfo_unexecuted_blocks=1 00:20:04.713 00:20:04.713 ' 00:20:04.713 13:53:44 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:04.713 13:53:44 -- nvmf/common.sh@7 -- # uname -s 00:20:04.713 13:53:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:04.713 13:53:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:04.713 13:53:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:04.713 13:53:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:04.713 13:53:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:04.713 13:53:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:04.713 13:53:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:04.713 13:53:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:04.713 13:53:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:04.713 13:53:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:04.713 13:53:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.713 13:53:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.713 13:53:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:04.713 13:53:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:04.713 13:53:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:04.713 13:53:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:04.713 13:53:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:04.713 13:53:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:04.713 13:53:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:04.713 13:53:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.713 13:53:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.713 13:53:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.713 13:53:44 -- paths/export.sh@5 -- # export PATH 00:20:04.713 13:53:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.713 13:53:44 -- nvmf/common.sh@46 -- # : 0 00:20:04.713 13:53:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:04.713 13:53:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:04.713 13:53:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:04.713 13:53:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:04.713 13:53:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:04.713 13:53:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:04.713 13:53:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:04.713 13:53:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:04.713 13:53:44 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:04.713 13:53:44 -- target/tls.sh@71 -- # nvmftestinit 00:20:04.713 13:53:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:04.713 13:53:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:04.713 13:53:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:04.713 13:53:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:04.713 13:53:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:04.713 13:53:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:04.713 13:53:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:04.713 13:53:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.713 13:53:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:04.713 13:53:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:04.713 13:53:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:04.713 13:53:44 -- common/autotest_common.sh@10 -- # set +x 00:20:06.617 13:53:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:06.617 13:53:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:06.617 13:53:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:06.617 13:53:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:06.617 13:53:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:06.617 13:53:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:06.617 13:53:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:06.617 13:53:46 -- nvmf/common.sh@294 -- # net_devs=() 00:20:06.617 13:53:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:06.617 13:53:46 -- nvmf/common.sh@295 -- # e810=() 00:20:06.617 13:53:46 -- nvmf/common.sh@295 -- # local -ga e810 00:20:06.617 13:53:46 -- nvmf/common.sh@296 -- # x722=() 00:20:06.617 13:53:46 -- nvmf/common.sh@296 -- # local -ga x722 00:20:06.617 13:53:46 -- nvmf/common.sh@297 -- # mlx=() 00:20:06.617 13:53:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:06.617 13:53:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:06.617 13:53:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.617 13:53:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:06.617 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:06.617 13:53:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.617 13:53:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:06.617 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:06.617 13:53:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.617 13:53:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.617 13:53:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.617 13:53:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:06.617 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:06.617 13:53:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.617 13:53:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.617 13:53:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.617 13:53:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:06.617 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:06.617 13:53:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:06.617 13:53:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:06.617 13:53:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:06.617 13:53:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:06.617 13:53:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:06.617 13:53:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:06.617 13:53:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:06.617 13:53:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:06.617 13:53:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:06.617 13:53:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:06.617 13:53:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:06.617 13:53:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:06.617 13:53:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:06.617 13:53:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:06.617 13:53:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:06.617 13:53:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:06.617 13:53:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:06.617 13:53:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:06.617 13:53:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:06.617 13:53:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:06.617 13:53:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:06.617 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:06.617 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:20:06.617 00:20:06.617 --- 10.0.0.2 ping statistics --- 00:20:06.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.617 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:20:06.617 13:53:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:06.617 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:06.617 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:20:06.617 00:20:06.617 --- 10.0.0.1 ping statistics --- 00:20:06.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.617 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:20:06.617 13:53:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:06.617 13:53:46 -- nvmf/common.sh@410 -- # return 0 00:20:06.617 13:53:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:06.617 13:53:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:06.617 13:53:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:06.617 13:53:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:06.617 13:53:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:06.617 13:53:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:06.617 13:53:46 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:06.617 13:53:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:06.617 13:53:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:06.617 13:53:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.617 13:53:46 -- nvmf/common.sh@469 -- # nvmfpid=2325124 00:20:06.617 13:53:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:06.617 13:53:46 -- nvmf/common.sh@470 -- # waitforlisten 2325124 00:20:06.617 13:53:46 -- common/autotest_common.sh@829 -- # '[' -z 2325124 ']' 00:20:06.617 13:53:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:06.617 13:53:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:06.617 13:53:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:06.617 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:06.617 13:53:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:06.617 13:53:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.876 [2024-11-29 13:53:46.920544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:06.876 [2024-11-29 13:53:46.920619] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:06.876 EAL: No free 2048 kB hugepages reported on node 1 00:20:06.876 [2024-11-29 13:53:46.993390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.876 [2024-11-29 13:53:47.082494] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:06.876 [2024-11-29 13:53:47.082658] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:06.876 [2024-11-29 13:53:47.082692] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:06.876 [2024-11-29 13:53:47.082706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:06.876 [2024-11-29 13:53:47.082735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:06.876 13:53:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:06.876 13:53:47 -- common/autotest_common.sh@862 -- # return 0 00:20:06.876 13:53:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:06.876 13:53:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:06.876 13:53:47 -- common/autotest_common.sh@10 -- # set +x 00:20:06.876 13:53:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.876 13:53:47 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:06.876 13:53:47 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:07.134 true 00:20:07.134 13:53:47 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.134 13:53:47 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:07.392 13:53:47 -- target/tls.sh@82 -- # version=0 00:20:07.392 13:53:47 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:07.392 13:53:47 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:07.651 13:53:47 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.651 13:53:47 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:07.909 13:53:48 -- target/tls.sh@90 -- # version=13 00:20:07.909 13:53:48 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:07.909 13:53:48 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:08.169 13:53:48 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.169 13:53:48 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:08.428 13:53:48 -- target/tls.sh@98 -- # version=7 00:20:08.428 13:53:48 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:08.428 13:53:48 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.428 13:53:48 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:08.686 13:53:48 -- target/tls.sh@105 -- # ktls=false 00:20:08.686 13:53:48 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:08.686 13:53:48 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:09.256 13:53:49 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:09.256 13:53:49 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:09.256 13:53:49 -- target/tls.sh@113 -- # ktls=true 00:20:09.256 13:53:49 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:09.256 13:53:49 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:09.515 13:53:49 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:09.515 13:53:49 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:09.773 13:53:50 -- target/tls.sh@121 -- # ktls=false 00:20:09.773 13:53:50 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:09.773 13:53:50 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:09.773 13:53:50 -- target/tls.sh@49 -- # local key hash crc 00:20:09.773 13:53:50 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:09.773 13:53:50 -- target/tls.sh@51 -- # hash=01 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # tail -c8 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # head -c 4 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # crc='p$H�' 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.773 13:53:50 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.773 13:53:50 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:09.773 13:53:50 -- target/tls.sh@49 -- # local key hash crc 00:20:09.773 13:53:50 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:09.773 13:53:50 -- target/tls.sh@51 -- # hash=01 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # tail -c8 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # head -c 4 00:20:09.773 13:53:50 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:09.773 13:53:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.773 13:53:50 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.773 13:53:50 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.773 13:53:50 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.773 13:53:50 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.773 13:53:50 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.773 13:53:50 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.773 13:53:50 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.773 13:53:50 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:10.031 13:53:50 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:10.598 13:53:50 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.598 13:53:50 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.598 13:53:50 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:10.858 [2024-11-29 13:53:50.894890] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:10.858 13:53:50 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:11.117 13:53:51 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:11.376 [2024-11-29 13:53:51.400278] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:11.377 [2024-11-29 13:53:51.400589] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:11.377 13:53:51 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:11.636 malloc0 00:20:11.636 13:53:51 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:11.894 13:53:51 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.153 13:53:52 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.153 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.140 Initializing NVMe Controllers 00:20:22.140 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:22.140 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:22.140 Initialization complete. Launching workers. 00:20:22.140 ======================================================== 00:20:22.140 Latency(us) 00:20:22.140 Device Information : IOPS MiB/s Average min max 00:20:22.140 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7887.58 30.81 8116.42 1140.88 10210.99 00:20:22.140 ======================================================== 00:20:22.140 Total : 7887.58 30.81 8116.42 1140.88 10210.99 00:20:22.140 00:20:22.140 13:54:02 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.140 13:54:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:22.140 13:54:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:22.140 13:54:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:22.140 13:54:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:22.140 13:54:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:22.140 13:54:02 -- target/tls.sh@28 -- # bdevperf_pid=2327197 00:20:22.140 13:54:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:22.140 13:54:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:22.140 13:54:02 -- target/tls.sh@31 -- # waitforlisten 2327197 /var/tmp/bdevperf.sock 00:20:22.140 13:54:02 -- common/autotest_common.sh@829 -- # '[' -z 2327197 ']' 00:20:22.140 13:54:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:22.140 13:54:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.140 13:54:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:22.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:22.140 13:54:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.140 13:54:02 -- common/autotest_common.sh@10 -- # set +x 00:20:22.140 [2024-11-29 13:54:02.382402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:22.140 [2024-11-29 13:54:02.382497] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2327197 ] 00:20:22.140 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.399 [2024-11-29 13:54:02.448983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:22.399 [2024-11-29 13:54:02.537355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.333 13:54:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:23.333 13:54:03 -- common/autotest_common.sh@862 -- # return 0 00:20:23.333 13:54:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:23.592 [2024-11-29 13:54:03.620239] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:23.592 TLSTESTn1 00:20:23.592 13:54:03 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:23.592 Running I/O for 10 seconds... 00:20:33.676 00:20:33.676 Latency(us) 00:20:33.676 [2024-11-29T12:54:13.958Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.676 [2024-11-29T12:54:13.958Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:33.676 Verification LBA range: start 0x0 length 0x2000 00:20:33.676 TLSTESTn1 : 10.03 4654.26 18.18 0.00 0.00 27458.56 4369.07 45632.47 00:20:33.676 [2024-11-29T12:54:13.958Z] =================================================================================================================== 00:20:33.676 [2024-11-29T12:54:13.958Z] Total : 4654.26 18.18 0.00 0.00 27458.56 4369.07 45632.47 00:20:33.676 0 00:20:33.676 13:54:13 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:33.676 13:54:13 -- target/tls.sh@45 -- # killprocess 2327197 00:20:33.676 13:54:13 -- common/autotest_common.sh@936 -- # '[' -z 2327197 ']' 00:20:33.676 13:54:13 -- common/autotest_common.sh@940 -- # kill -0 2327197 00:20:33.676 13:54:13 -- common/autotest_common.sh@941 -- # uname 00:20:33.676 13:54:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.676 13:54:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2327197 00:20:33.676 13:54:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:33.676 13:54:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:33.676 13:54:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2327197' 00:20:33.676 killing process with pid 2327197 00:20:33.676 13:54:13 -- common/autotest_common.sh@955 -- # kill 2327197 00:20:33.676 Received shutdown signal, test time was about 10.000000 seconds 00:20:33.676 00:20:33.676 Latency(us) 00:20:33.676 [2024-11-29T12:54:13.958Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.676 [2024-11-29T12:54:13.958Z] =================================================================================================================== 00:20:33.676 [2024-11-29T12:54:13.958Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:33.676 13:54:13 -- common/autotest_common.sh@960 -- # wait 2327197 00:20:33.935 13:54:14 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.935 13:54:14 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.935 13:54:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.935 13:54:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.935 13:54:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.935 13:54:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.935 13:54:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.935 13:54:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.935 13:54:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.935 13:54:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.935 13:54:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.935 13:54:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:33.935 13:54:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.935 13:54:14 -- target/tls.sh@28 -- # bdevperf_pid=2329079 00:20:33.935 13:54:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.935 13:54:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.935 13:54:14 -- target/tls.sh@31 -- # waitforlisten 2329079 /var/tmp/bdevperf.sock 00:20:33.935 13:54:14 -- common/autotest_common.sh@829 -- # '[' -z 2329079 ']' 00:20:33.935 13:54:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.935 13:54:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.935 13:54:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.935 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.935 13:54:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.935 13:54:14 -- common/autotest_common.sh@10 -- # set +x 00:20:33.935 [2024-11-29 13:54:14.199586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:33.935 [2024-11-29 13:54:14.199664] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329079 ] 00:20:34.194 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.194 [2024-11-29 13:54:14.260302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:34.194 [2024-11-29 13:54:14.343769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.130 13:54:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:35.130 13:54:15 -- common/autotest_common.sh@862 -- # return 0 00:20:35.130 13:54:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:35.388 [2024-11-29 13:54:15.463039] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:35.388 [2024-11-29 13:54:15.469547] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:35.388 [2024-11-29 13:54:15.469813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a93cf0 (107): Transport endpoint is not connected 00:20:35.388 [2024-11-29 13:54:15.470803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a93cf0 (9): Bad file descriptor 00:20:35.388 [2024-11-29 13:54:15.471804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:35.388 [2024-11-29 13:54:15.471825] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:35.388 [2024-11-29 13:54:15.471854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:35.388 request: 00:20:35.388 { 00:20:35.388 "name": "TLSTEST", 00:20:35.388 "trtype": "tcp", 00:20:35.388 "traddr": "10.0.0.2", 00:20:35.388 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:35.388 "adrfam": "ipv4", 00:20:35.388 "trsvcid": "4420", 00:20:35.388 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.388 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:35.388 "method": "bdev_nvme_attach_controller", 00:20:35.388 "req_id": 1 00:20:35.388 } 00:20:35.388 Got JSON-RPC error response 00:20:35.388 response: 00:20:35.388 { 00:20:35.388 "code": -32602, 00:20:35.388 "message": "Invalid parameters" 00:20:35.388 } 00:20:35.388 13:54:15 -- target/tls.sh@36 -- # killprocess 2329079 00:20:35.388 13:54:15 -- common/autotest_common.sh@936 -- # '[' -z 2329079 ']' 00:20:35.388 13:54:15 -- common/autotest_common.sh@940 -- # kill -0 2329079 00:20:35.388 13:54:15 -- common/autotest_common.sh@941 -- # uname 00:20:35.388 13:54:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.388 13:54:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329079 00:20:35.388 13:54:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:35.388 13:54:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:35.388 13:54:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329079' 00:20:35.388 killing process with pid 2329079 00:20:35.388 13:54:15 -- common/autotest_common.sh@955 -- # kill 2329079 00:20:35.388 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.388 00:20:35.388 Latency(us) 00:20:35.388 [2024-11-29T12:54:15.670Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.388 [2024-11-29T12:54:15.670Z] =================================================================================================================== 00:20:35.388 [2024-11-29T12:54:15.670Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:35.388 13:54:15 -- common/autotest_common.sh@960 -- # wait 2329079 00:20:35.647 13:54:15 -- target/tls.sh@37 -- # return 1 00:20:35.647 13:54:15 -- common/autotest_common.sh@653 -- # es=1 00:20:35.647 13:54:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:35.647 13:54:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:35.647 13:54:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:35.647 13:54:15 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.647 13:54:15 -- common/autotest_common.sh@650 -- # local es=0 00:20:35.647 13:54:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.647 13:54:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:35.647 13:54:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.647 13:54:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:35.647 13:54:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.647 13:54:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.647 13:54:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:35.647 13:54:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:35.647 13:54:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:35.647 13:54:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:35.647 13:54:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:35.647 13:54:15 -- target/tls.sh@28 -- # bdevperf_pid=2329346 00:20:35.647 13:54:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.647 13:54:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.647 13:54:15 -- target/tls.sh@31 -- # waitforlisten 2329346 /var/tmp/bdevperf.sock 00:20:35.647 13:54:15 -- common/autotest_common.sh@829 -- # '[' -z 2329346 ']' 00:20:35.647 13:54:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.647 13:54:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.647 13:54:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.647 13:54:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.647 13:54:15 -- common/autotest_common.sh@10 -- # set +x 00:20:35.647 [2024-11-29 13:54:15.783841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:35.647 [2024-11-29 13:54:15.783918] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329346 ] 00:20:35.647 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.647 [2024-11-29 13:54:15.843018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.647 [2024-11-29 13:54:15.926653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.585 13:54:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.585 13:54:16 -- common/autotest_common.sh@862 -- # return 0 00:20:36.585 13:54:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.843 [2024-11-29 13:54:17.078533] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:36.843 [2024-11-29 13:54:17.083919] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.843 [2024-11-29 13:54:17.083956] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.843 [2024-11-29 13:54:17.084003] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:36.843 [2024-11-29 13:54:17.084434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb7cf0 (107): Transport endpoint is not connected 00:20:36.843 [2024-11-29 13:54:17.085420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb7cf0 (9): Bad file descriptor 00:20:36.843 [2024-11-29 13:54:17.086420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:36.843 [2024-11-29 13:54:17.086443] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:36.843 [2024-11-29 13:54:17.086458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:36.843 request: 00:20:36.843 { 00:20:36.843 "name": "TLSTEST", 00:20:36.843 "trtype": "tcp", 00:20:36.843 "traddr": "10.0.0.2", 00:20:36.843 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:36.843 "adrfam": "ipv4", 00:20:36.843 "trsvcid": "4420", 00:20:36.843 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.843 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:36.843 "method": "bdev_nvme_attach_controller", 00:20:36.843 "req_id": 1 00:20:36.843 } 00:20:36.843 Got JSON-RPC error response 00:20:36.843 response: 00:20:36.843 { 00:20:36.843 "code": -32602, 00:20:36.843 "message": "Invalid parameters" 00:20:36.843 } 00:20:36.843 13:54:17 -- target/tls.sh@36 -- # killprocess 2329346 00:20:36.843 13:54:17 -- common/autotest_common.sh@936 -- # '[' -z 2329346 ']' 00:20:36.843 13:54:17 -- common/autotest_common.sh@940 -- # kill -0 2329346 00:20:36.843 13:54:17 -- common/autotest_common.sh@941 -- # uname 00:20:36.843 13:54:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:36.843 13:54:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329346 00:20:37.102 13:54:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:37.102 13:54:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:37.102 13:54:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329346' 00:20:37.102 killing process with pid 2329346 00:20:37.102 13:54:17 -- common/autotest_common.sh@955 -- # kill 2329346 00:20:37.102 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.102 00:20:37.102 Latency(us) 00:20:37.102 [2024-11-29T12:54:17.384Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.102 [2024-11-29T12:54:17.384Z] =================================================================================================================== 00:20:37.102 [2024-11-29T12:54:17.384Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:37.102 13:54:17 -- common/autotest_common.sh@960 -- # wait 2329346 00:20:37.102 13:54:17 -- target/tls.sh@37 -- # return 1 00:20:37.102 13:54:17 -- common/autotest_common.sh@653 -- # es=1 00:20:37.102 13:54:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:37.102 13:54:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:37.102 13:54:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:37.102 13:54:17 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:37.102 13:54:17 -- common/autotest_common.sh@650 -- # local es=0 00:20:37.102 13:54:17 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:37.102 13:54:17 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:37.102 13:54:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:37.102 13:54:17 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:37.102 13:54:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:37.102 13:54:17 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:37.102 13:54:17 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:37.102 13:54:17 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:37.102 13:54:17 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:37.102 13:54:17 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:37.102 13:54:17 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:37.102 13:54:17 -- target/tls.sh@28 -- # bdevperf_pid=2329504 00:20:37.102 13:54:17 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:37.102 13:54:17 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:37.102 13:54:17 -- target/tls.sh@31 -- # waitforlisten 2329504 /var/tmp/bdevperf.sock 00:20:37.102 13:54:17 -- common/autotest_common.sh@829 -- # '[' -z 2329504 ']' 00:20:37.102 13:54:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:37.102 13:54:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.102 13:54:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:37.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:37.102 13:54:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.102 13:54:17 -- common/autotest_common.sh@10 -- # set +x 00:20:37.362 [2024-11-29 13:54:17.407463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:37.362 [2024-11-29 13:54:17.407542] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329504 ] 00:20:37.362 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.362 [2024-11-29 13:54:17.467155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.362 [2024-11-29 13:54:17.551125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:38.297 13:54:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.297 13:54:18 -- common/autotest_common.sh@862 -- # return 0 00:20:38.297 13:54:18 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:38.557 [2024-11-29 13:54:18.626881] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:38.557 [2024-11-29 13:54:18.637766] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:38.557 [2024-11-29 13:54:18.637799] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:38.557 [2024-11-29 13:54:18.637856] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:38.557 [2024-11-29 13:54:18.638696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2371cf0 (107): Transport endpoint is not connected 00:20:38.557 [2024-11-29 13:54:18.639670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2371cf0 (9): Bad file descriptor 00:20:38.557 [2024-11-29 13:54:18.640684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:38.557 [2024-11-29 13:54:18.640709] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:38.557 [2024-11-29 13:54:18.640724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:38.557 request: 00:20:38.557 { 00:20:38.557 "name": "TLSTEST", 00:20:38.557 "trtype": "tcp", 00:20:38.557 "traddr": "10.0.0.2", 00:20:38.557 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:38.557 "adrfam": "ipv4", 00:20:38.557 "trsvcid": "4420", 00:20:38.557 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:38.557 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:38.557 "method": "bdev_nvme_attach_controller", 00:20:38.557 "req_id": 1 00:20:38.557 } 00:20:38.557 Got JSON-RPC error response 00:20:38.557 response: 00:20:38.557 { 00:20:38.557 "code": -32602, 00:20:38.557 "message": "Invalid parameters" 00:20:38.557 } 00:20:38.557 13:54:18 -- target/tls.sh@36 -- # killprocess 2329504 00:20:38.557 13:54:18 -- common/autotest_common.sh@936 -- # '[' -z 2329504 ']' 00:20:38.557 13:54:18 -- common/autotest_common.sh@940 -- # kill -0 2329504 00:20:38.557 13:54:18 -- common/autotest_common.sh@941 -- # uname 00:20:38.557 13:54:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:38.557 13:54:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329504 00:20:38.557 13:54:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:38.557 13:54:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:38.557 13:54:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329504' 00:20:38.557 killing process with pid 2329504 00:20:38.557 13:54:18 -- common/autotest_common.sh@955 -- # kill 2329504 00:20:38.557 Received shutdown signal, test time was about 10.000000 seconds 00:20:38.557 00:20:38.557 Latency(us) 00:20:38.557 [2024-11-29T12:54:18.839Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:38.557 [2024-11-29T12:54:18.839Z] =================================================================================================================== 00:20:38.557 [2024-11-29T12:54:18.839Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:38.557 13:54:18 -- common/autotest_common.sh@960 -- # wait 2329504 00:20:38.816 13:54:18 -- target/tls.sh@37 -- # return 1 00:20:38.816 13:54:18 -- common/autotest_common.sh@653 -- # es=1 00:20:38.816 13:54:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:38.816 13:54:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:38.816 13:54:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:38.816 13:54:18 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.816 13:54:18 -- common/autotest_common.sh@650 -- # local es=0 00:20:38.816 13:54:18 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.816 13:54:18 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:38.816 13:54:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.816 13:54:18 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:38.816 13:54:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.816 13:54:18 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.816 13:54:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:38.816 13:54:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:38.816 13:54:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:38.816 13:54:18 -- target/tls.sh@23 -- # psk= 00:20:38.816 13:54:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:38.816 13:54:18 -- target/tls.sh@28 -- # bdevperf_pid=2329652 00:20:38.816 13:54:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:38.816 13:54:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:38.816 13:54:18 -- target/tls.sh@31 -- # waitforlisten 2329652 /var/tmp/bdevperf.sock 00:20:38.816 13:54:18 -- common/autotest_common.sh@829 -- # '[' -z 2329652 ']' 00:20:38.816 13:54:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:38.816 13:54:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:38.816 13:54:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:38.816 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:38.816 13:54:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:38.816 13:54:18 -- common/autotest_common.sh@10 -- # set +x 00:20:38.816 [2024-11-29 13:54:18.962999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:38.816 [2024-11-29 13:54:18.963077] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329652 ] 00:20:38.816 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.816 [2024-11-29 13:54:19.022699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.105 [2024-11-29 13:54:19.111010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:40.042 13:54:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:40.042 13:54:19 -- common/autotest_common.sh@862 -- # return 0 00:20:40.042 13:54:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:40.042 [2024-11-29 13:54:20.272214] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:40.042 [2024-11-29 13:54:20.274096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x241b720 (9): Bad file descriptor 00:20:40.042 [2024-11-29 13:54:20.275093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:40.043 [2024-11-29 13:54:20.275112] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:40.043 [2024-11-29 13:54:20.275140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:40.043 request: 00:20:40.043 { 00:20:40.043 "name": "TLSTEST", 00:20:40.043 "trtype": "tcp", 00:20:40.043 "traddr": "10.0.0.2", 00:20:40.043 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:40.043 "adrfam": "ipv4", 00:20:40.043 "trsvcid": "4420", 00:20:40.043 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:40.043 "method": "bdev_nvme_attach_controller", 00:20:40.043 "req_id": 1 00:20:40.043 } 00:20:40.043 Got JSON-RPC error response 00:20:40.043 response: 00:20:40.043 { 00:20:40.043 "code": -32602, 00:20:40.043 "message": "Invalid parameters" 00:20:40.043 } 00:20:40.043 13:54:20 -- target/tls.sh@36 -- # killprocess 2329652 00:20:40.043 13:54:20 -- common/autotest_common.sh@936 -- # '[' -z 2329652 ']' 00:20:40.043 13:54:20 -- common/autotest_common.sh@940 -- # kill -0 2329652 00:20:40.043 13:54:20 -- common/autotest_common.sh@941 -- # uname 00:20:40.043 13:54:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:40.043 13:54:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329652 00:20:40.301 13:54:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:40.301 13:54:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:40.301 13:54:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329652' 00:20:40.301 killing process with pid 2329652 00:20:40.301 13:54:20 -- common/autotest_common.sh@955 -- # kill 2329652 00:20:40.301 Received shutdown signal, test time was about 10.000000 seconds 00:20:40.301 00:20:40.301 Latency(us) 00:20:40.301 [2024-11-29T12:54:20.583Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:40.301 [2024-11-29T12:54:20.583Z] =================================================================================================================== 00:20:40.301 [2024-11-29T12:54:20.583Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:40.301 13:54:20 -- common/autotest_common.sh@960 -- # wait 2329652 00:20:40.301 13:54:20 -- target/tls.sh@37 -- # return 1 00:20:40.301 13:54:20 -- common/autotest_common.sh@653 -- # es=1 00:20:40.301 13:54:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:40.301 13:54:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:40.301 13:54:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:40.301 13:54:20 -- target/tls.sh@167 -- # killprocess 2325124 00:20:40.301 13:54:20 -- common/autotest_common.sh@936 -- # '[' -z 2325124 ']' 00:20:40.301 13:54:20 -- common/autotest_common.sh@940 -- # kill -0 2325124 00:20:40.301 13:54:20 -- common/autotest_common.sh@941 -- # uname 00:20:40.301 13:54:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:40.301 13:54:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2325124 00:20:40.560 13:54:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:40.560 13:54:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:40.560 13:54:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2325124' 00:20:40.560 killing process with pid 2325124 00:20:40.560 13:54:20 -- common/autotest_common.sh@955 -- # kill 2325124 00:20:40.560 13:54:20 -- common/autotest_common.sh@960 -- # wait 2325124 00:20:40.560 13:54:20 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:40.560 13:54:20 -- target/tls.sh@49 -- # local key hash crc 00:20:40.560 13:54:20 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:40.560 13:54:20 -- target/tls.sh@51 -- # hash=02 00:20:40.560 13:54:20 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:40.560 13:54:20 -- target/tls.sh@52 -- # gzip -1 -c 00:20:40.560 13:54:20 -- target/tls.sh@52 -- # tail -c8 00:20:40.560 13:54:20 -- target/tls.sh@52 -- # head -c 4 00:20:40.560 13:54:20 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:40.560 13:54:20 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:40.560 13:54:20 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:40.560 13:54:20 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.560 13:54:20 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.560 13:54:20 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.560 13:54:20 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.560 13:54:20 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.818 13:54:20 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:40.818 13:54:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:40.818 13:54:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:40.818 13:54:20 -- common/autotest_common.sh@10 -- # set +x 00:20:40.818 13:54:20 -- nvmf/common.sh@469 -- # nvmfpid=2329945 00:20:40.818 13:54:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:40.818 13:54:20 -- nvmf/common.sh@470 -- # waitforlisten 2329945 00:20:40.818 13:54:20 -- common/autotest_common.sh@829 -- # '[' -z 2329945 ']' 00:20:40.818 13:54:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:40.818 13:54:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.818 13:54:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:40.818 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:40.818 13:54:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.818 13:54:20 -- common/autotest_common.sh@10 -- # set +x 00:20:40.818 [2024-11-29 13:54:20.892544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:40.819 [2024-11-29 13:54:20.892639] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:40.819 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.819 [2024-11-29 13:54:20.957681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.819 [2024-11-29 13:54:21.040080] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:40.819 [2024-11-29 13:54:21.040234] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:40.819 [2024-11-29 13:54:21.040250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:40.819 [2024-11-29 13:54:21.040261] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:40.819 [2024-11-29 13:54:21.040293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:41.770 13:54:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:41.770 13:54:21 -- common/autotest_common.sh@862 -- # return 0 00:20:41.770 13:54:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:41.770 13:54:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:41.770 13:54:21 -- common/autotest_common.sh@10 -- # set +x 00:20:41.770 13:54:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:41.770 13:54:21 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.770 13:54:21 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.770 13:54:21 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:42.031 [2024-11-29 13:54:22.161343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:42.031 13:54:22 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:42.289 13:54:22 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:42.547 [2024-11-29 13:54:22.767045] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:42.547 [2024-11-29 13:54:22.767304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:42.547 13:54:22 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:42.805 malloc0 00:20:42.805 13:54:23 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:43.064 13:54:23 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:43.632 13:54:23 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:43.632 13:54:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:43.632 13:54:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:43.632 13:54:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:43.632 13:54:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:43.632 13:54:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:43.632 13:54:23 -- target/tls.sh@28 -- # bdevperf_pid=2330329 00:20:43.632 13:54:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:43.632 13:54:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:43.632 13:54:23 -- target/tls.sh@31 -- # waitforlisten 2330329 /var/tmp/bdevperf.sock 00:20:43.632 13:54:23 -- common/autotest_common.sh@829 -- # '[' -z 2330329 ']' 00:20:43.632 13:54:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:43.632 13:54:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:43.632 13:54:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:43.632 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:43.632 13:54:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:43.632 13:54:23 -- common/autotest_common.sh@10 -- # set +x 00:20:43.632 [2024-11-29 13:54:23.659582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:43.632 [2024-11-29 13:54:23.659660] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2330329 ] 00:20:43.632 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.632 [2024-11-29 13:54:23.719037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.632 [2024-11-29 13:54:23.805089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:44.569 13:54:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:44.569 13:54:24 -- common/autotest_common.sh@862 -- # return 0 00:20:44.569 13:54:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:44.827 [2024-11-29 13:54:24.952326] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:44.827 TLSTESTn1 00:20:44.827 13:54:25 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:45.084 Running I/O for 10 seconds... 00:20:55.055 00:20:55.055 Latency(us) 00:20:55.055 [2024-11-29T12:54:35.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.055 [2024-11-29T12:54:35.337Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:55.055 Verification LBA range: start 0x0 length 0x2000 00:20:55.055 TLSTESTn1 : 10.03 4604.81 17.99 0.00 0.00 27752.88 4587.52 45244.11 00:20:55.055 [2024-11-29T12:54:35.337Z] =================================================================================================================== 00:20:55.055 [2024-11-29T12:54:35.337Z] Total : 4604.81 17.99 0.00 0.00 27752.88 4587.52 45244.11 00:20:55.055 0 00:20:55.055 13:54:35 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:55.055 13:54:35 -- target/tls.sh@45 -- # killprocess 2330329 00:20:55.055 13:54:35 -- common/autotest_common.sh@936 -- # '[' -z 2330329 ']' 00:20:55.055 13:54:35 -- common/autotest_common.sh@940 -- # kill -0 2330329 00:20:55.055 13:54:35 -- common/autotest_common.sh@941 -- # uname 00:20:55.055 13:54:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.055 13:54:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2330329 00:20:55.055 13:54:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:55.055 13:54:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:55.055 13:54:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2330329' 00:20:55.055 killing process with pid 2330329 00:20:55.055 13:54:35 -- common/autotest_common.sh@955 -- # kill 2330329 00:20:55.055 Received shutdown signal, test time was about 10.000000 seconds 00:20:55.055 00:20:55.055 Latency(us) 00:20:55.055 [2024-11-29T12:54:35.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.055 [2024-11-29T12:54:35.337Z] =================================================================================================================== 00:20:55.055 [2024-11-29T12:54:35.337Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:55.055 13:54:35 -- common/autotest_common.sh@960 -- # wait 2330329 00:20:55.312 13:54:35 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.312 13:54:35 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.312 13:54:35 -- common/autotest_common.sh@650 -- # local es=0 00:20:55.312 13:54:35 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.312 13:54:35 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:55.312 13:54:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.312 13:54:35 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:55.312 13:54:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.312 13:54:35 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.312 13:54:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:55.312 13:54:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:55.312 13:54:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:55.312 13:54:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:55.312 13:54:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:55.312 13:54:35 -- target/tls.sh@28 -- # bdevperf_pid=2331735 00:20:55.312 13:54:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:55.312 13:54:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:55.312 13:54:35 -- target/tls.sh@31 -- # waitforlisten 2331735 /var/tmp/bdevperf.sock 00:20:55.312 13:54:35 -- common/autotest_common.sh@829 -- # '[' -z 2331735 ']' 00:20:55.312 13:54:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:55.312 13:54:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.312 13:54:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:55.312 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:55.312 13:54:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.312 13:54:35 -- common/autotest_common.sh@10 -- # set +x 00:20:55.312 [2024-11-29 13:54:35.507333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:55.312 [2024-11-29 13:54:35.507427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2331735 ] 00:20:55.312 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.312 [2024-11-29 13:54:35.565582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.571 [2024-11-29 13:54:35.649313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:56.506 13:54:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.506 13:54:36 -- common/autotest_common.sh@862 -- # return 0 00:20:56.506 13:54:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.506 [2024-11-29 13:54:36.766777] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:56.506 [2024-11-29 13:54:36.766839] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:56.506 request: 00:20:56.506 { 00:20:56.506 "name": "TLSTEST", 00:20:56.506 "trtype": "tcp", 00:20:56.506 "traddr": "10.0.0.2", 00:20:56.506 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:56.506 "adrfam": "ipv4", 00:20:56.506 "trsvcid": "4420", 00:20:56.506 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:56.506 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:56.506 "method": "bdev_nvme_attach_controller", 00:20:56.506 "req_id": 1 00:20:56.506 } 00:20:56.506 Got JSON-RPC error response 00:20:56.506 response: 00:20:56.506 { 00:20:56.506 "code": -22, 00:20:56.506 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:56.506 } 00:20:56.765 13:54:36 -- target/tls.sh@36 -- # killprocess 2331735 00:20:56.765 13:54:36 -- common/autotest_common.sh@936 -- # '[' -z 2331735 ']' 00:20:56.765 13:54:36 -- common/autotest_common.sh@940 -- # kill -0 2331735 00:20:56.765 13:54:36 -- common/autotest_common.sh@941 -- # uname 00:20:56.765 13:54:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.765 13:54:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2331735 00:20:56.765 13:54:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:56.765 13:54:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:56.765 13:54:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2331735' 00:20:56.765 killing process with pid 2331735 00:20:56.765 13:54:36 -- common/autotest_common.sh@955 -- # kill 2331735 00:20:56.765 Received shutdown signal, test time was about 10.000000 seconds 00:20:56.765 00:20:56.765 Latency(us) 00:20:56.765 [2024-11-29T12:54:37.047Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.765 [2024-11-29T12:54:37.047Z] =================================================================================================================== 00:20:56.765 [2024-11-29T12:54:37.047Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:56.765 13:54:36 -- common/autotest_common.sh@960 -- # wait 2331735 00:20:56.765 13:54:37 -- target/tls.sh@37 -- # return 1 00:20:56.765 13:54:37 -- common/autotest_common.sh@653 -- # es=1 00:20:56.765 13:54:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:56.765 13:54:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:56.765 13:54:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:56.765 13:54:37 -- target/tls.sh@183 -- # killprocess 2329945 00:20:56.765 13:54:37 -- common/autotest_common.sh@936 -- # '[' -z 2329945 ']' 00:20:56.765 13:54:37 -- common/autotest_common.sh@940 -- # kill -0 2329945 00:20:57.024 13:54:37 -- common/autotest_common.sh@941 -- # uname 00:20:57.024 13:54:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:57.024 13:54:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2329945 00:20:57.024 13:54:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:57.024 13:54:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:57.024 13:54:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2329945' 00:20:57.024 killing process with pid 2329945 00:20:57.024 13:54:37 -- common/autotest_common.sh@955 -- # kill 2329945 00:20:57.024 13:54:37 -- common/autotest_common.sh@960 -- # wait 2329945 00:20:57.282 13:54:37 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:57.282 13:54:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:57.282 13:54:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:57.282 13:54:37 -- common/autotest_common.sh@10 -- # set +x 00:20:57.282 13:54:37 -- nvmf/common.sh@469 -- # nvmfpid=2332013 00:20:57.283 13:54:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:57.283 13:54:37 -- nvmf/common.sh@470 -- # waitforlisten 2332013 00:20:57.283 13:54:37 -- common/autotest_common.sh@829 -- # '[' -z 2332013 ']' 00:20:57.283 13:54:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:57.283 13:54:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:57.283 13:54:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:57.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:57.283 13:54:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:57.283 13:54:37 -- common/autotest_common.sh@10 -- # set +x 00:20:57.283 [2024-11-29 13:54:37.366019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:57.283 [2024-11-29 13:54:37.366089] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:57.283 EAL: No free 2048 kB hugepages reported on node 1 00:20:57.283 [2024-11-29 13:54:37.432970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:57.283 [2024-11-29 13:54:37.521146] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:57.283 [2024-11-29 13:54:37.521313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:57.283 [2024-11-29 13:54:37.521333] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:57.283 [2024-11-29 13:54:37.521347] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:57.283 [2024-11-29 13:54:37.521377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:58.222 13:54:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:58.222 13:54:38 -- common/autotest_common.sh@862 -- # return 0 00:20:58.222 13:54:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:58.222 13:54:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:58.222 13:54:38 -- common/autotest_common.sh@10 -- # set +x 00:20:58.222 13:54:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:58.222 13:54:38 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.222 13:54:38 -- common/autotest_common.sh@650 -- # local es=0 00:20:58.222 13:54:38 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.222 13:54:38 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:58.222 13:54:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:58.222 13:54:38 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:58.222 13:54:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:58.222 13:54:38 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.222 13:54:38 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.222 13:54:38 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:58.481 [2024-11-29 13:54:38.627908] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:58.481 13:54:38 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:58.739 13:54:38 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:58.995 [2024-11-29 13:54:39.121237] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:58.995 [2024-11-29 13:54:39.121505] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:58.995 13:54:39 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:59.251 malloc0 00:20:59.251 13:54:39 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:59.507 13:54:39 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:59.763 [2024-11-29 13:54:39.870969] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:59.763 [2024-11-29 13:54:39.871008] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:59.763 [2024-11-29 13:54:39.871033] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:59.763 request: 00:20:59.763 { 00:20:59.763 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.763 "host": "nqn.2016-06.io.spdk:host1", 00:20:59.763 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:59.763 "method": "nvmf_subsystem_add_host", 00:20:59.763 "req_id": 1 00:20:59.763 } 00:20:59.763 Got JSON-RPC error response 00:20:59.763 response: 00:20:59.763 { 00:20:59.763 "code": -32603, 00:20:59.763 "message": "Internal error" 00:20:59.763 } 00:20:59.763 13:54:39 -- common/autotest_common.sh@653 -- # es=1 00:20:59.763 13:54:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:59.763 13:54:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:59.763 13:54:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:59.763 13:54:39 -- target/tls.sh@189 -- # killprocess 2332013 00:20:59.763 13:54:39 -- common/autotest_common.sh@936 -- # '[' -z 2332013 ']' 00:20:59.763 13:54:39 -- common/autotest_common.sh@940 -- # kill -0 2332013 00:20:59.763 13:54:39 -- common/autotest_common.sh@941 -- # uname 00:20:59.763 13:54:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:59.763 13:54:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332013 00:20:59.763 13:54:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:59.763 13:54:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:59.763 13:54:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332013' 00:20:59.763 killing process with pid 2332013 00:20:59.763 13:54:39 -- common/autotest_common.sh@955 -- # kill 2332013 00:20:59.763 13:54:39 -- common/autotest_common.sh@960 -- # wait 2332013 00:21:00.021 13:54:40 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.021 13:54:40 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:00.021 13:54:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:00.021 13:54:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:00.021 13:54:40 -- common/autotest_common.sh@10 -- # set +x 00:21:00.021 13:54:40 -- nvmf/common.sh@469 -- # nvmfpid=2332328 00:21:00.021 13:54:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:00.021 13:54:40 -- nvmf/common.sh@470 -- # waitforlisten 2332328 00:21:00.021 13:54:40 -- common/autotest_common.sh@829 -- # '[' -z 2332328 ']' 00:21:00.021 13:54:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:00.021 13:54:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.021 13:54:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:00.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:00.021 13:54:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.022 13:54:40 -- common/autotest_common.sh@10 -- # set +x 00:21:00.022 [2024-11-29 13:54:40.205591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:00.022 [2024-11-29 13:54:40.205668] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:00.022 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.022 [2024-11-29 13:54:40.270291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.280 [2024-11-29 13:54:40.354623] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:00.280 [2024-11-29 13:54:40.354784] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.280 [2024-11-29 13:54:40.354801] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.280 [2024-11-29 13:54:40.354814] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.280 [2024-11-29 13:54:40.354851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:01.211 13:54:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.211 13:54:41 -- common/autotest_common.sh@862 -- # return 0 00:21:01.211 13:54:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:01.211 13:54:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:01.211 13:54:41 -- common/autotest_common.sh@10 -- # set +x 00:21:01.211 13:54:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:01.211 13:54:41 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.211 13:54:41 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.211 13:54:41 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:01.479 [2024-11-29 13:54:41.526389] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:01.479 13:54:41 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:01.786 13:54:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:02.050 [2024-11-29 13:54:42.128062] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:02.050 [2024-11-29 13:54:42.128332] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:02.050 13:54:42 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:02.308 malloc0 00:21:02.308 13:54:42 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:02.565 13:54:42 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:02.824 13:54:43 -- target/tls.sh@197 -- # bdevperf_pid=2332754 00:21:02.824 13:54:43 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:02.824 13:54:43 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:02.824 13:54:43 -- target/tls.sh@200 -- # waitforlisten 2332754 /var/tmp/bdevperf.sock 00:21:02.824 13:54:43 -- common/autotest_common.sh@829 -- # '[' -z 2332754 ']' 00:21:02.824 13:54:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:02.824 13:54:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:02.824 13:54:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:02.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:02.824 13:54:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:02.824 13:54:43 -- common/autotest_common.sh@10 -- # set +x 00:21:02.824 [2024-11-29 13:54:43.067692] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:02.824 [2024-11-29 13:54:43.067767] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332754 ] 00:21:02.824 EAL: No free 2048 kB hugepages reported on node 1 00:21:03.082 [2024-11-29 13:54:43.127473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:03.082 [2024-11-29 13:54:43.209176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:04.017 13:54:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:04.017 13:54:44 -- common/autotest_common.sh@862 -- # return 0 00:21:04.017 13:54:44 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.017 [2024-11-29 13:54:44.255216] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:04.277 TLSTESTn1 00:21:04.277 13:54:44 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:04.536 13:54:44 -- target/tls.sh@205 -- # tgtconf='{ 00:21:04.536 "subsystems": [ 00:21:04.536 { 00:21:04.536 "subsystem": "iobuf", 00:21:04.536 "config": [ 00:21:04.536 { 00:21:04.536 "method": "iobuf_set_options", 00:21:04.536 "params": { 00:21:04.536 "small_pool_count": 8192, 00:21:04.536 "large_pool_count": 1024, 00:21:04.536 "small_bufsize": 8192, 00:21:04.536 "large_bufsize": 135168 00:21:04.536 } 00:21:04.536 } 00:21:04.536 ] 00:21:04.536 }, 00:21:04.536 { 00:21:04.536 "subsystem": "sock", 00:21:04.536 "config": [ 00:21:04.536 { 00:21:04.536 "method": "sock_impl_set_options", 00:21:04.536 "params": { 00:21:04.536 "impl_name": "posix", 00:21:04.536 "recv_buf_size": 2097152, 00:21:04.536 "send_buf_size": 2097152, 00:21:04.536 "enable_recv_pipe": true, 00:21:04.536 "enable_quickack": false, 00:21:04.536 "enable_placement_id": 0, 00:21:04.536 "enable_zerocopy_send_server": true, 00:21:04.536 "enable_zerocopy_send_client": false, 00:21:04.536 "zerocopy_threshold": 0, 00:21:04.536 "tls_version": 0, 00:21:04.536 "enable_ktls": false 00:21:04.536 } 00:21:04.536 }, 00:21:04.536 { 00:21:04.536 "method": "sock_impl_set_options", 00:21:04.536 "params": { 00:21:04.536 "impl_name": "ssl", 00:21:04.536 "recv_buf_size": 4096, 00:21:04.536 "send_buf_size": 4096, 00:21:04.536 "enable_recv_pipe": true, 00:21:04.536 "enable_quickack": false, 00:21:04.536 "enable_placement_id": 0, 00:21:04.536 "enable_zerocopy_send_server": true, 00:21:04.536 "enable_zerocopy_send_client": false, 00:21:04.536 "zerocopy_threshold": 0, 00:21:04.536 "tls_version": 0, 00:21:04.536 "enable_ktls": false 00:21:04.536 } 00:21:04.536 } 00:21:04.536 ] 00:21:04.536 }, 00:21:04.536 { 00:21:04.536 "subsystem": "vmd", 00:21:04.536 "config": [] 00:21:04.536 }, 00:21:04.536 { 00:21:04.536 "subsystem": "accel", 00:21:04.536 "config": [ 00:21:04.536 { 00:21:04.537 "method": "accel_set_options", 00:21:04.537 "params": { 00:21:04.537 "small_cache_size": 128, 00:21:04.537 "large_cache_size": 16, 00:21:04.537 "task_count": 2048, 00:21:04.537 "sequence_count": 2048, 00:21:04.537 "buf_count": 2048 00:21:04.537 } 00:21:04.537 } 00:21:04.537 ] 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "subsystem": "bdev", 00:21:04.537 "config": [ 00:21:04.537 { 00:21:04.537 "method": "bdev_set_options", 00:21:04.537 "params": { 00:21:04.537 "bdev_io_pool_size": 65535, 00:21:04.537 "bdev_io_cache_size": 256, 00:21:04.537 "bdev_auto_examine": true, 00:21:04.537 "iobuf_small_cache_size": 128, 00:21:04.537 "iobuf_large_cache_size": 16 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_raid_set_options", 00:21:04.537 "params": { 00:21:04.537 "process_window_size_kb": 1024 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_iscsi_set_options", 00:21:04.537 "params": { 00:21:04.537 "timeout_sec": 30 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_nvme_set_options", 00:21:04.537 "params": { 00:21:04.537 "action_on_timeout": "none", 00:21:04.537 "timeout_us": 0, 00:21:04.537 "timeout_admin_us": 0, 00:21:04.537 "keep_alive_timeout_ms": 10000, 00:21:04.537 "transport_retry_count": 4, 00:21:04.537 "arbitration_burst": 0, 00:21:04.537 "low_priority_weight": 0, 00:21:04.537 "medium_priority_weight": 0, 00:21:04.537 "high_priority_weight": 0, 00:21:04.537 "nvme_adminq_poll_period_us": 10000, 00:21:04.537 "nvme_ioq_poll_period_us": 0, 00:21:04.537 "io_queue_requests": 0, 00:21:04.537 "delay_cmd_submit": true, 00:21:04.537 "bdev_retry_count": 3, 00:21:04.537 "transport_ack_timeout": 0, 00:21:04.537 "ctrlr_loss_timeout_sec": 0, 00:21:04.537 "reconnect_delay_sec": 0, 00:21:04.537 "fast_io_fail_timeout_sec": 0, 00:21:04.537 "generate_uuids": false, 00:21:04.537 "transport_tos": 0, 00:21:04.537 "io_path_stat": false, 00:21:04.537 "allow_accel_sequence": false 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_nvme_set_hotplug", 00:21:04.537 "params": { 00:21:04.537 "period_us": 100000, 00:21:04.537 "enable": false 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_malloc_create", 00:21:04.537 "params": { 00:21:04.537 "name": "malloc0", 00:21:04.537 "num_blocks": 8192, 00:21:04.537 "block_size": 4096, 00:21:04.537 "physical_block_size": 4096, 00:21:04.537 "uuid": "253ef7cf-b654-4b1a-8212-1aa2a222a763", 00:21:04.537 "optimal_io_boundary": 0 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "bdev_wait_for_examine" 00:21:04.537 } 00:21:04.537 ] 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "subsystem": "nbd", 00:21:04.537 "config": [] 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "subsystem": "scheduler", 00:21:04.537 "config": [ 00:21:04.537 { 00:21:04.537 "method": "framework_set_scheduler", 00:21:04.537 "params": { 00:21:04.537 "name": "static" 00:21:04.537 } 00:21:04.537 } 00:21:04.537 ] 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "subsystem": "nvmf", 00:21:04.537 "config": [ 00:21:04.537 { 00:21:04.537 "method": "nvmf_set_config", 00:21:04.537 "params": { 00:21:04.537 "discovery_filter": "match_any", 00:21:04.537 "admin_cmd_passthru": { 00:21:04.537 "identify_ctrlr": false 00:21:04.537 } 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_set_max_subsystems", 00:21:04.537 "params": { 00:21:04.537 "max_subsystems": 1024 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_set_crdt", 00:21:04.537 "params": { 00:21:04.537 "crdt1": 0, 00:21:04.537 "crdt2": 0, 00:21:04.537 "crdt3": 0 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_create_transport", 00:21:04.537 "params": { 00:21:04.537 "trtype": "TCP", 00:21:04.537 "max_queue_depth": 128, 00:21:04.537 "max_io_qpairs_per_ctrlr": 127, 00:21:04.537 "in_capsule_data_size": 4096, 00:21:04.537 "max_io_size": 131072, 00:21:04.537 "io_unit_size": 131072, 00:21:04.537 "max_aq_depth": 128, 00:21:04.537 "num_shared_buffers": 511, 00:21:04.537 "buf_cache_size": 4294967295, 00:21:04.537 "dif_insert_or_strip": false, 00:21:04.537 "zcopy": false, 00:21:04.537 "c2h_success": false, 00:21:04.537 "sock_priority": 0, 00:21:04.537 "abort_timeout_sec": 1 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_create_subsystem", 00:21:04.537 "params": { 00:21:04.537 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.537 "allow_any_host": false, 00:21:04.537 "serial_number": "SPDK00000000000001", 00:21:04.537 "model_number": "SPDK bdev Controller", 00:21:04.537 "max_namespaces": 10, 00:21:04.537 "min_cntlid": 1, 00:21:04.537 "max_cntlid": 65519, 00:21:04.537 "ana_reporting": false 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_subsystem_add_host", 00:21:04.537 "params": { 00:21:04.537 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.537 "host": "nqn.2016-06.io.spdk:host1", 00:21:04.537 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_subsystem_add_ns", 00:21:04.537 "params": { 00:21:04.537 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.537 "namespace": { 00:21:04.537 "nsid": 1, 00:21:04.537 "bdev_name": "malloc0", 00:21:04.537 "nguid": "253EF7CFB6544B1A82121AA2A222A763", 00:21:04.537 "uuid": "253ef7cf-b654-4b1a-8212-1aa2a222a763" 00:21:04.537 } 00:21:04.537 } 00:21:04.537 }, 00:21:04.537 { 00:21:04.537 "method": "nvmf_subsystem_add_listener", 00:21:04.537 "params": { 00:21:04.537 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.537 "listen_address": { 00:21:04.537 "trtype": "TCP", 00:21:04.537 "adrfam": "IPv4", 00:21:04.537 "traddr": "10.0.0.2", 00:21:04.537 "trsvcid": "4420" 00:21:04.537 }, 00:21:04.537 "secure_channel": true 00:21:04.537 } 00:21:04.537 } 00:21:04.537 ] 00:21:04.537 } 00:21:04.537 ] 00:21:04.537 }' 00:21:04.537 13:54:44 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:04.795 13:54:44 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:04.795 "subsystems": [ 00:21:04.795 { 00:21:04.795 "subsystem": "iobuf", 00:21:04.795 "config": [ 00:21:04.796 { 00:21:04.796 "method": "iobuf_set_options", 00:21:04.796 "params": { 00:21:04.796 "small_pool_count": 8192, 00:21:04.796 "large_pool_count": 1024, 00:21:04.796 "small_bufsize": 8192, 00:21:04.796 "large_bufsize": 135168 00:21:04.796 } 00:21:04.796 } 00:21:04.796 ] 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "subsystem": "sock", 00:21:04.796 "config": [ 00:21:04.796 { 00:21:04.796 "method": "sock_impl_set_options", 00:21:04.796 "params": { 00:21:04.796 "impl_name": "posix", 00:21:04.796 "recv_buf_size": 2097152, 00:21:04.796 "send_buf_size": 2097152, 00:21:04.796 "enable_recv_pipe": true, 00:21:04.796 "enable_quickack": false, 00:21:04.796 "enable_placement_id": 0, 00:21:04.796 "enable_zerocopy_send_server": true, 00:21:04.796 "enable_zerocopy_send_client": false, 00:21:04.796 "zerocopy_threshold": 0, 00:21:04.796 "tls_version": 0, 00:21:04.796 "enable_ktls": false 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "sock_impl_set_options", 00:21:04.796 "params": { 00:21:04.796 "impl_name": "ssl", 00:21:04.796 "recv_buf_size": 4096, 00:21:04.796 "send_buf_size": 4096, 00:21:04.796 "enable_recv_pipe": true, 00:21:04.796 "enable_quickack": false, 00:21:04.796 "enable_placement_id": 0, 00:21:04.796 "enable_zerocopy_send_server": true, 00:21:04.796 "enable_zerocopy_send_client": false, 00:21:04.796 "zerocopy_threshold": 0, 00:21:04.796 "tls_version": 0, 00:21:04.796 "enable_ktls": false 00:21:04.796 } 00:21:04.796 } 00:21:04.796 ] 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "subsystem": "vmd", 00:21:04.796 "config": [] 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "subsystem": "accel", 00:21:04.796 "config": [ 00:21:04.796 { 00:21:04.796 "method": "accel_set_options", 00:21:04.796 "params": { 00:21:04.796 "small_cache_size": 128, 00:21:04.796 "large_cache_size": 16, 00:21:04.796 "task_count": 2048, 00:21:04.796 "sequence_count": 2048, 00:21:04.796 "buf_count": 2048 00:21:04.796 } 00:21:04.796 } 00:21:04.796 ] 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "subsystem": "bdev", 00:21:04.796 "config": [ 00:21:04.796 { 00:21:04.796 "method": "bdev_set_options", 00:21:04.796 "params": { 00:21:04.796 "bdev_io_pool_size": 65535, 00:21:04.796 "bdev_io_cache_size": 256, 00:21:04.796 "bdev_auto_examine": true, 00:21:04.796 "iobuf_small_cache_size": 128, 00:21:04.796 "iobuf_large_cache_size": 16 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_raid_set_options", 00:21:04.796 "params": { 00:21:04.796 "process_window_size_kb": 1024 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_iscsi_set_options", 00:21:04.796 "params": { 00:21:04.796 "timeout_sec": 30 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_nvme_set_options", 00:21:04.796 "params": { 00:21:04.796 "action_on_timeout": "none", 00:21:04.796 "timeout_us": 0, 00:21:04.796 "timeout_admin_us": 0, 00:21:04.796 "keep_alive_timeout_ms": 10000, 00:21:04.796 "transport_retry_count": 4, 00:21:04.796 "arbitration_burst": 0, 00:21:04.796 "low_priority_weight": 0, 00:21:04.796 "medium_priority_weight": 0, 00:21:04.796 "high_priority_weight": 0, 00:21:04.796 "nvme_adminq_poll_period_us": 10000, 00:21:04.796 "nvme_ioq_poll_period_us": 0, 00:21:04.796 "io_queue_requests": 512, 00:21:04.796 "delay_cmd_submit": true, 00:21:04.796 "bdev_retry_count": 3, 00:21:04.796 "transport_ack_timeout": 0, 00:21:04.796 "ctrlr_loss_timeout_sec": 0, 00:21:04.796 "reconnect_delay_sec": 0, 00:21:04.796 "fast_io_fail_timeout_sec": 0, 00:21:04.796 "generate_uuids": false, 00:21:04.796 "transport_tos": 0, 00:21:04.796 "io_path_stat": false, 00:21:04.796 "allow_accel_sequence": false 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_nvme_attach_controller", 00:21:04.796 "params": { 00:21:04.796 "name": "TLSTEST", 00:21:04.796 "trtype": "TCP", 00:21:04.796 "adrfam": "IPv4", 00:21:04.796 "traddr": "10.0.0.2", 00:21:04.796 "trsvcid": "4420", 00:21:04.796 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.796 "prchk_reftag": false, 00:21:04.796 "prchk_guard": false, 00:21:04.796 "ctrlr_loss_timeout_sec": 0, 00:21:04.796 "reconnect_delay_sec": 0, 00:21:04.796 "fast_io_fail_timeout_sec": 0, 00:21:04.796 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:04.796 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:04.796 "hdgst": false, 00:21:04.796 "ddgst": false 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_nvme_set_hotplug", 00:21:04.796 "params": { 00:21:04.796 "period_us": 100000, 00:21:04.796 "enable": false 00:21:04.796 } 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "method": "bdev_wait_for_examine" 00:21:04.796 } 00:21:04.796 ] 00:21:04.796 }, 00:21:04.796 { 00:21:04.796 "subsystem": "nbd", 00:21:04.796 "config": [] 00:21:04.796 } 00:21:04.796 ] 00:21:04.796 }' 00:21:04.796 13:54:44 -- target/tls.sh@208 -- # killprocess 2332754 00:21:04.796 13:54:44 -- common/autotest_common.sh@936 -- # '[' -z 2332754 ']' 00:21:04.796 13:54:44 -- common/autotest_common.sh@940 -- # kill -0 2332754 00:21:04.796 13:54:44 -- common/autotest_common.sh@941 -- # uname 00:21:04.796 13:54:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.796 13:54:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332754 00:21:04.796 13:54:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:04.796 13:54:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:04.796 13:54:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332754' 00:21:04.796 killing process with pid 2332754 00:21:04.796 13:54:45 -- common/autotest_common.sh@955 -- # kill 2332754 00:21:04.796 Received shutdown signal, test time was about 10.000000 seconds 00:21:04.796 00:21:04.796 Latency(us) 00:21:04.797 [2024-11-29T12:54:45.079Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:04.797 [2024-11-29T12:54:45.079Z] =================================================================================================================== 00:21:04.797 [2024-11-29T12:54:45.079Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:04.797 13:54:45 -- common/autotest_common.sh@960 -- # wait 2332754 00:21:05.064 13:54:45 -- target/tls.sh@209 -- # killprocess 2332328 00:21:05.064 13:54:45 -- common/autotest_common.sh@936 -- # '[' -z 2332328 ']' 00:21:05.064 13:54:45 -- common/autotest_common.sh@940 -- # kill -0 2332328 00:21:05.065 13:54:45 -- common/autotest_common.sh@941 -- # uname 00:21:05.065 13:54:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:05.065 13:54:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332328 00:21:05.065 13:54:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:05.065 13:54:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:05.065 13:54:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332328' 00:21:05.065 killing process with pid 2332328 00:21:05.065 13:54:45 -- common/autotest_common.sh@955 -- # kill 2332328 00:21:05.065 13:54:45 -- common/autotest_common.sh@960 -- # wait 2332328 00:21:05.330 13:54:45 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:05.330 13:54:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:05.330 13:54:45 -- target/tls.sh@212 -- # echo '{ 00:21:05.330 "subsystems": [ 00:21:05.330 { 00:21:05.330 "subsystem": "iobuf", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "iobuf_set_options", 00:21:05.330 "params": { 00:21:05.330 "small_pool_count": 8192, 00:21:05.330 "large_pool_count": 1024, 00:21:05.330 "small_bufsize": 8192, 00:21:05.330 "large_bufsize": 135168 00:21:05.330 } 00:21:05.330 } 00:21:05.330 ] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "sock", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "sock_impl_set_options", 00:21:05.330 "params": { 00:21:05.330 "impl_name": "posix", 00:21:05.330 "recv_buf_size": 2097152, 00:21:05.330 "send_buf_size": 2097152, 00:21:05.330 "enable_recv_pipe": true, 00:21:05.330 "enable_quickack": false, 00:21:05.330 "enable_placement_id": 0, 00:21:05.330 "enable_zerocopy_send_server": true, 00:21:05.330 "enable_zerocopy_send_client": false, 00:21:05.330 "zerocopy_threshold": 0, 00:21:05.330 "tls_version": 0, 00:21:05.330 "enable_ktls": false 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "sock_impl_set_options", 00:21:05.330 "params": { 00:21:05.330 "impl_name": "ssl", 00:21:05.330 "recv_buf_size": 4096, 00:21:05.330 "send_buf_size": 4096, 00:21:05.330 "enable_recv_pipe": true, 00:21:05.330 "enable_quickack": false, 00:21:05.330 "enable_placement_id": 0, 00:21:05.330 "enable_zerocopy_send_server": true, 00:21:05.330 "enable_zerocopy_send_client": false, 00:21:05.330 "zerocopy_threshold": 0, 00:21:05.330 "tls_version": 0, 00:21:05.330 "enable_ktls": false 00:21:05.330 } 00:21:05.330 } 00:21:05.330 ] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "vmd", 00:21:05.330 "config": [] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "accel", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "accel_set_options", 00:21:05.330 "params": { 00:21:05.330 "small_cache_size": 128, 00:21:05.330 "large_cache_size": 16, 00:21:05.330 "task_count": 2048, 00:21:05.330 "sequence_count": 2048, 00:21:05.330 "buf_count": 2048 00:21:05.330 } 00:21:05.330 } 00:21:05.330 ] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "bdev", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "bdev_set_options", 00:21:05.330 "params": { 00:21:05.330 "bdev_io_pool_size": 65535, 00:21:05.330 "bdev_io_cache_size": 256, 00:21:05.330 "bdev_auto_examine": true, 00:21:05.330 "iobuf_small_cache_size": 128, 00:21:05.330 "iobuf_large_cache_size": 16 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_raid_set_options", 00:21:05.330 "params": { 00:21:05.330 "process_window_size_kb": 1024 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_iscsi_set_options", 00:21:05.330 "params": { 00:21:05.330 "timeout_sec": 30 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_nvme_set_options", 00:21:05.330 "params": { 00:21:05.330 "action_on_timeout": "none", 00:21:05.330 "timeout_us": 0, 00:21:05.330 "timeout_admin_us": 0, 00:21:05.330 "keep_alive_timeout_ms": 10000, 00:21:05.330 "transport_retry_count": 4, 00:21:05.330 "arbitration_burst": 0, 00:21:05.330 "low_priority_weight": 0, 00:21:05.330 "medium_priority_weight": 0, 00:21:05.330 "high_priority_weight": 0, 00:21:05.330 "nvme_adminq_poll_period_us": 10000, 00:21:05.330 "nvme_ioq_poll_period_us": 0, 00:21:05.330 "io_queue_requests": 0, 00:21:05.330 "delay_cmd_submit": true, 00:21:05.330 "bdev_retry_count": 3, 00:21:05.330 "transport_ack_timeout": 0, 00:21:05.330 "ctrlr_loss_timeout_sec": 0, 00:21:05.330 "reconnect_delay_sec": 0, 00:21:05.330 "fast_io_fail_timeout_sec": 0, 00:21:05.330 "generate_uuids": false, 00:21:05.330 "transport_tos": 0, 00:21:05.330 "io_path_stat": false, 00:21:05.330 "allow_accel_sequence": false 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_nvme_set_hotplug", 00:21:05.330 "params": { 00:21:05.330 "period_us": 100000, 00:21:05.330 "enable": false 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_malloc_create", 00:21:05.330 "params": { 00:21:05.330 "name": "malloc0", 00:21:05.330 "num_blocks": 8192, 00:21:05.330 "block_size": 4096, 00:21:05.330 "physical_block_size": 4096, 00:21:05.330 "uuid": "253ef7cf-b654-4b1a-8212-1aa2a222a763", 00:21:05.330 "optimal_io_boundary": 0 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "bdev_wait_for_examine" 00:21:05.330 } 00:21:05.330 ] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "nbd", 00:21:05.330 "config": [] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "scheduler", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "framework_set_scheduler", 00:21:05.330 "params": { 00:21:05.330 "name": "static" 00:21:05.330 } 00:21:05.330 } 00:21:05.330 ] 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "subsystem": "nvmf", 00:21:05.330 "config": [ 00:21:05.330 { 00:21:05.330 "method": "nvmf_set_config", 00:21:05.330 "params": { 00:21:05.330 "discovery_filter": "match_any", 00:21:05.330 "admin_cmd_passthru": { 00:21:05.330 "identify_ctrlr": false 00:21:05.330 } 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "nvmf_set_max_subsystems", 00:21:05.330 "params": { 00:21:05.330 "max_subsystems": 1024 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "nvmf_set_crdt", 00:21:05.330 "params": { 00:21:05.330 "crdt1": 0, 00:21:05.330 "crdt2": 0, 00:21:05.330 "crdt3": 0 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "nvmf_create_transport", 00:21:05.330 "params": { 00:21:05.330 "trtype": "TCP", 00:21:05.330 "max_queue_depth": 128, 00:21:05.330 "max_io_qpairs_per_ctrlr": 127, 00:21:05.330 "in_capsule_data_size": 4096, 00:21:05.330 "max_io_size": 131072, 00:21:05.330 "io_unit_size": 131072, 00:21:05.330 "max_aq_depth": 128, 00:21:05.330 "num_shared_buffers": 511, 00:21:05.330 "buf_cache_size": 4294967295, 00:21:05.330 "dif_insert_or_strip": false, 00:21:05.330 "zcopy": false, 00:21:05.330 "c2h_success": false, 00:21:05.330 "sock_priority": 0, 00:21:05.330 "abort_timeout_sec": 1 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "nvmf_create_subsystem", 00:21:05.330 "params": { 00:21:05.330 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.330 "allow_any_host": false, 00:21:05.330 "serial_number": "SPDK00000000000001", 00:21:05.330 "model_number": "SPDK bdev Controller", 00:21:05.330 "max_namespaces": 10, 00:21:05.330 "min_cntlid": 1, 00:21:05.330 "max_cntlid": 65519, 00:21:05.330 "ana_reporting": false 00:21:05.330 } 00:21:05.330 }, 00:21:05.330 { 00:21:05.330 "method": "nvmf_subsystem_add_host", 00:21:05.330 "params": { 00:21:05.330 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.330 "host": "nqn.2016-06.io.spdk:host1", 00:21:05.330 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:05.330 } 00:21:05.330 }, 00:21:05.331 { 00:21:05.331 "method": "nvmf_subsystem_add_ns", 00:21:05.331 "params": { 00:21:05.331 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.331 "namespace": { 00:21:05.331 "nsid": 1, 00:21:05.331 "bdev_name": "malloc0", 00:21:05.331 "nguid": "253EF7CFB6544B1A82121AA2A222A763", 00:21:05.331 "uuid": "253ef7cf-b654-4b1a-8212-1aa2a222a763" 00:21:05.331 } 00:21:05.331 } 00:21:05.331 }, 00:21:05.331 { 00:21:05.331 "method": "nvmf_subsystem_add_listener", 00:21:05.331 "params": { 00:21:05.331 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.331 "listen_address": { 00:21:05.331 "trtype": "TCP", 00:21:05.331 "adrfam": "IPv4", 00:21:05.331 "traddr": "10.0.0.2", 00:21:05.331 "trsvcid": "4420" 00:21:05.331 }, 00:21:05.331 "secure_channel": true 00:21:05.331 } 00:21:05.331 } 00:21:05.331 ] 00:21:05.331 } 00:21:05.331 ] 00:21:05.331 }' 00:21:05.331 13:54:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:05.331 13:54:45 -- common/autotest_common.sh@10 -- # set +x 00:21:05.331 13:54:45 -- nvmf/common.sh@469 -- # nvmfpid=2333047 00:21:05.331 13:54:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:05.331 13:54:45 -- nvmf/common.sh@470 -- # waitforlisten 2333047 00:21:05.331 13:54:45 -- common/autotest_common.sh@829 -- # '[' -z 2333047 ']' 00:21:05.331 13:54:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:05.331 13:54:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:05.331 13:54:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:05.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:05.331 13:54:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:05.331 13:54:45 -- common/autotest_common.sh@10 -- # set +x 00:21:05.331 [2024-11-29 13:54:45.559903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:05.331 [2024-11-29 13:54:45.559990] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:05.331 EAL: No free 2048 kB hugepages reported on node 1 00:21:05.588 [2024-11-29 13:54:45.628667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:05.588 [2024-11-29 13:54:45.714166] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:05.588 [2024-11-29 13:54:45.714342] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:05.588 [2024-11-29 13:54:45.714363] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:05.588 [2024-11-29 13:54:45.714377] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:05.588 [2024-11-29 13:54:45.714424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:05.847 [2024-11-29 13:54:45.940825] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:05.847 [2024-11-29 13:54:45.972840] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:05.847 [2024-11-29 13:54:45.973086] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:06.415 13:54:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:06.415 13:54:46 -- common/autotest_common.sh@862 -- # return 0 00:21:06.415 13:54:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:06.415 13:54:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:06.415 13:54:46 -- common/autotest_common.sh@10 -- # set +x 00:21:06.415 13:54:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:06.415 13:54:46 -- target/tls.sh@216 -- # bdevperf_pid=2333208 00:21:06.415 13:54:46 -- target/tls.sh@217 -- # waitforlisten 2333208 /var/tmp/bdevperf.sock 00:21:06.415 13:54:46 -- common/autotest_common.sh@829 -- # '[' -z 2333208 ']' 00:21:06.415 13:54:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:06.415 13:54:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:06.415 13:54:46 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:06.415 13:54:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:06.415 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:06.415 13:54:46 -- target/tls.sh@213 -- # echo '{ 00:21:06.415 "subsystems": [ 00:21:06.415 { 00:21:06.415 "subsystem": "iobuf", 00:21:06.415 "config": [ 00:21:06.415 { 00:21:06.415 "method": "iobuf_set_options", 00:21:06.415 "params": { 00:21:06.415 "small_pool_count": 8192, 00:21:06.415 "large_pool_count": 1024, 00:21:06.415 "small_bufsize": 8192, 00:21:06.415 "large_bufsize": 135168 00:21:06.415 } 00:21:06.415 } 00:21:06.415 ] 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "subsystem": "sock", 00:21:06.415 "config": [ 00:21:06.415 { 00:21:06.415 "method": "sock_impl_set_options", 00:21:06.415 "params": { 00:21:06.415 "impl_name": "posix", 00:21:06.415 "recv_buf_size": 2097152, 00:21:06.415 "send_buf_size": 2097152, 00:21:06.415 "enable_recv_pipe": true, 00:21:06.415 "enable_quickack": false, 00:21:06.415 "enable_placement_id": 0, 00:21:06.415 "enable_zerocopy_send_server": true, 00:21:06.415 "enable_zerocopy_send_client": false, 00:21:06.415 "zerocopy_threshold": 0, 00:21:06.415 "tls_version": 0, 00:21:06.415 "enable_ktls": false 00:21:06.415 } 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "method": "sock_impl_set_options", 00:21:06.415 "params": { 00:21:06.415 "impl_name": "ssl", 00:21:06.415 "recv_buf_size": 4096, 00:21:06.415 "send_buf_size": 4096, 00:21:06.415 "enable_recv_pipe": true, 00:21:06.415 "enable_quickack": false, 00:21:06.415 "enable_placement_id": 0, 00:21:06.415 "enable_zerocopy_send_server": true, 00:21:06.415 "enable_zerocopy_send_client": false, 00:21:06.415 "zerocopy_threshold": 0, 00:21:06.415 "tls_version": 0, 00:21:06.415 "enable_ktls": false 00:21:06.415 } 00:21:06.415 } 00:21:06.415 ] 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "subsystem": "vmd", 00:21:06.415 "config": [] 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "subsystem": "accel", 00:21:06.415 "config": [ 00:21:06.415 { 00:21:06.415 "method": "accel_set_options", 00:21:06.415 "params": { 00:21:06.415 "small_cache_size": 128, 00:21:06.415 "large_cache_size": 16, 00:21:06.415 "task_count": 2048, 00:21:06.415 "sequence_count": 2048, 00:21:06.415 "buf_count": 2048 00:21:06.415 } 00:21:06.415 } 00:21:06.415 ] 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "subsystem": "bdev", 00:21:06.415 "config": [ 00:21:06.415 { 00:21:06.415 "method": "bdev_set_options", 00:21:06.415 "params": { 00:21:06.415 "bdev_io_pool_size": 65535, 00:21:06.415 "bdev_io_cache_size": 256, 00:21:06.415 "bdev_auto_examine": true, 00:21:06.415 "iobuf_small_cache_size": 128, 00:21:06.415 "iobuf_large_cache_size": 16 00:21:06.415 } 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "method": "bdev_raid_set_options", 00:21:06.415 "params": { 00:21:06.415 "process_window_size_kb": 1024 00:21:06.415 } 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "method": "bdev_iscsi_set_options", 00:21:06.415 "params": { 00:21:06.415 "timeout_sec": 30 00:21:06.415 } 00:21:06.415 }, 00:21:06.415 { 00:21:06.415 "method": "bdev_nvme_set_options", 00:21:06.415 "params": { 00:21:06.415 "action_on_timeout": "none", 00:21:06.415 "timeout_us": 0, 00:21:06.415 "timeout_admin_us": 0, 00:21:06.415 "keep_alive_timeout_ms": 10000, 00:21:06.415 "transport_retry_count": 4, 00:21:06.415 "arbitration_burst": 0, 00:21:06.415 "low_priority_weight": 0, 00:21:06.415 "medium_priority_weight": 0, 00:21:06.415 "high_priority_weight": 0, 00:21:06.415 "nvme_adminq_poll_period_us": 10000, 00:21:06.415 "nvme_ioq_poll_period_us": 0, 00:21:06.415 "io_queue_requests": 512, 00:21:06.415 "delay_cmd_submit": true, 00:21:06.415 "bdev_retry_count": 3, 00:21:06.415 "transport_ack_timeout": 0, 00:21:06.415 "ctrlr_loss_timeout_sec": 0, 00:21:06.415 "reconnect_delay_sec": 0, 00:21:06.415 "fast_io_fail_timeout_sec": 0, 00:21:06.415 "generate_uuids": false, 00:21:06.416 "transport_tos": 0, 00:21:06.416 "io_path_stat": false, 00:21:06.416 "allow_accel_sequence": false 00:21:06.416 } 00:21:06.416 }, 00:21:06.416 { 00:21:06.416 "method": "bdev_nvme_attach_controller", 00:21:06.416 "params": { 00:21:06.416 "name": "TLSTEST", 00:21:06.416 "trtype": "TCP", 00:21:06.416 "adrfam": "IPv4", 00:21:06.416 "traddr": "10.0.0.2", 00:21:06.416 "trsvcid": "4420", 00:21:06.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:06.416 "prchk_reftag": false, 00:21:06.416 "prchk_guard": false, 00:21:06.416 "ctrlr_loss_timeout_sec": 0, 00:21:06.416 "reconnect_delay_sec": 0, 00:21:06.416 "fast_io_fail_timeout_sec": 0, 00:21:06.416 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:06.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:06.416 "hdgst": 13:54:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:06.416 false, 00:21:06.416 "ddgst": false 00:21:06.416 } 00:21:06.416 }, 00:21:06.416 { 00:21:06.416 "method": "bdev_nvme_set_hotplug", 00:21:06.416 "params": { 00:21:06.416 "period_us": 100000, 00:21:06.416 "enable": false 00:21:06.416 } 00:21:06.416 }, 00:21:06.416 { 00:21:06.416 "method": "bdev_wait_for_examine" 00:21:06.416 } 00:21:06.416 ] 00:21:06.416 }, 00:21:06.416 { 00:21:06.416 "subsystem": "nbd", 00:21:06.416 "config": [] 00:21:06.416 } 00:21:06.416 ] 00:21:06.416 }' 00:21:06.416 13:54:46 -- common/autotest_common.sh@10 -- # set +x 00:21:06.416 [2024-11-29 13:54:46.618144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:06.416 [2024-11-29 13:54:46.618218] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333208 ] 00:21:06.416 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.416 [2024-11-29 13:54:46.676789] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:06.675 [2024-11-29 13:54:46.760976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:06.675 [2024-11-29 13:54:46.919664] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:07.612 13:54:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:07.613 13:54:47 -- common/autotest_common.sh@862 -- # return 0 00:21:07.613 13:54:47 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:07.613 Running I/O for 10 seconds... 00:21:17.592 00:21:17.592 Latency(us) 00:21:17.592 [2024-11-29T12:54:57.874Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.592 [2024-11-29T12:54:57.874Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:17.592 Verification LBA range: start 0x0 length 0x2000 00:21:17.592 TLSTESTn1 : 10.02 4609.13 18.00 0.00 0.00 27730.24 6893.42 45438.29 00:21:17.592 [2024-11-29T12:54:57.874Z] =================================================================================================================== 00:21:17.592 [2024-11-29T12:54:57.874Z] Total : 4609.13 18.00 0.00 0.00 27730.24 6893.42 45438.29 00:21:17.592 0 00:21:17.592 13:54:57 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:17.592 13:54:57 -- target/tls.sh@223 -- # killprocess 2333208 00:21:17.592 13:54:57 -- common/autotest_common.sh@936 -- # '[' -z 2333208 ']' 00:21:17.592 13:54:57 -- common/autotest_common.sh@940 -- # kill -0 2333208 00:21:17.592 13:54:57 -- common/autotest_common.sh@941 -- # uname 00:21:17.592 13:54:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.592 13:54:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333208 00:21:17.592 13:54:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:17.592 13:54:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:17.592 13:54:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333208' 00:21:17.592 killing process with pid 2333208 00:21:17.592 13:54:57 -- common/autotest_common.sh@955 -- # kill 2333208 00:21:17.592 Received shutdown signal, test time was about 10.000000 seconds 00:21:17.592 00:21:17.592 Latency(us) 00:21:17.592 [2024-11-29T12:54:57.874Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.592 [2024-11-29T12:54:57.875Z] =================================================================================================================== 00:21:17.593 [2024-11-29T12:54:57.875Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:17.593 13:54:57 -- common/autotest_common.sh@960 -- # wait 2333208 00:21:17.851 13:54:58 -- target/tls.sh@224 -- # killprocess 2333047 00:21:17.851 13:54:58 -- common/autotest_common.sh@936 -- # '[' -z 2333047 ']' 00:21:17.851 13:54:58 -- common/autotest_common.sh@940 -- # kill -0 2333047 00:21:17.851 13:54:58 -- common/autotest_common.sh@941 -- # uname 00:21:17.851 13:54:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.851 13:54:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333047 00:21:17.851 13:54:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:17.851 13:54:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:17.851 13:54:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333047' 00:21:17.851 killing process with pid 2333047 00:21:17.851 13:54:58 -- common/autotest_common.sh@955 -- # kill 2333047 00:21:17.851 13:54:58 -- common/autotest_common.sh@960 -- # wait 2333047 00:21:18.110 13:54:58 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:18.110 13:54:58 -- target/tls.sh@227 -- # cleanup 00:21:18.110 13:54:58 -- target/tls.sh@15 -- # process_shm --id 0 00:21:18.110 13:54:58 -- common/autotest_common.sh@806 -- # type=--id 00:21:18.110 13:54:58 -- common/autotest_common.sh@807 -- # id=0 00:21:18.110 13:54:58 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:18.110 13:54:58 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:18.110 13:54:58 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:18.110 13:54:58 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:18.110 13:54:58 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:18.110 13:54:58 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:18.110 nvmf_trace.0 00:21:18.110 13:54:58 -- common/autotest_common.sh@821 -- # return 0 00:21:18.110 13:54:58 -- target/tls.sh@16 -- # killprocess 2333208 00:21:18.110 13:54:58 -- common/autotest_common.sh@936 -- # '[' -z 2333208 ']' 00:21:18.110 13:54:58 -- common/autotest_common.sh@940 -- # kill -0 2333208 00:21:18.110 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2333208) - No such process 00:21:18.110 13:54:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2333208 is not found' 00:21:18.110 Process with pid 2333208 is not found 00:21:18.110 13:54:58 -- target/tls.sh@17 -- # nvmftestfini 00:21:18.110 13:54:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:18.369 13:54:58 -- nvmf/common.sh@116 -- # sync 00:21:18.369 13:54:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:18.369 13:54:58 -- nvmf/common.sh@119 -- # set +e 00:21:18.369 13:54:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:18.369 13:54:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:18.369 rmmod nvme_tcp 00:21:18.369 rmmod nvme_fabrics 00:21:18.369 rmmod nvme_keyring 00:21:18.369 13:54:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:18.369 13:54:58 -- nvmf/common.sh@123 -- # set -e 00:21:18.369 13:54:58 -- nvmf/common.sh@124 -- # return 0 00:21:18.369 13:54:58 -- nvmf/common.sh@477 -- # '[' -n 2333047 ']' 00:21:18.369 13:54:58 -- nvmf/common.sh@478 -- # killprocess 2333047 00:21:18.369 13:54:58 -- common/autotest_common.sh@936 -- # '[' -z 2333047 ']' 00:21:18.369 13:54:58 -- common/autotest_common.sh@940 -- # kill -0 2333047 00:21:18.369 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2333047) - No such process 00:21:18.369 13:54:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2333047 is not found' 00:21:18.369 Process with pid 2333047 is not found 00:21:18.369 13:54:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:18.369 13:54:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:18.369 13:54:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:18.369 13:54:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:18.369 13:54:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:18.369 13:54:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:18.369 13:54:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:18.369 13:54:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:20.276 13:55:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:20.276 13:55:00 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:20.276 00:21:20.276 real 1m15.997s 00:21:20.276 user 2m4.662s 00:21:20.276 sys 0m22.979s 00:21:20.276 13:55:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:20.276 13:55:00 -- common/autotest_common.sh@10 -- # set +x 00:21:20.276 ************************************ 00:21:20.276 END TEST nvmf_tls 00:21:20.276 ************************************ 00:21:20.276 13:55:00 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:20.276 13:55:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:20.276 13:55:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:20.276 13:55:00 -- common/autotest_common.sh@10 -- # set +x 00:21:20.276 ************************************ 00:21:20.276 START TEST nvmf_fips 00:21:20.276 ************************************ 00:21:20.276 13:55:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:20.536 * Looking for test storage... 00:21:20.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:20.536 13:55:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:20.536 13:55:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:20.536 13:55:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:20.536 13:55:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:20.536 13:55:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:20.536 13:55:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:20.536 13:55:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:20.536 13:55:00 -- scripts/common.sh@335 -- # IFS=.-: 00:21:20.536 13:55:00 -- scripts/common.sh@335 -- # read -ra ver1 00:21:20.536 13:55:00 -- scripts/common.sh@336 -- # IFS=.-: 00:21:20.536 13:55:00 -- scripts/common.sh@336 -- # read -ra ver2 00:21:20.536 13:55:00 -- scripts/common.sh@337 -- # local 'op=<' 00:21:20.536 13:55:00 -- scripts/common.sh@339 -- # ver1_l=2 00:21:20.536 13:55:00 -- scripts/common.sh@340 -- # ver2_l=1 00:21:20.536 13:55:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:20.536 13:55:00 -- scripts/common.sh@343 -- # case "$op" in 00:21:20.536 13:55:00 -- scripts/common.sh@344 -- # : 1 00:21:20.536 13:55:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:20.536 13:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:20.536 13:55:00 -- scripts/common.sh@364 -- # decimal 1 00:21:20.536 13:55:00 -- scripts/common.sh@352 -- # local d=1 00:21:20.536 13:55:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:20.536 13:55:00 -- scripts/common.sh@354 -- # echo 1 00:21:20.536 13:55:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # decimal 2 00:21:20.537 13:55:00 -- scripts/common.sh@352 -- # local d=2 00:21:20.537 13:55:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:20.537 13:55:00 -- scripts/common.sh@354 -- # echo 2 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:20.537 13:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:20.537 13:55:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:20.537 13:55:00 -- scripts/common.sh@367 -- # return 0 00:21:20.537 13:55:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:20.537 13:55:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:20.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:20.537 --rc genhtml_branch_coverage=1 00:21:20.537 --rc genhtml_function_coverage=1 00:21:20.537 --rc genhtml_legend=1 00:21:20.537 --rc geninfo_all_blocks=1 00:21:20.537 --rc geninfo_unexecuted_blocks=1 00:21:20.537 00:21:20.537 ' 00:21:20.537 13:55:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:20.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:20.537 --rc genhtml_branch_coverage=1 00:21:20.537 --rc genhtml_function_coverage=1 00:21:20.537 --rc genhtml_legend=1 00:21:20.537 --rc geninfo_all_blocks=1 00:21:20.537 --rc geninfo_unexecuted_blocks=1 00:21:20.537 00:21:20.537 ' 00:21:20.537 13:55:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:20.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:20.537 --rc genhtml_branch_coverage=1 00:21:20.537 --rc genhtml_function_coverage=1 00:21:20.537 --rc genhtml_legend=1 00:21:20.537 --rc geninfo_all_blocks=1 00:21:20.537 --rc geninfo_unexecuted_blocks=1 00:21:20.537 00:21:20.537 ' 00:21:20.537 13:55:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:20.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:20.537 --rc genhtml_branch_coverage=1 00:21:20.537 --rc genhtml_function_coverage=1 00:21:20.537 --rc genhtml_legend=1 00:21:20.537 --rc geninfo_all_blocks=1 00:21:20.537 --rc geninfo_unexecuted_blocks=1 00:21:20.537 00:21:20.537 ' 00:21:20.537 13:55:00 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:20.537 13:55:00 -- nvmf/common.sh@7 -- # uname -s 00:21:20.537 13:55:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:20.537 13:55:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:20.537 13:55:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:20.537 13:55:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:20.537 13:55:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:20.537 13:55:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:20.537 13:55:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:20.537 13:55:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:20.537 13:55:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:20.537 13:55:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:20.537 13:55:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:20.537 13:55:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:20.537 13:55:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:20.537 13:55:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:20.537 13:55:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:20.537 13:55:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:20.537 13:55:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:20.537 13:55:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:20.537 13:55:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:20.537 13:55:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:20.537 13:55:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:20.537 13:55:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:20.537 13:55:00 -- paths/export.sh@5 -- # export PATH 00:21:20.537 13:55:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:20.537 13:55:00 -- nvmf/common.sh@46 -- # : 0 00:21:20.537 13:55:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:20.537 13:55:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:20.537 13:55:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:20.537 13:55:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:20.537 13:55:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:20.537 13:55:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:20.537 13:55:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:20.537 13:55:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:20.537 13:55:00 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:20.537 13:55:00 -- fips/fips.sh@89 -- # check_openssl_version 00:21:20.537 13:55:00 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:20.537 13:55:00 -- fips/fips.sh@85 -- # openssl version 00:21:20.537 13:55:00 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:20.537 13:55:00 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:20.537 13:55:00 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:20.537 13:55:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:20.537 13:55:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:20.537 13:55:00 -- scripts/common.sh@335 -- # IFS=.-: 00:21:20.537 13:55:00 -- scripts/common.sh@335 -- # read -ra ver1 00:21:20.537 13:55:00 -- scripts/common.sh@336 -- # IFS=.-: 00:21:20.537 13:55:00 -- scripts/common.sh@336 -- # read -ra ver2 00:21:20.537 13:55:00 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:20.537 13:55:00 -- scripts/common.sh@339 -- # ver1_l=3 00:21:20.537 13:55:00 -- scripts/common.sh@340 -- # ver2_l=3 00:21:20.537 13:55:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:20.537 13:55:00 -- scripts/common.sh@343 -- # case "$op" in 00:21:20.537 13:55:00 -- scripts/common.sh@347 -- # : 1 00:21:20.537 13:55:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:20.537 13:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:20.537 13:55:00 -- scripts/common.sh@364 -- # decimal 3 00:21:20.537 13:55:00 -- scripts/common.sh@352 -- # local d=3 00:21:20.537 13:55:00 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:20.537 13:55:00 -- scripts/common.sh@354 -- # echo 3 00:21:20.537 13:55:00 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # decimal 3 00:21:20.537 13:55:00 -- scripts/common.sh@352 -- # local d=3 00:21:20.537 13:55:00 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:20.537 13:55:00 -- scripts/common.sh@354 -- # echo 3 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:20.537 13:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:20.537 13:55:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:20.537 13:55:00 -- scripts/common.sh@363 -- # (( v++ )) 00:21:20.537 13:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:20.537 13:55:00 -- scripts/common.sh@364 -- # decimal 1 00:21:20.537 13:55:00 -- scripts/common.sh@352 -- # local d=1 00:21:20.537 13:55:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:20.537 13:55:00 -- scripts/common.sh@354 -- # echo 1 00:21:20.537 13:55:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # decimal 0 00:21:20.537 13:55:00 -- scripts/common.sh@352 -- # local d=0 00:21:20.537 13:55:00 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:20.537 13:55:00 -- scripts/common.sh@354 -- # echo 0 00:21:20.537 13:55:00 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:20.537 13:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:20.537 13:55:00 -- scripts/common.sh@366 -- # return 0 00:21:20.537 13:55:00 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:20.537 13:55:00 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:20.537 13:55:00 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:20.537 13:55:00 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:20.537 13:55:00 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:20.537 13:55:00 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:20.537 13:55:00 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:20.537 13:55:00 -- fips/fips.sh@113 -- # build_openssl_config 00:21:20.537 13:55:00 -- fips/fips.sh@37 -- # cat 00:21:20.537 13:55:00 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:20.537 13:55:00 -- fips/fips.sh@58 -- # cat - 00:21:20.537 13:55:00 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:20.537 13:55:00 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:20.537 13:55:00 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:20.537 13:55:00 -- fips/fips.sh@116 -- # openssl list -providers 00:21:20.537 13:55:00 -- fips/fips.sh@116 -- # grep name 00:21:20.537 13:55:00 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:20.537 13:55:00 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:20.537 13:55:00 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:20.538 13:55:00 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:20.538 13:55:00 -- fips/fips.sh@127 -- # : 00:21:20.538 13:55:00 -- common/autotest_common.sh@650 -- # local es=0 00:21:20.538 13:55:00 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:20.538 13:55:00 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:20.538 13:55:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:20.538 13:55:00 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:20.538 13:55:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:20.538 13:55:00 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:20.538 13:55:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:20.538 13:55:00 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:20.538 13:55:00 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:20.538 13:55:00 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:20.538 Error setting digest 00:21:20.538 40125870287F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:20.538 40125870287F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:20.538 13:55:00 -- common/autotest_common.sh@653 -- # es=1 00:21:20.538 13:55:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:20.538 13:55:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:20.538 13:55:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:20.538 13:55:00 -- fips/fips.sh@130 -- # nvmftestinit 00:21:20.538 13:55:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:20.538 13:55:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:20.538 13:55:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:20.538 13:55:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:20.538 13:55:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:20.538 13:55:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:20.538 13:55:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:20.538 13:55:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:20.538 13:55:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:20.538 13:55:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:20.538 13:55:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:20.538 13:55:00 -- common/autotest_common.sh@10 -- # set +x 00:21:23.072 13:55:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:23.072 13:55:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:23.072 13:55:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:23.072 13:55:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:23.072 13:55:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:23.072 13:55:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:23.072 13:55:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:23.072 13:55:02 -- nvmf/common.sh@294 -- # net_devs=() 00:21:23.072 13:55:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:23.072 13:55:02 -- nvmf/common.sh@295 -- # e810=() 00:21:23.072 13:55:02 -- nvmf/common.sh@295 -- # local -ga e810 00:21:23.072 13:55:02 -- nvmf/common.sh@296 -- # x722=() 00:21:23.072 13:55:02 -- nvmf/common.sh@296 -- # local -ga x722 00:21:23.072 13:55:02 -- nvmf/common.sh@297 -- # mlx=() 00:21:23.072 13:55:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:23.072 13:55:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:23.072 13:55:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:23.072 13:55:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:23.072 13:55:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.072 13:55:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:23.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:23.072 13:55:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.072 13:55:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:23.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:23.072 13:55:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.072 13:55:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.072 13:55:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.072 13:55:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:23.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:23.072 13:55:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.072 13:55:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.072 13:55:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.072 13:55:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.072 13:55:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:23.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:23.072 13:55:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.072 13:55:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:23.072 13:55:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:23.072 13:55:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:23.072 13:55:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:23.072 13:55:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:23.072 13:55:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:23.072 13:55:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:23.072 13:55:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:23.072 13:55:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:23.073 13:55:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:23.073 13:55:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:23.073 13:55:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:23.073 13:55:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:23.073 13:55:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:23.073 13:55:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:23.073 13:55:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:23.073 13:55:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:23.073 13:55:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:23.073 13:55:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:23.073 13:55:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:23.073 13:55:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:23.073 13:55:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:23.073 13:55:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:23.073 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:23.073 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:21:23.073 00:21:23.073 --- 10.0.0.2 ping statistics --- 00:21:23.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.073 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:21:23.073 13:55:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:23.073 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:23.073 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:21:23.073 00:21:23.073 --- 10.0.0.1 ping statistics --- 00:21:23.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.073 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:21:23.073 13:55:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:23.073 13:55:02 -- nvmf/common.sh@410 -- # return 0 00:21:23.073 13:55:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:23.073 13:55:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:23.073 13:55:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:23.073 13:55:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:23.073 13:55:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:23.073 13:55:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:23.073 13:55:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:23.073 13:55:02 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:23.073 13:55:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:23.073 13:55:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:23.073 13:55:02 -- common/autotest_common.sh@10 -- # set +x 00:21:23.073 13:55:02 -- nvmf/common.sh@469 -- # nvmfpid=2336546 00:21:23.073 13:55:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:23.073 13:55:02 -- nvmf/common.sh@470 -- # waitforlisten 2336546 00:21:23.073 13:55:02 -- common/autotest_common.sh@829 -- # '[' -z 2336546 ']' 00:21:23.073 13:55:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:23.073 13:55:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.073 13:55:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:23.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:23.073 13:55:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.073 13:55:02 -- common/autotest_common.sh@10 -- # set +x 00:21:23.073 [2024-11-29 13:55:02.980739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:23.073 [2024-11-29 13:55:02.980815] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:23.073 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.073 [2024-11-29 13:55:03.047358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:23.073 [2024-11-29 13:55:03.139448] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:23.073 [2024-11-29 13:55:03.139623] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:23.073 [2024-11-29 13:55:03.139641] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:23.073 [2024-11-29 13:55:03.139654] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:23.073 [2024-11-29 13:55:03.139685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:24.010 13:55:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:24.010 13:55:04 -- common/autotest_common.sh@862 -- # return 0 00:21:24.010 13:55:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:24.010 13:55:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:24.010 13:55:04 -- common/autotest_common.sh@10 -- # set +x 00:21:24.010 13:55:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:24.010 13:55:04 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:24.010 13:55:04 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:24.010 13:55:04 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.010 13:55:04 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:24.010 13:55:04 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.010 13:55:04 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.010 13:55:04 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.010 13:55:04 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:24.010 [2024-11-29 13:55:04.272716] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:24.010 [2024-11-29 13:55:04.288707] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:24.010 [2024-11-29 13:55:04.288969] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:24.268 malloc0 00:21:24.268 13:55:04 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:24.268 13:55:04 -- fips/fips.sh@147 -- # bdevperf_pid=2336752 00:21:24.268 13:55:04 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:24.268 13:55:04 -- fips/fips.sh@148 -- # waitforlisten 2336752 /var/tmp/bdevperf.sock 00:21:24.268 13:55:04 -- common/autotest_common.sh@829 -- # '[' -z 2336752 ']' 00:21:24.268 13:55:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:24.268 13:55:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:24.268 13:55:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:24.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:24.268 13:55:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:24.268 13:55:04 -- common/autotest_common.sh@10 -- # set +x 00:21:24.268 [2024-11-29 13:55:04.410173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:24.268 [2024-11-29 13:55:04.410260] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336752 ] 00:21:24.268 EAL: No free 2048 kB hugepages reported on node 1 00:21:24.268 [2024-11-29 13:55:04.471951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:24.526 [2024-11-29 13:55:04.557006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:25.475 13:55:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:25.475 13:55:05 -- common/autotest_common.sh@862 -- # return 0 00:21:25.475 13:55:05 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:25.475 [2024-11-29 13:55:05.643804] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:25.475 TLSTESTn1 00:21:25.475 13:55:05 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:25.733 Running I/O for 10 seconds... 00:21:35.706 00:21:35.706 Latency(us) 00:21:35.706 [2024-11-29T12:55:15.988Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:35.706 [2024-11-29T12:55:15.988Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:35.706 Verification LBA range: start 0x0 length 0x2000 00:21:35.706 TLSTESTn1 : 10.02 4659.07 18.20 0.00 0.00 27435.12 7136.14 46215.02 00:21:35.706 [2024-11-29T12:55:15.988Z] =================================================================================================================== 00:21:35.706 [2024-11-29T12:55:15.988Z] Total : 4659.07 18.20 0.00 0.00 27435.12 7136.14 46215.02 00:21:35.706 0 00:21:35.706 13:55:15 -- fips/fips.sh@1 -- # cleanup 00:21:35.706 13:55:15 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:35.706 13:55:15 -- common/autotest_common.sh@806 -- # type=--id 00:21:35.706 13:55:15 -- common/autotest_common.sh@807 -- # id=0 00:21:35.706 13:55:15 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:35.706 13:55:15 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:35.706 13:55:15 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:35.706 13:55:15 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:35.706 13:55:15 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:35.706 13:55:15 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:35.706 nvmf_trace.0 00:21:35.706 13:55:15 -- common/autotest_common.sh@821 -- # return 0 00:21:35.706 13:55:15 -- fips/fips.sh@16 -- # killprocess 2336752 00:21:35.706 13:55:15 -- common/autotest_common.sh@936 -- # '[' -z 2336752 ']' 00:21:35.706 13:55:15 -- common/autotest_common.sh@940 -- # kill -0 2336752 00:21:35.706 13:55:15 -- common/autotest_common.sh@941 -- # uname 00:21:35.706 13:55:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:35.706 13:55:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2336752 00:21:35.706 13:55:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:35.706 13:55:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:35.706 13:55:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2336752' 00:21:35.706 killing process with pid 2336752 00:21:35.706 13:55:15 -- common/autotest_common.sh@955 -- # kill 2336752 00:21:35.706 Received shutdown signal, test time was about 10.000000 seconds 00:21:35.706 00:21:35.706 Latency(us) 00:21:35.706 [2024-11-29T12:55:15.988Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:35.706 [2024-11-29T12:55:15.988Z] =================================================================================================================== 00:21:35.706 [2024-11-29T12:55:15.988Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:35.706 13:55:15 -- common/autotest_common.sh@960 -- # wait 2336752 00:21:35.964 13:55:16 -- fips/fips.sh@17 -- # nvmftestfini 00:21:35.964 13:55:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:35.964 13:55:16 -- nvmf/common.sh@116 -- # sync 00:21:35.964 13:55:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:35.964 13:55:16 -- nvmf/common.sh@119 -- # set +e 00:21:35.964 13:55:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:35.964 13:55:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:35.964 rmmod nvme_tcp 00:21:35.964 rmmod nvme_fabrics 00:21:35.964 rmmod nvme_keyring 00:21:36.222 13:55:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:36.222 13:55:16 -- nvmf/common.sh@123 -- # set -e 00:21:36.222 13:55:16 -- nvmf/common.sh@124 -- # return 0 00:21:36.222 13:55:16 -- nvmf/common.sh@477 -- # '[' -n 2336546 ']' 00:21:36.222 13:55:16 -- nvmf/common.sh@478 -- # killprocess 2336546 00:21:36.222 13:55:16 -- common/autotest_common.sh@936 -- # '[' -z 2336546 ']' 00:21:36.223 13:55:16 -- common/autotest_common.sh@940 -- # kill -0 2336546 00:21:36.223 13:55:16 -- common/autotest_common.sh@941 -- # uname 00:21:36.223 13:55:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:36.223 13:55:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2336546 00:21:36.223 13:55:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:36.223 13:55:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:36.223 13:55:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2336546' 00:21:36.223 killing process with pid 2336546 00:21:36.223 13:55:16 -- common/autotest_common.sh@955 -- # kill 2336546 00:21:36.223 13:55:16 -- common/autotest_common.sh@960 -- # wait 2336546 00:21:36.481 13:55:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:36.481 13:55:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:36.481 13:55:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:36.481 13:55:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:36.481 13:55:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:36.481 13:55:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:36.481 13:55:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:36.481 13:55:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:38.385 13:55:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:38.385 13:55:18 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:38.385 00:21:38.385 real 0m18.092s 00:21:38.385 user 0m24.051s 00:21:38.385 sys 0m5.667s 00:21:38.385 13:55:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:38.385 13:55:18 -- common/autotest_common.sh@10 -- # set +x 00:21:38.385 ************************************ 00:21:38.385 END TEST nvmf_fips 00:21:38.385 ************************************ 00:21:38.385 13:55:18 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:38.385 13:55:18 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:38.385 13:55:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:38.385 13:55:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:38.385 13:55:18 -- common/autotest_common.sh@10 -- # set +x 00:21:38.385 ************************************ 00:21:38.385 START TEST nvmf_fuzz 00:21:38.385 ************************************ 00:21:38.385 13:55:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:38.647 * Looking for test storage... 00:21:38.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:38.647 13:55:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:38.647 13:55:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:38.647 13:55:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:38.647 13:55:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:38.647 13:55:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:38.647 13:55:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:38.647 13:55:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:38.647 13:55:18 -- scripts/common.sh@335 -- # IFS=.-: 00:21:38.647 13:55:18 -- scripts/common.sh@335 -- # read -ra ver1 00:21:38.647 13:55:18 -- scripts/common.sh@336 -- # IFS=.-: 00:21:38.647 13:55:18 -- scripts/common.sh@336 -- # read -ra ver2 00:21:38.647 13:55:18 -- scripts/common.sh@337 -- # local 'op=<' 00:21:38.647 13:55:18 -- scripts/common.sh@339 -- # ver1_l=2 00:21:38.647 13:55:18 -- scripts/common.sh@340 -- # ver2_l=1 00:21:38.647 13:55:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:38.647 13:55:18 -- scripts/common.sh@343 -- # case "$op" in 00:21:38.647 13:55:18 -- scripts/common.sh@344 -- # : 1 00:21:38.647 13:55:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:38.647 13:55:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:38.647 13:55:18 -- scripts/common.sh@364 -- # decimal 1 00:21:38.647 13:55:18 -- scripts/common.sh@352 -- # local d=1 00:21:38.647 13:55:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:38.647 13:55:18 -- scripts/common.sh@354 -- # echo 1 00:21:38.647 13:55:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:38.647 13:55:18 -- scripts/common.sh@365 -- # decimal 2 00:21:38.647 13:55:18 -- scripts/common.sh@352 -- # local d=2 00:21:38.647 13:55:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:38.647 13:55:18 -- scripts/common.sh@354 -- # echo 2 00:21:38.647 13:55:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:38.647 13:55:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:38.647 13:55:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:38.647 13:55:18 -- scripts/common.sh@367 -- # return 0 00:21:38.647 13:55:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:38.647 13:55:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:38.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.647 --rc genhtml_branch_coverage=1 00:21:38.647 --rc genhtml_function_coverage=1 00:21:38.647 --rc genhtml_legend=1 00:21:38.647 --rc geninfo_all_blocks=1 00:21:38.647 --rc geninfo_unexecuted_blocks=1 00:21:38.647 00:21:38.647 ' 00:21:38.647 13:55:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:38.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.647 --rc genhtml_branch_coverage=1 00:21:38.647 --rc genhtml_function_coverage=1 00:21:38.647 --rc genhtml_legend=1 00:21:38.647 --rc geninfo_all_blocks=1 00:21:38.647 --rc geninfo_unexecuted_blocks=1 00:21:38.647 00:21:38.647 ' 00:21:38.647 13:55:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:38.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.647 --rc genhtml_branch_coverage=1 00:21:38.647 --rc genhtml_function_coverage=1 00:21:38.647 --rc genhtml_legend=1 00:21:38.647 --rc geninfo_all_blocks=1 00:21:38.647 --rc geninfo_unexecuted_blocks=1 00:21:38.647 00:21:38.647 ' 00:21:38.647 13:55:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:38.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.647 --rc genhtml_branch_coverage=1 00:21:38.647 --rc genhtml_function_coverage=1 00:21:38.647 --rc genhtml_legend=1 00:21:38.647 --rc geninfo_all_blocks=1 00:21:38.647 --rc geninfo_unexecuted_blocks=1 00:21:38.647 00:21:38.647 ' 00:21:38.647 13:55:18 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:38.647 13:55:18 -- nvmf/common.sh@7 -- # uname -s 00:21:38.647 13:55:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:38.647 13:55:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:38.647 13:55:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:38.647 13:55:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:38.647 13:55:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:38.647 13:55:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:38.647 13:55:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:38.647 13:55:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:38.647 13:55:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:38.647 13:55:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:38.647 13:55:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:38.647 13:55:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:38.647 13:55:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:38.647 13:55:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:38.647 13:55:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:38.647 13:55:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:38.647 13:55:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:38.647 13:55:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:38.647 13:55:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:38.647 13:55:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.647 13:55:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.647 13:55:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.647 13:55:18 -- paths/export.sh@5 -- # export PATH 00:21:38.647 13:55:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.647 13:55:18 -- nvmf/common.sh@46 -- # : 0 00:21:38.647 13:55:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:38.647 13:55:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:38.647 13:55:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:38.647 13:55:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:38.647 13:55:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:38.647 13:55:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:38.647 13:55:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:38.647 13:55:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:38.647 13:55:18 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:38.647 13:55:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:38.647 13:55:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:38.647 13:55:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:38.647 13:55:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:38.647 13:55:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:38.647 13:55:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.647 13:55:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:38.647 13:55:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:38.647 13:55:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:38.647 13:55:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:38.647 13:55:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:38.647 13:55:18 -- common/autotest_common.sh@10 -- # set +x 00:21:40.554 13:55:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.554 13:55:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.554 13:55:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.554 13:55:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.554 13:55:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.554 13:55:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.554 13:55:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.554 13:55:20 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.554 13:55:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.554 13:55:20 -- nvmf/common.sh@295 -- # e810=() 00:21:40.554 13:55:20 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.554 13:55:20 -- nvmf/common.sh@296 -- # x722=() 00:21:40.554 13:55:20 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.554 13:55:20 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.554 13:55:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.554 13:55:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.554 13:55:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.554 13:55:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.554 13:55:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.554 13:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.554 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.554 13:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.554 13:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.554 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.554 13:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.554 13:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.554 13:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.554 13:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.554 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.554 13:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.554 13:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.554 13:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.554 13:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.554 13:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.554 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.554 13:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.554 13:55:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:40.554 13:55:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:40.554 13:55:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:40.554 13:55:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:40.554 13:55:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:40.554 13:55:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.554 13:55:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:40.554 13:55:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:40.554 13:55:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:40.554 13:55:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:40.554 13:55:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:40.554 13:55:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:40.554 13:55:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:40.554 13:55:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:40.554 13:55:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:40.554 13:55:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:40.554 13:55:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:40.554 13:55:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:40.812 13:55:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:40.812 13:55:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:40.812 13:55:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:40.812 13:55:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:40.812 13:55:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:40.812 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:40.812 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:21:40.812 00:21:40.812 --- 10.0.0.2 ping statistics --- 00:21:40.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.812 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:21:40.812 13:55:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:40.812 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:40.812 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:21:40.812 00:21:40.812 --- 10.0.0.1 ping statistics --- 00:21:40.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.812 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:21:40.813 13:55:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:40.813 13:55:20 -- nvmf/common.sh@410 -- # return 0 00:21:40.813 13:55:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:40.813 13:55:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:40.813 13:55:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:40.813 13:55:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:40.813 13:55:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:40.813 13:55:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:40.813 13:55:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:40.813 13:55:20 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2340145 00:21:40.813 13:55:20 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:40.813 13:55:20 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:40.813 13:55:20 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2340145 00:21:40.813 13:55:20 -- common/autotest_common.sh@829 -- # '[' -z 2340145 ']' 00:21:40.813 13:55:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:40.813 13:55:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:40.813 13:55:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:40.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:40.813 13:55:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:40.813 13:55:20 -- common/autotest_common.sh@10 -- # set +x 00:21:41.747 13:55:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:41.747 13:55:21 -- common/autotest_common.sh@862 -- # return 0 00:21:41.747 13:55:21 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:41.747 13:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.747 13:55:21 -- common/autotest_common.sh@10 -- # set +x 00:21:41.747 13:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.747 13:55:21 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:41.747 13:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.747 13:55:21 -- common/autotest_common.sh@10 -- # set +x 00:21:42.004 Malloc0 00:21:42.004 13:55:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.004 13:55:22 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:42.004 13:55:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.004 13:55:22 -- common/autotest_common.sh@10 -- # set +x 00:21:42.004 13:55:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.004 13:55:22 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:42.004 13:55:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.004 13:55:22 -- common/autotest_common.sh@10 -- # set +x 00:21:42.004 13:55:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.004 13:55:22 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:42.004 13:55:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.004 13:55:22 -- common/autotest_common.sh@10 -- # set +x 00:21:42.004 13:55:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.004 13:55:22 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:42.004 13:55:22 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:14.163 Fuzzing completed. Shutting down the fuzz application 00:22:14.163 00:22:14.163 Dumping successful admin opcodes: 00:22:14.163 8, 9, 10, 24, 00:22:14.163 Dumping successful io opcodes: 00:22:14.163 0, 9, 00:22:14.163 NS: 0x200003aeff00 I/O qp, Total commands completed: 483965, total successful commands: 2790, random_seed: 4068208512 00:22:14.163 NS: 0x200003aeff00 admin qp, Total commands completed: 58000, total successful commands: 462, random_seed: 1746007872 00:22:14.163 13:55:52 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:14.163 Fuzzing completed. Shutting down the fuzz application 00:22:14.163 00:22:14.163 Dumping successful admin opcodes: 00:22:14.163 24, 00:22:14.163 Dumping successful io opcodes: 00:22:14.163 00:22:14.163 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1679160720 00:22:14.163 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1679287728 00:22:14.163 13:55:53 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:14.163 13:55:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.163 13:55:53 -- common/autotest_common.sh@10 -- # set +x 00:22:14.163 13:55:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.163 13:55:53 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:14.163 13:55:53 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:14.163 13:55:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.163 13:55:53 -- nvmf/common.sh@116 -- # sync 00:22:14.163 13:55:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.163 13:55:53 -- nvmf/common.sh@119 -- # set +e 00:22:14.163 13:55:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.163 13:55:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.163 rmmod nvme_tcp 00:22:14.163 rmmod nvme_fabrics 00:22:14.163 rmmod nvme_keyring 00:22:14.163 13:55:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.163 13:55:53 -- nvmf/common.sh@123 -- # set -e 00:22:14.163 13:55:53 -- nvmf/common.sh@124 -- # return 0 00:22:14.163 13:55:53 -- nvmf/common.sh@477 -- # '[' -n 2340145 ']' 00:22:14.163 13:55:53 -- nvmf/common.sh@478 -- # killprocess 2340145 00:22:14.163 13:55:53 -- common/autotest_common.sh@936 -- # '[' -z 2340145 ']' 00:22:14.163 13:55:53 -- common/autotest_common.sh@940 -- # kill -0 2340145 00:22:14.163 13:55:53 -- common/autotest_common.sh@941 -- # uname 00:22:14.163 13:55:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.163 13:55:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2340145 00:22:14.163 13:55:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.163 13:55:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.163 13:55:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2340145' 00:22:14.163 killing process with pid 2340145 00:22:14.163 13:55:53 -- common/autotest_common.sh@955 -- # kill 2340145 00:22:14.163 13:55:53 -- common/autotest_common.sh@960 -- # wait 2340145 00:22:14.163 13:55:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:14.163 13:55:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:14.163 13:55:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:14.163 13:55:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:14.163 13:55:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:14.163 13:55:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.163 13:55:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.163 13:55:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.071 13:55:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:16.071 13:55:56 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:16.071 00:22:16.071 real 0m37.685s 00:22:16.071 user 0m52.913s 00:22:16.071 sys 0m14.695s 00:22:16.071 13:55:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:16.071 13:55:56 -- common/autotest_common.sh@10 -- # set +x 00:22:16.071 ************************************ 00:22:16.071 END TEST nvmf_fuzz 00:22:16.071 ************************************ 00:22:16.071 13:55:56 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:16.071 13:55:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:16.071 13:55:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:16.071 13:55:56 -- common/autotest_common.sh@10 -- # set +x 00:22:16.071 ************************************ 00:22:16.071 START TEST nvmf_multiconnection 00:22:16.071 ************************************ 00:22:16.071 13:55:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:16.330 * Looking for test storage... 00:22:16.330 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:16.330 13:55:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:16.330 13:55:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:16.330 13:55:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:16.330 13:55:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:16.330 13:55:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:16.330 13:55:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:16.330 13:55:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:16.330 13:55:56 -- scripts/common.sh@335 -- # IFS=.-: 00:22:16.330 13:55:56 -- scripts/common.sh@335 -- # read -ra ver1 00:22:16.330 13:55:56 -- scripts/common.sh@336 -- # IFS=.-: 00:22:16.330 13:55:56 -- scripts/common.sh@336 -- # read -ra ver2 00:22:16.330 13:55:56 -- scripts/common.sh@337 -- # local 'op=<' 00:22:16.330 13:55:56 -- scripts/common.sh@339 -- # ver1_l=2 00:22:16.330 13:55:56 -- scripts/common.sh@340 -- # ver2_l=1 00:22:16.330 13:55:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:16.330 13:55:56 -- scripts/common.sh@343 -- # case "$op" in 00:22:16.330 13:55:56 -- scripts/common.sh@344 -- # : 1 00:22:16.330 13:55:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:16.330 13:55:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:16.330 13:55:56 -- scripts/common.sh@364 -- # decimal 1 00:22:16.330 13:55:56 -- scripts/common.sh@352 -- # local d=1 00:22:16.330 13:55:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:16.330 13:55:56 -- scripts/common.sh@354 -- # echo 1 00:22:16.330 13:55:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:16.330 13:55:56 -- scripts/common.sh@365 -- # decimal 2 00:22:16.330 13:55:56 -- scripts/common.sh@352 -- # local d=2 00:22:16.330 13:55:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:16.330 13:55:56 -- scripts/common.sh@354 -- # echo 2 00:22:16.330 13:55:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:16.330 13:55:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:16.330 13:55:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:16.330 13:55:56 -- scripts/common.sh@367 -- # return 0 00:22:16.330 13:55:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:16.330 13:55:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:16.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.330 --rc genhtml_branch_coverage=1 00:22:16.330 --rc genhtml_function_coverage=1 00:22:16.330 --rc genhtml_legend=1 00:22:16.330 --rc geninfo_all_blocks=1 00:22:16.330 --rc geninfo_unexecuted_blocks=1 00:22:16.330 00:22:16.330 ' 00:22:16.330 13:55:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:16.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.330 --rc genhtml_branch_coverage=1 00:22:16.330 --rc genhtml_function_coverage=1 00:22:16.330 --rc genhtml_legend=1 00:22:16.330 --rc geninfo_all_blocks=1 00:22:16.330 --rc geninfo_unexecuted_blocks=1 00:22:16.330 00:22:16.330 ' 00:22:16.330 13:55:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:16.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.330 --rc genhtml_branch_coverage=1 00:22:16.330 --rc genhtml_function_coverage=1 00:22:16.330 --rc genhtml_legend=1 00:22:16.330 --rc geninfo_all_blocks=1 00:22:16.330 --rc geninfo_unexecuted_blocks=1 00:22:16.330 00:22:16.330 ' 00:22:16.330 13:55:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:16.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.330 --rc genhtml_branch_coverage=1 00:22:16.330 --rc genhtml_function_coverage=1 00:22:16.330 --rc genhtml_legend=1 00:22:16.330 --rc geninfo_all_blocks=1 00:22:16.330 --rc geninfo_unexecuted_blocks=1 00:22:16.330 00:22:16.330 ' 00:22:16.330 13:55:56 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:16.330 13:55:56 -- nvmf/common.sh@7 -- # uname -s 00:22:16.330 13:55:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:16.330 13:55:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:16.330 13:55:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:16.330 13:55:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:16.330 13:55:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:16.330 13:55:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:16.330 13:55:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:16.330 13:55:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:16.330 13:55:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:16.330 13:55:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:16.330 13:55:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:16.330 13:55:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:16.330 13:55:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:16.330 13:55:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:16.330 13:55:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:16.330 13:55:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:16.330 13:55:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:16.330 13:55:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:16.330 13:55:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:16.330 13:55:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.330 13:55:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.330 13:55:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.330 13:55:56 -- paths/export.sh@5 -- # export PATH 00:22:16.330 13:55:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.330 13:55:56 -- nvmf/common.sh@46 -- # : 0 00:22:16.330 13:55:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:16.330 13:55:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:16.330 13:55:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:16.330 13:55:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:16.330 13:55:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:16.330 13:55:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:16.330 13:55:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:16.330 13:55:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:16.330 13:55:56 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:16.330 13:55:56 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:16.330 13:55:56 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:16.330 13:55:56 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:16.330 13:55:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:16.330 13:55:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:16.330 13:55:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:16.330 13:55:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:16.330 13:55:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:16.330 13:55:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.330 13:55:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:16.330 13:55:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.330 13:55:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:16.330 13:55:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:16.330 13:55:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:16.330 13:55:56 -- common/autotest_common.sh@10 -- # set +x 00:22:18.864 13:55:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:18.864 13:55:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:18.864 13:55:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:18.864 13:55:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:18.864 13:55:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:18.864 13:55:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:18.864 13:55:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:18.864 13:55:58 -- nvmf/common.sh@294 -- # net_devs=() 00:22:18.864 13:55:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:18.864 13:55:58 -- nvmf/common.sh@295 -- # e810=() 00:22:18.864 13:55:58 -- nvmf/common.sh@295 -- # local -ga e810 00:22:18.864 13:55:58 -- nvmf/common.sh@296 -- # x722=() 00:22:18.864 13:55:58 -- nvmf/common.sh@296 -- # local -ga x722 00:22:18.864 13:55:58 -- nvmf/common.sh@297 -- # mlx=() 00:22:18.864 13:55:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:18.864 13:55:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:18.864 13:55:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:18.864 13:55:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:18.864 13:55:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:18.864 13:55:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.864 13:55:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:18.864 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:18.864 13:55:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.864 13:55:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:18.864 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:18.864 13:55:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.864 13:55:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:18.864 13:55:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.865 13:55:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.865 13:55:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.865 13:55:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.865 13:55:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:18.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:18.865 13:55:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.865 13:55:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.865 13:55:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.865 13:55:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.865 13:55:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.865 13:55:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:18.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:18.865 13:55:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.865 13:55:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:18.865 13:55:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:18.865 13:55:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:18.865 13:55:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:18.865 13:55:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:18.865 13:55:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:18.865 13:55:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:18.865 13:55:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:18.865 13:55:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:18.865 13:55:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:18.865 13:55:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:18.865 13:55:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:18.865 13:55:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:18.865 13:55:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:18.865 13:55:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:18.865 13:55:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:18.865 13:55:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:18.865 13:55:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.865 13:55:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.865 13:55:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.865 13:55:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.865 13:55:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.865 13:55:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.865 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.865 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:22:18.865 00:22:18.865 --- 10.0.0.2 ping statistics --- 00:22:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.865 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:22:18.865 13:55:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.865 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.865 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:22:18.865 00:22:18.865 --- 10.0.0.1 ping statistics --- 00:22:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.865 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:22:18.865 13:55:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.865 13:55:58 -- nvmf/common.sh@410 -- # return 0 00:22:18.865 13:55:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.865 13:55:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.865 13:55:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.865 13:55:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.865 13:55:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.865 13:55:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.865 13:55:58 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:18.865 13:55:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.865 13:55:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.865 13:55:58 -- common/autotest_common.sh@10 -- # set +x 00:22:18.865 13:55:58 -- nvmf/common.sh@469 -- # nvmfpid=2346029 00:22:18.865 13:55:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:18.865 13:55:58 -- nvmf/common.sh@470 -- # waitforlisten 2346029 00:22:18.865 13:55:58 -- common/autotest_common.sh@829 -- # '[' -z 2346029 ']' 00:22:18.865 13:55:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.865 13:55:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:18.865 13:55:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.865 13:55:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:18.865 13:55:58 -- common/autotest_common.sh@10 -- # set +x 00:22:18.865 [2024-11-29 13:55:58.871665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:18.865 [2024-11-29 13:55:58.871768] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.865 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.865 [2024-11-29 13:55:58.948683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.865 [2024-11-29 13:55:59.042910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.865 [2024-11-29 13:55:59.043074] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.865 [2024-11-29 13:55:59.043104] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.865 [2024-11-29 13:55:59.043118] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.865 [2024-11-29 13:55:59.043208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.865 [2024-11-29 13:55:59.043273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.865 [2024-11-29 13:55:59.043329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.865 [2024-11-29 13:55:59.043327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:19.803 13:55:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:19.803 13:55:59 -- common/autotest_common.sh@862 -- # return 0 00:22:19.803 13:55:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:19.803 13:55:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.804 13:55:59 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 [2024-11-29 13:55:59.864047] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:19.804 13:55:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.804 13:55:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 Malloc1 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 [2024-11-29 13:55:59.921565] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.804 13:55:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 Malloc2 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.804 13:55:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 Malloc3 00:22:19.804 13:55:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:55:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:19.804 13:55:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:55:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.804 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 Malloc4 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.804 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.804 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.804 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:19.804 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.804 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc5 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.063 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc6 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.063 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc7 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.063 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc8 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.063 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc9 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.063 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.063 Malloc10 00:22:20.063 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.063 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:20.063 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.063 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.321 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.321 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:20.321 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.321 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.321 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.321 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:20.321 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.321 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.321 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.321 13:56:00 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.321 13:56:00 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:20.321 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.321 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.321 Malloc11 00:22:20.321 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.322 13:56:00 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:20.322 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.322 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.322 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.322 13:56:00 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:20.322 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.322 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.322 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.322 13:56:00 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:20.322 13:56:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.322 13:56:00 -- common/autotest_common.sh@10 -- # set +x 00:22:20.322 13:56:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.322 13:56:00 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:20.322 13:56:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.322 13:56:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:20.890 13:56:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:20.890 13:56:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:20.890 13:56:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.890 13:56:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:20.890 13:56:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:22.804 13:56:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:22.804 13:56:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:22.804 13:56:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:22.804 13:56:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:22.804 13:56:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.804 13:56:03 -- common/autotest_common.sh@1197 -- # return 0 00:22:22.804 13:56:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.804 13:56:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:23.744 13:56:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:23.744 13:56:03 -- common/autotest_common.sh@1187 -- # local i=0 00:22:23.744 13:56:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.744 13:56:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:23.744 13:56:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:25.665 13:56:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:25.665 13:56:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:25.665 13:56:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:25.665 13:56:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:25.666 13:56:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:25.666 13:56:05 -- common/autotest_common.sh@1197 -- # return 0 00:22:25.666 13:56:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.666 13:56:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:26.235 13:56:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:26.235 13:56:06 -- common/autotest_common.sh@1187 -- # local i=0 00:22:26.235 13:56:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:26.235 13:56:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:26.235 13:56:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:28.136 13:56:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:28.136 13:56:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:28.136 13:56:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:28.136 13:56:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:28.136 13:56:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:28.136 13:56:08 -- common/autotest_common.sh@1197 -- # return 0 00:22:28.136 13:56:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:28.136 13:56:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:29.073 13:56:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:29.073 13:56:09 -- common/autotest_common.sh@1187 -- # local i=0 00:22:29.073 13:56:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:29.073 13:56:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:29.073 13:56:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:30.982 13:56:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:30.982 13:56:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:30.982 13:56:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:30.982 13:56:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:30.982 13:56:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:30.982 13:56:11 -- common/autotest_common.sh@1197 -- # return 0 00:22:30.982 13:56:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:30.982 13:56:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:31.917 13:56:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:31.917 13:56:11 -- common/autotest_common.sh@1187 -- # local i=0 00:22:31.917 13:56:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:31.917 13:56:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:31.917 13:56:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:33.826 13:56:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:33.826 13:56:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:33.826 13:56:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:33.826 13:56:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:33.826 13:56:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:33.826 13:56:14 -- common/autotest_common.sh@1197 -- # return 0 00:22:33.826 13:56:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:33.826 13:56:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:34.766 13:56:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:34.766 13:56:14 -- common/autotest_common.sh@1187 -- # local i=0 00:22:34.766 13:56:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:34.766 13:56:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:34.766 13:56:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:36.682 13:56:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:36.682 13:56:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:36.682 13:56:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:36.682 13:56:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:36.682 13:56:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:36.682 13:56:16 -- common/autotest_common.sh@1197 -- # return 0 00:22:36.682 13:56:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:36.682 13:56:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:37.620 13:56:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:37.620 13:56:17 -- common/autotest_common.sh@1187 -- # local i=0 00:22:37.620 13:56:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:37.620 13:56:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:37.620 13:56:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:39.528 13:56:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:39.528 13:56:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:39.528 13:56:19 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:39.528 13:56:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:39.528 13:56:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:39.528 13:56:19 -- common/autotest_common.sh@1197 -- # return 0 00:22:39.528 13:56:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.528 13:56:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:40.515 13:56:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:40.515 13:56:20 -- common/autotest_common.sh@1187 -- # local i=0 00:22:40.515 13:56:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:40.515 13:56:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:40.515 13:56:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:42.422 13:56:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:42.422 13:56:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:42.422 13:56:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:42.422 13:56:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:42.422 13:56:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:42.422 13:56:22 -- common/autotest_common.sh@1197 -- # return 0 00:22:42.422 13:56:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:42.422 13:56:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:42.993 13:56:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:42.993 13:56:23 -- common/autotest_common.sh@1187 -- # local i=0 00:22:42.993 13:56:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:42.993 13:56:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:42.993 13:56:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:45.528 13:56:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:45.528 13:56:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:45.528 13:56:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:45.528 13:56:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:45.528 13:56:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:45.528 13:56:25 -- common/autotest_common.sh@1197 -- # return 0 00:22:45.528 13:56:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.528 13:56:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:45.789 13:56:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:45.789 13:56:26 -- common/autotest_common.sh@1187 -- # local i=0 00:22:45.789 13:56:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:45.789 13:56:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:45.789 13:56:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:48.325 13:56:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:48.325 13:56:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:48.325 13:56:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:48.325 13:56:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:48.325 13:56:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:48.325 13:56:28 -- common/autotest_common.sh@1197 -- # return 0 00:22:48.325 13:56:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:48.325 13:56:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:48.893 13:56:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:48.893 13:56:28 -- common/autotest_common.sh@1187 -- # local i=0 00:22:48.893 13:56:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:48.893 13:56:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:48.893 13:56:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:50.799 13:56:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:50.799 13:56:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:50.799 13:56:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:50.799 13:56:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:50.799 13:56:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:50.799 13:56:30 -- common/autotest_common.sh@1197 -- # return 0 00:22:50.799 13:56:30 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:50.799 [global] 00:22:50.799 thread=1 00:22:50.799 invalidate=1 00:22:50.799 rw=read 00:22:50.799 time_based=1 00:22:50.799 runtime=10 00:22:50.799 ioengine=libaio 00:22:50.799 direct=1 00:22:50.799 bs=262144 00:22:50.799 iodepth=64 00:22:50.799 norandommap=1 00:22:50.799 numjobs=1 00:22:50.799 00:22:50.799 [job0] 00:22:50.799 filename=/dev/nvme0n1 00:22:50.799 [job1] 00:22:50.799 filename=/dev/nvme10n1 00:22:50.799 [job2] 00:22:50.799 filename=/dev/nvme1n1 00:22:50.799 [job3] 00:22:50.799 filename=/dev/nvme2n1 00:22:50.799 [job4] 00:22:50.799 filename=/dev/nvme3n1 00:22:50.799 [job5] 00:22:50.799 filename=/dev/nvme4n1 00:22:50.799 [job6] 00:22:50.799 filename=/dev/nvme5n1 00:22:50.799 [job7] 00:22:50.799 filename=/dev/nvme6n1 00:22:50.799 [job8] 00:22:50.799 filename=/dev/nvme7n1 00:22:50.799 [job9] 00:22:50.799 filename=/dev/nvme8n1 00:22:50.799 [job10] 00:22:50.799 filename=/dev/nvme9n1 00:22:51.058 Could not set queue depth (nvme0n1) 00:22:51.058 Could not set queue depth (nvme10n1) 00:22:51.058 Could not set queue depth (nvme1n1) 00:22:51.058 Could not set queue depth (nvme2n1) 00:22:51.058 Could not set queue depth (nvme3n1) 00:22:51.058 Could not set queue depth (nvme4n1) 00:22:51.058 Could not set queue depth (nvme5n1) 00:22:51.058 Could not set queue depth (nvme6n1) 00:22:51.058 Could not set queue depth (nvme7n1) 00:22:51.058 Could not set queue depth (nvme8n1) 00:22:51.058 Could not set queue depth (nvme9n1) 00:22:51.058 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:51.058 fio-3.35 00:22:51.058 Starting 11 threads 00:23:03.264 00:23:03.264 job0: (groupid=0, jobs=1): err= 0: pid=2350524: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=638, BW=160MiB/s (167MB/s)(1601MiB/10024msec) 00:23:03.265 slat (usec): min=8, max=125908, avg=833.08, stdev=4959.27 00:23:03.265 clat (msec): min=2, max=297, avg=99.31, stdev=57.88 00:23:03.265 lat (msec): min=2, max=401, avg=100.14, stdev=58.52 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 40], 00:23:03.265 | 30.00th=[ 58], 40.00th=[ 82], 50.00th=[ 95], 60.00th=[ 111], 00:23:03.265 | 70.00th=[ 136], 80.00th=[ 157], 90.00th=[ 178], 95.00th=[ 190], 00:23:03.265 | 99.00th=[ 245], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 275], 00:23:03.265 | 99.99th=[ 296] 00:23:03.265 bw ( KiB/s): min=94720, max=285184, per=8.55%, avg=162265.55, stdev=51801.62, samples=20 00:23:03.265 iops : min= 370, max= 1114, avg=633.80, stdev=202.38, samples=20 00:23:03.265 lat (msec) : 4=0.37%, 10=1.77%, 20=4.50%, 50=20.32%, 100=27.26% 00:23:03.265 lat (msec) : 250=45.20%, 500=0.58% 00:23:03.265 cpu : usr=0.26%, sys=1.56%, ctx=1392, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=6402,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job1: (groupid=0, jobs=1): err= 0: pid=2350525: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=498, BW=125MiB/s (131MB/s)(1253MiB/10064msec) 00:23:03.265 slat (usec): min=12, max=120910, avg=1910.62, stdev=5967.81 00:23:03.265 clat (msec): min=12, max=307, avg=126.47, stdev=51.71 00:23:03.265 lat (msec): min=12, max=322, avg=128.38, stdev=52.62 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 34], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 75], 00:23:03.265 | 30.00th=[ 87], 40.00th=[ 109], 50.00th=[ 129], 60.00th=[ 142], 00:23:03.265 | 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 194], 95.00th=[ 211], 00:23:03.265 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 300], 99.95th=[ 309], 00:23:03.265 | 99.99th=[ 309] 00:23:03.265 bw ( KiB/s): min=74752, max=238592, per=6.68%, avg=126712.25, stdev=51307.34, samples=20 00:23:03.265 iops : min= 292, max= 932, avg=494.95, stdev=200.44, samples=20 00:23:03.265 lat (msec) : 20=0.46%, 50=1.48%, 100=33.57%, 250=62.38%, 500=2.11% 00:23:03.265 cpu : usr=0.33%, sys=1.70%, ctx=965, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=5013,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job2: (groupid=0, jobs=1): err= 0: pid=2350526: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=596, BW=149MiB/s (156MB/s)(1509MiB/10112msec) 00:23:03.265 slat (usec): min=8, max=123569, avg=1316.48, stdev=5330.07 00:23:03.265 clat (usec): min=730, max=307616, avg=105855.21, stdev=65930.38 00:23:03.265 lat (usec): min=786, max=307635, avg=107171.69, stdev=66726.06 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 22], 20.00th=[ 35], 00:23:03.265 | 30.00th=[ 60], 40.00th=[ 79], 50.00th=[ 102], 60.00th=[ 129], 00:23:03.265 | 70.00th=[ 150], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 209], 00:23:03.265 | 99.00th=[ 264], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], 00:23:03.265 | 99.99th=[ 309] 00:23:03.265 bw ( KiB/s): min=72047, max=346112, per=8.06%, avg=152850.35, stdev=70686.68, samples=20 00:23:03.265 iops : min= 281, max= 1352, avg=597.05, stdev=276.15, samples=20 00:23:03.265 lat (usec) : 750=0.05%, 1000=0.07% 00:23:03.265 lat (msec) : 2=0.53%, 4=1.34%, 10=3.38%, 20=3.48%, 50=15.01% 00:23:03.265 lat (msec) : 100=25.90%, 250=48.51%, 500=1.72% 00:23:03.265 cpu : usr=0.28%, sys=1.86%, ctx=1273, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=6034,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job3: (groupid=0, jobs=1): err= 0: pid=2350527: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=667, BW=167MiB/s (175MB/s)(1687MiB/10112msec) 00:23:03.265 slat (usec): min=8, max=129352, avg=1395.99, stdev=4546.30 00:23:03.265 clat (msec): min=6, max=251, avg=94.47, stdev=35.16 00:23:03.265 lat (msec): min=6, max=298, avg=95.86, stdev=35.69 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 25], 5.00th=[ 42], 10.00th=[ 54], 20.00th=[ 67], 00:23:03.265 | 30.00th=[ 77], 40.00th=[ 85], 50.00th=[ 92], 60.00th=[ 99], 00:23:03.265 | 70.00th=[ 108], 80.00th=[ 120], 90.00th=[ 140], 95.00th=[ 159], 00:23:03.265 | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 226], 99.95th=[ 226], 00:23:03.265 | 99.99th=[ 253] 00:23:03.265 bw ( KiB/s): min=88576, max=308224, per=9.01%, avg=171039.65, stdev=52119.96, samples=20 00:23:03.265 iops : min= 346, max= 1204, avg=668.10, stdev=203.58, samples=20 00:23:03.265 lat (msec) : 10=0.19%, 20=0.49%, 50=7.50%, 100=53.72%, 250=38.07% 00:23:03.265 lat (msec) : 500=0.03% 00:23:03.265 cpu : usr=0.43%, sys=2.04%, ctx=1156, majf=0, minf=3721 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=6746,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job4: (groupid=0, jobs=1): err= 0: pid=2350528: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=472, BW=118MiB/s (124MB/s)(1193MiB/10107msec) 00:23:03.265 slat (usec): min=8, max=156290, avg=1672.89, stdev=6233.40 00:23:03.265 clat (usec): min=1037, max=305125, avg=133768.85, stdev=51778.96 00:23:03.265 lat (usec): min=1058, max=311666, avg=135441.74, stdev=52790.20 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 3], 5.00th=[ 46], 10.00th=[ 72], 20.00th=[ 95], 00:23:03.265 | 30.00th=[ 110], 40.00th=[ 121], 50.00th=[ 132], 60.00th=[ 146], 00:23:03.265 | 70.00th=[ 159], 80.00th=[ 176], 90.00th=[ 199], 95.00th=[ 218], 00:23:03.265 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 300], 00:23:03.265 | 99.99th=[ 305] 00:23:03.265 bw ( KiB/s): min=73728, max=206336, per=6.35%, avg=120550.40, stdev=36373.24, samples=20 00:23:03.265 iops : min= 288, max= 806, avg=470.90, stdev=142.08, samples=20 00:23:03.265 lat (msec) : 2=0.31%, 4=1.26%, 10=0.48%, 20=0.71%, 50=2.70% 00:23:03.265 lat (msec) : 100=16.53%, 250=75.98%, 500=2.01% 00:23:03.265 cpu : usr=0.29%, sys=1.51%, ctx=984, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=4772,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job5: (groupid=0, jobs=1): err= 0: pid=2350529: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=820, BW=205MiB/s (215MB/s)(2061MiB/10046msec) 00:23:03.265 slat (usec): min=8, max=84879, avg=796.36, stdev=3540.36 00:23:03.265 clat (usec): min=984, max=309760, avg=77135.35, stdev=52304.43 00:23:03.265 lat (usec): min=1009, max=309771, avg=77931.71, stdev=52729.23 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 24], 20.00th=[ 37], 00:23:03.265 | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 62], 60.00th=[ 72], 00:23:03.265 | 70.00th=[ 85], 80.00th=[ 127], 90.00th=[ 157], 95.00th=[ 180], 00:23:03.265 | 99.00th=[ 239], 99.50th=[ 266], 99.90th=[ 284], 99.95th=[ 284], 00:23:03.265 | 99.99th=[ 309] 00:23:03.265 bw ( KiB/s): min=98304, max=356352, per=11.04%, avg=209423.30, stdev=77078.54, samples=20 00:23:03.265 iops : min= 384, max= 1392, avg=818.05, stdev=301.10, samples=20 00:23:03.265 lat (usec) : 1000=0.01% 00:23:03.265 lat (msec) : 2=0.38%, 4=1.61%, 10=3.02%, 20=4.25%, 50=22.08% 00:23:03.265 lat (msec) : 100=43.73%, 250=24.13%, 500=0.80% 00:23:03.265 cpu : usr=0.51%, sys=2.50%, ctx=1750, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=8244,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job6: (groupid=0, jobs=1): err= 0: pid=2350530: Fri Nov 29 13:56:41 2024 00:23:03.265 read: IOPS=754, BW=189MiB/s (198MB/s)(1908MiB/10110msec) 00:23:03.265 slat (usec): min=8, max=155924, avg=807.38, stdev=5264.58 00:23:03.265 clat (usec): min=777, max=279039, avg=83932.66, stdev=59963.07 00:23:03.265 lat (usec): min=802, max=310107, avg=84740.04, stdev=60823.80 00:23:03.265 clat percentiles (msec): 00:23:03.265 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 14], 20.00th=[ 27], 00:23:03.265 | 30.00th=[ 35], 40.00th=[ 54], 50.00th=[ 74], 60.00th=[ 97], 00:23:03.265 | 70.00th=[ 117], 80.00th=[ 144], 90.00th=[ 169], 95.00th=[ 190], 00:23:03.265 | 99.00th=[ 232], 99.50th=[ 239], 99.90th=[ 271], 99.95th=[ 271], 00:23:03.265 | 99.99th=[ 279] 00:23:03.265 bw ( KiB/s): min=83456, max=530432, per=10.21%, avg=193689.30, stdev=105756.74, samples=20 00:23:03.265 iops : min= 326, max= 2072, avg=756.55, stdev=413.08, samples=20 00:23:03.265 lat (usec) : 1000=0.01% 00:23:03.265 lat (msec) : 2=0.43%, 4=2.37%, 10=4.33%, 20=7.26%, 50=24.01% 00:23:03.265 lat (msec) : 100=22.40%, 250=39.03%, 500=0.16% 00:23:03.265 cpu : usr=0.26%, sys=1.91%, ctx=1675, majf=0, minf=4097 00:23:03.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:03.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.265 issued rwts: total=7630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.265 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.265 job7: (groupid=0, jobs=1): err= 0: pid=2350531: Fri Nov 29 13:56:41 2024 00:23:03.266 read: IOPS=756, BW=189MiB/s (198MB/s)(1912MiB/10107msec) 00:23:03.266 slat (usec): min=9, max=137986, avg=702.45, stdev=3975.37 00:23:03.266 clat (usec): min=790, max=295219, avg=83833.92, stdev=48612.70 00:23:03.266 lat (usec): min=813, max=305224, avg=84536.37, stdev=49028.25 00:23:03.266 clat percentiles (msec): 00:23:03.266 | 1.00th=[ 3], 5.00th=[ 12], 10.00th=[ 24], 20.00th=[ 42], 00:23:03.266 | 30.00th=[ 58], 40.00th=[ 71], 50.00th=[ 83], 60.00th=[ 91], 00:23:03.266 | 70.00th=[ 100], 80.00th=[ 113], 90.00th=[ 148], 95.00th=[ 174], 00:23:03.266 | 99.00th=[ 232], 99.50th=[ 236], 99.90th=[ 268], 99.95th=[ 271], 00:23:03.266 | 99.99th=[ 296] 00:23:03.266 bw ( KiB/s): min=100352, max=268288, per=10.23%, avg=194107.30, stdev=49063.75, samples=20 00:23:03.266 iops : min= 392, max= 1048, avg=758.20, stdev=191.67, samples=20 00:23:03.266 lat (usec) : 1000=0.01% 00:23:03.266 lat (msec) : 2=0.54%, 4=1.46%, 10=2.46%, 20=3.96%, 50=16.47% 00:23:03.266 lat (msec) : 100=45.44%, 250=29.28%, 500=0.38% 00:23:03.266 cpu : usr=0.37%, sys=2.10%, ctx=1641, majf=0, minf=4097 00:23:03.266 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:03.266 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.266 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.266 issued rwts: total=7646,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.266 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.266 job8: (groupid=0, jobs=1): err= 0: pid=2350536: Fri Nov 29 13:56:41 2024 00:23:03.266 read: IOPS=678, BW=170MiB/s (178MB/s)(1707MiB/10068msec) 00:23:03.266 slat (usec): min=8, max=149199, avg=1126.07, stdev=5269.47 00:23:03.266 clat (msec): min=2, max=360, avg=93.17, stdev=62.05 00:23:03.266 lat (msec): min=2, max=360, avg=94.29, stdev=62.87 00:23:03.266 clat percentiles (msec): 00:23:03.266 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 20], 20.00th=[ 32], 00:23:03.266 | 30.00th=[ 57], 40.00th=[ 69], 50.00th=[ 85], 60.00th=[ 99], 00:23:03.266 | 70.00th=[ 118], 80.00th=[ 146], 90.00th=[ 186], 95.00th=[ 213], 00:23:03.266 | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 305], 99.95th=[ 309], 00:23:03.266 | 99.99th=[ 359] 00:23:03.266 bw ( KiB/s): min=72047, max=382464, per=9.13%, avg=173217.65, stdev=83392.36, samples=20 00:23:03.266 iops : min= 281, max= 1494, avg=676.60, stdev=325.78, samples=20 00:23:03.266 lat (msec) : 4=0.85%, 10=2.86%, 20=6.41%, 50=18.17%, 100=32.48% 00:23:03.266 lat (msec) : 250=38.03%, 500=1.20% 00:23:03.266 cpu : usr=0.27%, sys=2.08%, ctx=1509, majf=0, minf=4097 00:23:03.266 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:03.266 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.266 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.266 issued rwts: total=6829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.266 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.266 job9: (groupid=0, jobs=1): err= 0: pid=2350538: Fri Nov 29 13:56:41 2024 00:23:03.266 read: IOPS=635, BW=159MiB/s (167MB/s)(1606MiB/10113msec) 00:23:03.266 slat (usec): min=8, max=120933, avg=1087.29, stdev=4268.87 00:23:03.266 clat (usec): min=1125, max=292013, avg=99592.56, stdev=41706.01 00:23:03.266 lat (usec): min=1178, max=292030, avg=100679.85, stdev=42156.62 00:23:03.266 clat percentiles (msec): 00:23:03.266 | 1.00th=[ 8], 5.00th=[ 34], 10.00th=[ 50], 20.00th=[ 68], 00:23:03.266 | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 97], 60.00th=[ 107], 00:23:03.266 | 70.00th=[ 116], 80.00th=[ 130], 90.00th=[ 153], 95.00th=[ 178], 00:23:03.266 | 99.00th=[ 222], 99.50th=[ 226], 99.90th=[ 247], 99.95th=[ 249], 00:23:03.266 | 99.99th=[ 292] 00:23:03.266 bw ( KiB/s): min=97474, max=277972, per=8.58%, avg=162797.90, stdev=46172.35, samples=20 00:23:03.266 iops : min= 380, max= 1085, avg=635.85, stdev=180.31, samples=20 00:23:03.266 lat (msec) : 2=0.02%, 4=0.56%, 10=1.31%, 20=0.59%, 50=7.67% 00:23:03.266 lat (msec) : 100=43.60%, 250=46.20%, 500=0.05% 00:23:03.266 cpu : usr=0.42%, sys=1.78%, ctx=1293, majf=0, minf=4097 00:23:03.266 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:03.266 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.266 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.266 issued rwts: total=6424,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.266 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.266 job10: (groupid=0, jobs=1): err= 0: pid=2350540: Fri Nov 29 13:56:41 2024 00:23:03.266 read: IOPS=917, BW=229MiB/s (240MB/s)(2303MiB/10044msec) 00:23:03.266 slat (usec): min=8, max=136128, avg=971.81, stdev=3775.94 00:23:03.266 clat (usec): min=655, max=273728, avg=68761.98, stdev=43238.17 00:23:03.266 lat (usec): min=675, max=273851, avg=69733.80, stdev=43764.22 00:23:03.266 clat percentiles (msec): 00:23:03.266 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 30], 00:23:03.266 | 30.00th=[ 38], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 72], 00:23:03.266 | 70.00th=[ 84], 80.00th=[ 100], 90.00th=[ 138], 95.00th=[ 157], 00:23:03.266 | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 211], 99.95th=[ 211], 00:23:03.266 | 99.99th=[ 275] 00:23:03.266 bw ( KiB/s): min=80545, max=488960, per=12.34%, avg=234179.25, stdev=96248.75, samples=20 00:23:03.266 iops : min= 314, max= 1910, avg=914.70, stdev=375.96, samples=20 00:23:03.266 lat (usec) : 750=0.02%, 1000=0.03% 00:23:03.266 lat (msec) : 2=0.36%, 4=0.99%, 10=2.15%, 20=3.00%, 50=32.34% 00:23:03.266 lat (msec) : 100=41.44%, 250=19.66%, 500=0.02% 00:23:03.266 cpu : usr=0.47%, sys=2.84%, ctx=1711, majf=0, minf=4097 00:23:03.266 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:23:03.266 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.266 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:03.266 issued rwts: total=9212,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.266 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:03.266 00:23:03.266 Run status group 0 (all jobs): 00:23:03.266 READ: bw=1853MiB/s (1943MB/s), 118MiB/s-229MiB/s (124MB/s-240MB/s), io=18.3GiB (19.6GB), run=10024-10113msec 00:23:03.266 00:23:03.266 Disk stats (read/write): 00:23:03.266 nvme0n1: ios=12414/0, merge=0/0, ticks=1245106/0, in_queue=1245106, util=97.00% 00:23:03.266 nvme10n1: ios=9751/0, merge=0/0, ticks=1228314/0, in_queue=1228314, util=97.22% 00:23:03.266 nvme1n1: ios=11856/0, merge=0/0, ticks=1229915/0, in_queue=1229915, util=97.55% 00:23:03.266 nvme2n1: ios=13287/0, merge=0/0, ticks=1231012/0, in_queue=1231012, util=97.71% 00:23:03.266 nvme3n1: ios=9352/0, merge=0/0, ticks=1229716/0, in_queue=1229716, util=97.79% 00:23:03.266 nvme4n1: ios=16205/0, merge=0/0, ticks=1239826/0, in_queue=1239826, util=98.21% 00:23:03.266 nvme5n1: ios=15074/0, merge=0/0, ticks=1235133/0, in_queue=1235133, util=98.39% 00:23:03.266 nvme6n1: ios=15070/0, merge=0/0, ticks=1239849/0, in_queue=1239849, util=98.53% 00:23:03.266 nvme7n1: ios=13363/0, merge=0/0, ticks=1234634/0, in_queue=1234634, util=98.93% 00:23:03.266 nvme8n1: ios=12648/0, merge=0/0, ticks=1233869/0, in_queue=1233869, util=99.11% 00:23:03.266 nvme9n1: ios=18144/0, merge=0/0, ticks=1236586/0, in_queue=1236586, util=99.24% 00:23:03.266 13:56:41 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:03.266 [global] 00:23:03.266 thread=1 00:23:03.266 invalidate=1 00:23:03.266 rw=randwrite 00:23:03.266 time_based=1 00:23:03.266 runtime=10 00:23:03.266 ioengine=libaio 00:23:03.266 direct=1 00:23:03.266 bs=262144 00:23:03.266 iodepth=64 00:23:03.266 norandommap=1 00:23:03.266 numjobs=1 00:23:03.266 00:23:03.266 [job0] 00:23:03.266 filename=/dev/nvme0n1 00:23:03.266 [job1] 00:23:03.266 filename=/dev/nvme10n1 00:23:03.266 [job2] 00:23:03.266 filename=/dev/nvme1n1 00:23:03.266 [job3] 00:23:03.266 filename=/dev/nvme2n1 00:23:03.266 [job4] 00:23:03.266 filename=/dev/nvme3n1 00:23:03.266 [job5] 00:23:03.266 filename=/dev/nvme4n1 00:23:03.266 [job6] 00:23:03.266 filename=/dev/nvme5n1 00:23:03.266 [job7] 00:23:03.266 filename=/dev/nvme6n1 00:23:03.266 [job8] 00:23:03.266 filename=/dev/nvme7n1 00:23:03.266 [job9] 00:23:03.266 filename=/dev/nvme8n1 00:23:03.266 [job10] 00:23:03.266 filename=/dev/nvme9n1 00:23:03.266 Could not set queue depth (nvme0n1) 00:23:03.266 Could not set queue depth (nvme10n1) 00:23:03.266 Could not set queue depth (nvme1n1) 00:23:03.266 Could not set queue depth (nvme2n1) 00:23:03.266 Could not set queue depth (nvme3n1) 00:23:03.266 Could not set queue depth (nvme4n1) 00:23:03.266 Could not set queue depth (nvme5n1) 00:23:03.266 Could not set queue depth (nvme6n1) 00:23:03.266 Could not set queue depth (nvme7n1) 00:23:03.266 Could not set queue depth (nvme8n1) 00:23:03.266 Could not set queue depth (nvme9n1) 00:23:03.266 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:03.266 fio-3.35 00:23:03.266 Starting 11 threads 00:23:13.244 00:23:13.244 job0: (groupid=0, jobs=1): err= 0: pid=2351589: Fri Nov 29 13:56:52 2024 00:23:13.244 write: IOPS=572, BW=143MiB/s (150MB/s)(1443MiB/10077msec); 0 zone resets 00:23:13.244 slat (usec): min=21, max=114758, avg=1351.92, stdev=4073.28 00:23:13.244 clat (usec): min=1239, max=339334, avg=110332.61, stdev=71847.64 00:23:13.244 lat (usec): min=1998, max=339601, avg=111684.53, stdev=72554.36 00:23:13.244 clat percentiles (msec): 00:23:13.244 | 1.00th=[ 9], 5.00th=[ 21], 10.00th=[ 42], 20.00th=[ 53], 00:23:13.244 | 30.00th=[ 66], 40.00th=[ 80], 50.00th=[ 86], 60.00th=[ 96], 00:23:13.244 | 70.00th=[ 133], 80.00th=[ 178], 90.00th=[ 230], 95.00th=[ 253], 00:23:13.244 | 99.00th=[ 300], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 338], 00:23:13.244 | 99.99th=[ 338] 00:23:13.245 bw ( KiB/s): min=67584, max=255488, per=9.82%, avg=146175.15, stdev=61429.87, samples=20 00:23:13.245 iops : min= 264, max= 998, avg=570.95, stdev=239.88, samples=20 00:23:13.245 lat (msec) : 2=0.03%, 4=0.12%, 10=1.33%, 20=3.50%, 50=13.39% 00:23:13.245 lat (msec) : 100=43.49%, 250=32.55%, 500=5.58% 00:23:13.245 cpu : usr=1.94%, sys=2.07%, ctx=2567, majf=0, minf=2 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,5772,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.245 job1: (groupid=0, jobs=1): err= 0: pid=2351600: Fri Nov 29 13:56:52 2024 00:23:13.245 write: IOPS=514, BW=129MiB/s (135MB/s)(1303MiB/10132msec); 0 zone resets 00:23:13.245 slat (usec): min=19, max=177241, avg=1210.11, stdev=4853.22 00:23:13.245 clat (msec): min=2, max=421, avg=123.19, stdev=78.24 00:23:13.245 lat (msec): min=2, max=421, avg=124.40, stdev=79.03 00:23:13.245 clat percentiles (msec): 00:23:13.245 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 32], 20.00th=[ 61], 00:23:13.245 | 30.00th=[ 79], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 122], 00:23:13.245 | 70.00th=[ 136], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 284], 00:23:13.245 | 99.00th=[ 372], 99.50th=[ 397], 99.90th=[ 414], 99.95th=[ 414], 00:23:13.245 | 99.99th=[ 422] 00:23:13.245 bw ( KiB/s): min=49152, max=211456, per=8.85%, avg=131772.20, stdev=47889.10, samples=20 00:23:13.245 iops : min= 192, max= 826, avg=514.70, stdev=187.10, samples=20 00:23:13.245 lat (msec) : 4=0.13%, 10=1.65%, 20=3.69%, 50=10.94%, 100=22.55% 00:23:13.245 lat (msec) : 250=53.82%, 500=7.22% 00:23:13.245 cpu : usr=1.56%, sys=1.70%, ctx=3090, majf=0, minf=1 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,5210,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.245 job2: (groupid=0, jobs=1): err= 0: pid=2351613: Fri Nov 29 13:56:52 2024 00:23:13.245 write: IOPS=502, BW=126MiB/s (132MB/s)(1271MiB/10127msec); 0 zone resets 00:23:13.245 slat (usec): min=16, max=136007, avg=1236.16, stdev=4178.16 00:23:13.245 clat (usec): min=824, max=422531, avg=126166.64, stdev=75639.41 00:23:13.245 lat (usec): min=874, max=422581, avg=127402.80, stdev=76578.25 00:23:13.245 clat percentiles (msec): 00:23:13.245 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 31], 20.00th=[ 58], 00:23:13.245 | 30.00th=[ 74], 40.00th=[ 94], 50.00th=[ 120], 60.00th=[ 136], 00:23:13.245 | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 228], 95.00th=[ 255], 00:23:13.245 | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 347], 00:23:13.245 | 99.99th=[ 422] 00:23:13.245 bw ( KiB/s): min=61952, max=225792, per=8.64%, avg=128544.60, stdev=45300.96, samples=20 00:23:13.245 iops : min= 242, max= 882, avg=502.10, stdev=176.92, samples=20 00:23:13.245 lat (usec) : 1000=0.14% 00:23:13.245 lat (msec) : 2=0.04%, 4=0.39%, 10=2.79%, 20=3.28%, 50=10.09% 00:23:13.245 lat (msec) : 100=25.33%, 250=52.21%, 500=5.72% 00:23:13.245 cpu : usr=1.45%, sys=1.88%, ctx=3214, majf=0, minf=1 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,5085,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.245 job3: (groupid=0, jobs=1): err= 0: pid=2351625: Fri Nov 29 13:56:52 2024 00:23:13.245 write: IOPS=503, BW=126MiB/s (132MB/s)(1275MiB/10131msec); 0 zone resets 00:23:13.245 slat (usec): min=23, max=80972, avg=1301.68, stdev=4034.22 00:23:13.245 clat (usec): min=1842, max=277698, avg=125792.59, stdev=72086.13 00:23:13.245 lat (usec): min=1899, max=280687, avg=127094.26, stdev=72967.89 00:23:13.245 clat percentiles (msec): 00:23:13.245 | 1.00th=[ 10], 5.00th=[ 21], 10.00th=[ 34], 20.00th=[ 54], 00:23:13.245 | 30.00th=[ 74], 40.00th=[ 87], 50.00th=[ 118], 60.00th=[ 159], 00:23:13.245 | 70.00th=[ 180], 80.00th=[ 197], 90.00th=[ 224], 95.00th=[ 243], 00:23:13.245 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 275], 00:23:13.245 | 99.99th=[ 279] 00:23:13.245 bw ( KiB/s): min=71680, max=228352, per=8.66%, avg=128921.60, stdev=44686.28, samples=20 00:23:13.245 iops : min= 280, max= 892, avg=503.60, stdev=174.56, samples=20 00:23:13.245 lat (msec) : 2=0.02%, 4=0.14%, 10=1.02%, 20=3.80%, 50=13.59% 00:23:13.245 lat (msec) : 100=26.93%, 250=50.83%, 500=3.67% 00:23:13.245 cpu : usr=1.58%, sys=2.03%, ctx=3039, majf=0, minf=1 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,5099,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.245 job4: (groupid=0, jobs=1): err= 0: pid=2351631: Fri Nov 29 13:56:52 2024 00:23:13.245 write: IOPS=705, BW=176MiB/s (185MB/s)(1790MiB/10139msec); 0 zone resets 00:23:13.245 slat (usec): min=18, max=107267, avg=984.70, stdev=2842.44 00:23:13.245 clat (usec): min=1380, max=356306, avg=89622.70, stdev=60053.41 00:23:13.245 lat (usec): min=1500, max=356351, avg=90607.40, stdev=60674.09 00:23:13.245 clat percentiles (msec): 00:23:13.245 | 1.00th=[ 5], 5.00th=[ 21], 10.00th=[ 36], 20.00th=[ 42], 00:23:13.245 | 30.00th=[ 47], 40.00th=[ 59], 50.00th=[ 73], 60.00th=[ 79], 00:23:13.245 | 70.00th=[ 107], 80.00th=[ 146], 90.00th=[ 184], 95.00th=[ 209], 00:23:13.245 | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 334], 99.95th=[ 347], 00:23:13.245 | 99.99th=[ 355] 00:23:13.245 bw ( KiB/s): min=92160, max=363008, per=12.21%, avg=181644.85, stdev=68906.17, samples=20 00:23:13.245 iops : min= 360, max= 1418, avg=709.55, stdev=269.16, samples=20 00:23:13.245 lat (msec) : 2=0.08%, 4=0.87%, 10=1.44%, 20=2.47%, 50=29.06% 00:23:13.245 lat (msec) : 100=34.44%, 250=30.64%, 500=1.01% 00:23:13.245 cpu : usr=2.27%, sys=2.68%, ctx=3513, majf=0, minf=1 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,7158,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.245 job5: (groupid=0, jobs=1): err= 0: pid=2351664: Fri Nov 29 13:56:52 2024 00:23:13.245 write: IOPS=460, BW=115MiB/s (121MB/s)(1167MiB/10140msec); 0 zone resets 00:23:13.245 slat (usec): min=18, max=106803, avg=1543.77, stdev=4640.08 00:23:13.245 clat (usec): min=1730, max=398795, avg=137219.18, stdev=76071.54 00:23:13.245 lat (usec): min=1788, max=398870, avg=138762.95, stdev=77030.91 00:23:13.245 clat percentiles (msec): 00:23:13.245 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 41], 20.00th=[ 78], 00:23:13.245 | 30.00th=[ 88], 40.00th=[ 115], 50.00th=[ 126], 60.00th=[ 148], 00:23:13.245 | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 239], 95.00th=[ 275], 00:23:13.245 | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 393], 99.95th=[ 401], 00:23:13.245 | 99.99th=[ 401] 00:23:13.245 bw ( KiB/s): min=49152, max=194560, per=7.92%, avg=117923.50, stdev=33805.78, samples=20 00:23:13.245 iops : min= 192, max= 760, avg=460.60, stdev=132.08, samples=20 00:23:13.245 lat (msec) : 2=0.04%, 4=0.15%, 10=1.73%, 20=3.02%, 50=7.77% 00:23:13.245 lat (msec) : 100=20.65%, 250=58.77%, 500=7.86% 00:23:13.245 cpu : usr=1.52%, sys=1.66%, ctx=2545, majf=0, minf=1 00:23:13.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:13.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.245 issued rwts: total=0,4669,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 job6: (groupid=0, jobs=1): err= 0: pid=2351689: Fri Nov 29 13:56:52 2024 00:23:13.246 write: IOPS=501, BW=125MiB/s (131MB/s)(1271MiB/10141msec); 0 zone resets 00:23:13.246 slat (usec): min=22, max=40048, avg=1856.71, stdev=3727.40 00:23:13.246 clat (msec): min=3, max=333, avg=125.79, stdev=53.35 00:23:13.246 lat (msec): min=3, max=333, avg=127.65, stdev=53.99 00:23:13.246 clat percentiles (msec): 00:23:13.246 | 1.00th=[ 29], 5.00th=[ 46], 10.00th=[ 56], 20.00th=[ 80], 00:23:13.246 | 30.00th=[ 95], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 136], 00:23:13.246 | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 222], 00:23:13.246 | 99.00th=[ 249], 99.50th=[ 259], 99.90th=[ 321], 99.95th=[ 321], 00:23:13.246 | 99.99th=[ 334] 00:23:13.246 bw ( KiB/s): min=71680, max=253952, per=8.63%, avg=128486.40, stdev=51732.53, samples=20 00:23:13.246 iops : min= 280, max= 992, avg=501.90, stdev=202.08, samples=20 00:23:13.246 lat (msec) : 4=0.02%, 10=0.14%, 20=0.41%, 50=7.14%, 100=23.89% 00:23:13.246 lat (msec) : 250=67.41%, 500=0.98% 00:23:13.246 cpu : usr=1.70%, sys=1.44%, ctx=1478, majf=0, minf=1 00:23:13.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:13.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.246 issued rwts: total=0,5082,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 job7: (groupid=0, jobs=1): err= 0: pid=2351701: Fri Nov 29 13:56:52 2024 00:23:13.246 write: IOPS=514, BW=129MiB/s (135MB/s)(1296MiB/10077msec); 0 zone resets 00:23:13.246 slat (usec): min=16, max=48736, avg=1438.49, stdev=3530.15 00:23:13.246 clat (msec): min=3, max=324, avg=122.89, stdev=61.31 00:23:13.246 lat (msec): min=5, max=324, avg=124.33, stdev=62.05 00:23:13.246 clat percentiles (msec): 00:23:13.246 | 1.00th=[ 15], 5.00th=[ 39], 10.00th=[ 45], 20.00th=[ 72], 00:23:13.246 | 30.00th=[ 88], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 128], 00:23:13.246 | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 213], 95.00th=[ 239], 00:23:13.246 | 99.00th=[ 300], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 321], 00:23:13.246 | 99.99th=[ 326] 00:23:13.246 bw ( KiB/s): min=55296, max=274944, per=8.81%, avg=131132.15, stdev=53096.88, samples=20 00:23:13.246 iops : min= 216, max= 1074, avg=512.20, stdev=207.44, samples=20 00:23:13.246 lat (msec) : 4=0.02%, 10=0.31%, 20=1.58%, 50=11.40%, 100=22.39% 00:23:13.246 lat (msec) : 250=60.73%, 500=3.57% 00:23:13.246 cpu : usr=1.78%, sys=1.73%, ctx=2314, majf=0, minf=1 00:23:13.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:13.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.246 issued rwts: total=0,5185,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 job8: (groupid=0, jobs=1): err= 0: pid=2351754: Fri Nov 29 13:56:52 2024 00:23:13.246 write: IOPS=437, BW=109MiB/s (115MB/s)(1110MiB/10135msec); 0 zone resets 00:23:13.246 slat (usec): min=20, max=47284, avg=1862.10, stdev=4231.03 00:23:13.246 clat (msec): min=4, max=287, avg=144.20, stdev=57.27 00:23:13.246 lat (msec): min=4, max=287, avg=146.06, stdev=57.97 00:23:13.246 clat percentiles (msec): 00:23:13.246 | 1.00th=[ 14], 5.00th=[ 40], 10.00th=[ 80], 20.00th=[ 101], 00:23:13.246 | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 157], 00:23:13.246 | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 220], 95.00th=[ 243], 00:23:13.246 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 284], 00:23:13.246 | 99.99th=[ 288] 00:23:13.246 bw ( KiB/s): min=60416, max=165888, per=7.53%, avg=112017.40, stdev=28719.35, samples=20 00:23:13.246 iops : min= 236, max= 648, avg=437.55, stdev=112.20, samples=20 00:23:13.246 lat (msec) : 10=0.52%, 20=1.28%, 50=4.55%, 100=12.64%, 250=76.89% 00:23:13.246 lat (msec) : 500=4.12% 00:23:13.246 cpu : usr=1.44%, sys=1.71%, ctx=1834, majf=0, minf=1 00:23:13.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:13.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.246 issued rwts: total=0,4439,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 job9: (groupid=0, jobs=1): err= 0: pid=2351762: Fri Nov 29 13:56:52 2024 00:23:13.246 write: IOPS=684, BW=171MiB/s (179MB/s)(1718MiB/10042msec); 0 zone resets 00:23:13.246 slat (usec): min=15, max=83530, avg=837.28, stdev=3116.96 00:23:13.246 clat (usec): min=836, max=367517, avg=92687.51, stdev=71679.41 00:23:13.246 lat (usec): min=896, max=367601, avg=93524.79, stdev=72331.72 00:23:13.246 clat percentiles (msec): 00:23:13.246 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 21], 20.00th=[ 37], 00:23:13.246 | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 72], 60.00th=[ 84], 00:23:13.246 | 70.00th=[ 120], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 236], 00:23:13.246 | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 326], 99.95th=[ 326], 00:23:13.246 | 99.99th=[ 368] 00:23:13.246 bw ( KiB/s): min=79360, max=359936, per=11.71%, avg=174259.20, stdev=74292.16, samples=20 00:23:13.246 iops : min= 310, max= 1406, avg=680.70, stdev=290.20, samples=20 00:23:13.246 lat (usec) : 1000=0.07% 00:23:13.246 lat (msec) : 2=0.42%, 4=1.19%, 10=3.10%, 20=5.24%, 50=30.61% 00:23:13.246 lat (msec) : 100=24.66%, 250=30.92%, 500=3.78% 00:23:13.246 cpu : usr=2.01%, sys=2.45%, ctx=4245, majf=0, minf=1 00:23:13.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:13.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.246 issued rwts: total=0,6870,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 job10: (groupid=0, jobs=1): err= 0: pid=2351763: Fri Nov 29 13:56:52 2024 00:23:13.246 write: IOPS=432, BW=108MiB/s (113MB/s)(1096MiB/10133msec); 0 zone resets 00:23:13.246 slat (usec): min=14, max=115138, avg=1651.96, stdev=4840.56 00:23:13.246 clat (msec): min=2, max=337, avg=146.27, stdev=79.91 00:23:13.246 lat (msec): min=3, max=338, avg=147.92, stdev=80.89 00:23:13.246 clat percentiles (msec): 00:23:13.246 | 1.00th=[ 9], 5.00th=[ 21], 10.00th=[ 34], 20.00th=[ 65], 00:23:13.246 | 30.00th=[ 92], 40.00th=[ 124], 50.00th=[ 159], 60.00th=[ 176], 00:23:13.246 | 70.00th=[ 188], 80.00th=[ 213], 90.00th=[ 253], 95.00th=[ 279], 00:23:13.246 | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 334], 99.95th=[ 334], 00:23:13.246 | 99.99th=[ 338] 00:23:13.246 bw ( KiB/s): min=59392, max=163840, per=7.43%, avg=110575.00, stdev=32653.45, samples=20 00:23:13.246 iops : min= 232, max= 640, avg=431.90, stdev=127.58, samples=20 00:23:13.246 lat (msec) : 4=0.05%, 10=1.32%, 20=3.35%, 50=11.32%, 100=16.34% 00:23:13.246 lat (msec) : 250=56.82%, 500=10.79% 00:23:13.246 cpu : usr=1.34%, sys=1.54%, ctx=2414, majf=0, minf=1 00:23:13.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:13.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:13.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:13.246 issued rwts: total=0,4382,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:13.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:13.246 00:23:13.246 Run status group 0 (all jobs): 00:23:13.246 WRITE: bw=1453MiB/s (1524MB/s), 108MiB/s-176MiB/s (113MB/s-185MB/s), io=14.4GiB (15.5GB), run=10042-10141msec 00:23:13.246 00:23:13.246 Disk stats (read/write): 00:23:13.247 nvme0n1: ios=49/11294, merge=0/0, ticks=40/1217452, in_queue=1217492, util=97.17% 00:23:13.247 nvme10n1: ios=47/10181, merge=0/0, ticks=246/1217675, in_queue=1217921, util=99.32% 00:23:13.247 nvme1n1: ios=49/9968, merge=0/0, ticks=234/1221275, in_queue=1221509, util=99.25% 00:23:13.247 nvme2n1: ios=38/9988, merge=0/0, ticks=2987/1211713, in_queue=1214700, util=99.91% 00:23:13.247 nvme3n1: ios=0/14137, merge=0/0, ticks=0/1213949, in_queue=1213949, util=97.67% 00:23:13.247 nvme4n1: ios=42/9158, merge=0/0, ticks=2635/1211313, in_queue=1213948, util=100.00% 00:23:13.247 nvme5n1: ios=0/9982, merge=0/0, ticks=0/1203192, in_queue=1203192, util=98.23% 00:23:13.247 nvme6n1: ios=0/10122, merge=0/0, ticks=0/1218944, in_queue=1218944, util=98.34% 00:23:13.247 nvme7n1: ios=0/8667, merge=0/0, ticks=0/1207964, in_queue=1207964, util=98.73% 00:23:13.247 nvme8n1: ios=0/13355, merge=0/0, ticks=0/1228503, in_queue=1228503, util=98.94% 00:23:13.247 nvme9n1: ios=0/8565, merge=0/0, ticks=0/1213604, in_queue=1213604, util=99.13% 00:23:13.247 13:56:52 -- target/multiconnection.sh@36 -- # sync 00:23:13.247 13:56:52 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:13.247 13:56:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.247 13:56:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:13.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:13.247 13:56:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:13.247 13:56:53 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.247 13:56:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.247 13:56:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:13.247 13:56:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.247 13:56:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:13.247 13:56:53 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.247 13:56:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:13.247 13:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.247 13:56:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.247 13:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.247 13:56:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.247 13:56:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:13.247 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:13.247 13:56:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:13.247 13:56:53 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.247 13:56:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.247 13:56:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:13.247 13:56:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.247 13:56:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:13.247 13:56:53 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.247 13:56:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:13.247 13:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.247 13:56:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.247 13:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.247 13:56:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.247 13:56:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:13.508 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:13.508 13:56:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:13.508 13:56:53 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.508 13:56:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.508 13:56:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:13.508 13:56:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.508 13:56:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:13.508 13:56:53 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.508 13:56:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:13.508 13:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.508 13:56:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.508 13:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.508 13:56:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.508 13:56:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:13.767 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:13.767 13:56:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:13.767 13:56:53 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.767 13:56:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.767 13:56:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:13.767 13:56:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.767 13:56:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:13.767 13:56:53 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.767 13:56:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:13.767 13:56:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.767 13:56:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.767 13:56:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.767 13:56:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.767 13:56:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:14.025 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:14.025 13:56:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:14.025 13:56:54 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.025 13:56:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.025 13:56:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:14.025 13:56:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.025 13:56:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:14.025 13:56:54 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.025 13:56:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:14.026 13:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.026 13:56:54 -- common/autotest_common.sh@10 -- # set +x 00:23:14.026 13:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.026 13:56:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.026 13:56:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:14.284 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:14.284 13:56:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:14.284 13:56:54 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.284 13:56:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.284 13:56:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:14.284 13:56:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.284 13:56:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:14.284 13:56:54 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.284 13:56:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:14.284 13:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.284 13:56:54 -- common/autotest_common.sh@10 -- # set +x 00:23:14.284 13:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.284 13:56:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.284 13:56:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:14.284 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:14.284 13:56:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:14.284 13:56:54 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.284 13:56:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.284 13:56:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:14.284 13:56:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.284 13:56:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:14.284 13:56:54 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.284 13:56:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:14.284 13:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.284 13:56:54 -- common/autotest_common.sh@10 -- # set +x 00:23:14.284 13:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.284 13:56:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.284 13:56:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:14.543 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:14.543 13:56:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:14.543 13:56:54 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.543 13:56:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.543 13:56:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:14.543 13:56:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.543 13:56:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:14.543 13:56:54 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.543 13:56:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:14.543 13:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.543 13:56:54 -- common/autotest_common.sh@10 -- # set +x 00:23:14.543 13:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.543 13:56:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.543 13:56:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:14.801 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:14.801 13:56:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:14.801 13:56:54 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.801 13:56:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.801 13:56:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:14.801 13:56:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.801 13:56:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:14.801 13:56:54 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.801 13:56:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:14.801 13:56:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.801 13:56:54 -- common/autotest_common.sh@10 -- # set +x 00:23:14.801 13:56:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.802 13:56:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.802 13:56:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:14.802 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:14.802 13:56:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:14.802 13:56:55 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.802 13:56:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.802 13:56:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:14.802 13:56:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.802 13:56:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:14.802 13:56:55 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.802 13:56:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:14.802 13:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.802 13:56:55 -- common/autotest_common.sh@10 -- # set +x 00:23:14.802 13:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.802 13:56:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.802 13:56:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:15.059 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:15.059 13:56:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:15.059 13:56:55 -- common/autotest_common.sh@1208 -- # local i=0 00:23:15.060 13:56:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:15.060 13:56:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:15.060 13:56:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:15.060 13:56:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:15.060 13:56:55 -- common/autotest_common.sh@1220 -- # return 0 00:23:15.060 13:56:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:15.060 13:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.060 13:56:55 -- common/autotest_common.sh@10 -- # set +x 00:23:15.060 13:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.060 13:56:55 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:15.060 13:56:55 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:15.060 13:56:55 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:15.060 13:56:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:15.060 13:56:55 -- nvmf/common.sh@116 -- # sync 00:23:15.060 13:56:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:15.060 13:56:55 -- nvmf/common.sh@119 -- # set +e 00:23:15.060 13:56:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:15.060 13:56:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:15.060 rmmod nvme_tcp 00:23:15.060 rmmod nvme_fabrics 00:23:15.060 rmmod nvme_keyring 00:23:15.060 13:56:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:15.060 13:56:55 -- nvmf/common.sh@123 -- # set -e 00:23:15.060 13:56:55 -- nvmf/common.sh@124 -- # return 0 00:23:15.060 13:56:55 -- nvmf/common.sh@477 -- # '[' -n 2346029 ']' 00:23:15.060 13:56:55 -- nvmf/common.sh@478 -- # killprocess 2346029 00:23:15.060 13:56:55 -- common/autotest_common.sh@936 -- # '[' -z 2346029 ']' 00:23:15.060 13:56:55 -- common/autotest_common.sh@940 -- # kill -0 2346029 00:23:15.060 13:56:55 -- common/autotest_common.sh@941 -- # uname 00:23:15.060 13:56:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:15.060 13:56:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2346029 00:23:15.060 13:56:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:15.060 13:56:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:15.060 13:56:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2346029' 00:23:15.060 killing process with pid 2346029 00:23:15.060 13:56:55 -- common/autotest_common.sh@955 -- # kill 2346029 00:23:15.060 13:56:55 -- common/autotest_common.sh@960 -- # wait 2346029 00:23:15.625 13:56:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:15.625 13:56:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:15.625 13:56:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:15.625 13:56:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:15.625 13:56:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:15.625 13:56:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.625 13:56:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.625 13:56:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:18.158 13:56:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:18.158 00:23:18.159 real 1m1.466s 00:23:18.159 user 3m26.103s 00:23:18.159 sys 0m25.162s 00:23:18.159 13:56:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:18.159 13:56:57 -- common/autotest_common.sh@10 -- # set +x 00:23:18.159 ************************************ 00:23:18.159 END TEST nvmf_multiconnection 00:23:18.159 ************************************ 00:23:18.159 13:56:57 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:18.159 13:56:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:18.159 13:56:57 -- common/autotest_common.sh@10 -- # set +x 00:23:18.159 ************************************ 00:23:18.159 START TEST nvmf_initiator_timeout 00:23:18.159 ************************************ 00:23:18.159 13:56:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:18.159 * Looking for test storage... 00:23:18.159 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:18.159 13:56:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:18.159 13:56:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:18.159 13:56:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:18.159 13:56:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:18.159 13:56:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:18.159 13:56:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:18.159 13:56:57 -- scripts/common.sh@335 -- # IFS=.-: 00:23:18.159 13:56:57 -- scripts/common.sh@335 -- # read -ra ver1 00:23:18.159 13:56:57 -- scripts/common.sh@336 -- # IFS=.-: 00:23:18.159 13:56:57 -- scripts/common.sh@336 -- # read -ra ver2 00:23:18.159 13:56:57 -- scripts/common.sh@337 -- # local 'op=<' 00:23:18.159 13:56:57 -- scripts/common.sh@339 -- # ver1_l=2 00:23:18.159 13:56:57 -- scripts/common.sh@340 -- # ver2_l=1 00:23:18.159 13:56:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:18.159 13:56:57 -- scripts/common.sh@343 -- # case "$op" in 00:23:18.159 13:56:57 -- scripts/common.sh@344 -- # : 1 00:23:18.159 13:56:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:18.159 13:56:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:18.159 13:56:57 -- scripts/common.sh@364 -- # decimal 1 00:23:18.159 13:56:57 -- scripts/common.sh@352 -- # local d=1 00:23:18.159 13:56:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:18.159 13:56:57 -- scripts/common.sh@354 -- # echo 1 00:23:18.159 13:56:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:18.159 13:56:57 -- scripts/common.sh@365 -- # decimal 2 00:23:18.159 13:56:57 -- scripts/common.sh@352 -- # local d=2 00:23:18.159 13:56:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:18.159 13:56:57 -- scripts/common.sh@354 -- # echo 2 00:23:18.159 13:56:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:18.159 13:56:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:18.159 13:56:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:18.159 13:56:57 -- scripts/common.sh@367 -- # return 0 00:23:18.159 13:56:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:18.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:18.159 --rc genhtml_branch_coverage=1 00:23:18.159 --rc genhtml_function_coverage=1 00:23:18.159 --rc genhtml_legend=1 00:23:18.159 --rc geninfo_all_blocks=1 00:23:18.159 --rc geninfo_unexecuted_blocks=1 00:23:18.159 00:23:18.159 ' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:18.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:18.159 --rc genhtml_branch_coverage=1 00:23:18.159 --rc genhtml_function_coverage=1 00:23:18.159 --rc genhtml_legend=1 00:23:18.159 --rc geninfo_all_blocks=1 00:23:18.159 --rc geninfo_unexecuted_blocks=1 00:23:18.159 00:23:18.159 ' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:18.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:18.159 --rc genhtml_branch_coverage=1 00:23:18.159 --rc genhtml_function_coverage=1 00:23:18.159 --rc genhtml_legend=1 00:23:18.159 --rc geninfo_all_blocks=1 00:23:18.159 --rc geninfo_unexecuted_blocks=1 00:23:18.159 00:23:18.159 ' 00:23:18.159 13:56:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:18.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:18.159 --rc genhtml_branch_coverage=1 00:23:18.159 --rc genhtml_function_coverage=1 00:23:18.159 --rc genhtml_legend=1 00:23:18.159 --rc geninfo_all_blocks=1 00:23:18.159 --rc geninfo_unexecuted_blocks=1 00:23:18.159 00:23:18.159 ' 00:23:18.159 13:56:57 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:18.159 13:56:57 -- nvmf/common.sh@7 -- # uname -s 00:23:18.159 13:56:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:18.159 13:56:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:18.159 13:56:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:18.159 13:56:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:18.159 13:56:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:18.159 13:56:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:18.159 13:56:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:18.159 13:56:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:18.159 13:56:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:18.159 13:56:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:18.159 13:56:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:18.159 13:56:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:18.159 13:56:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:18.159 13:56:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:18.159 13:56:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:18.159 13:56:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:18.159 13:56:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:18.159 13:56:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:18.159 13:56:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:18.159 13:56:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:18.159 13:56:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:18.159 13:56:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:18.159 13:56:57 -- paths/export.sh@5 -- # export PATH 00:23:18.159 13:56:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:18.159 13:56:57 -- nvmf/common.sh@46 -- # : 0 00:23:18.159 13:56:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:18.159 13:56:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:18.159 13:56:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:18.159 13:56:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:18.159 13:56:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:18.159 13:56:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:18.159 13:56:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:18.159 13:56:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:18.159 13:56:57 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:18.159 13:56:57 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:18.159 13:56:57 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:18.159 13:56:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:18.159 13:56:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:18.159 13:56:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:18.159 13:56:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:18.159 13:56:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:18.159 13:56:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:18.159 13:56:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:18.159 13:56:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:18.159 13:56:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:18.159 13:56:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:18.159 13:56:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:18.159 13:56:57 -- common/autotest_common.sh@10 -- # set +x 00:23:20.064 13:57:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:20.064 13:57:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:20.064 13:57:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:20.064 13:57:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:20.064 13:57:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:20.064 13:57:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:20.064 13:57:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:20.064 13:57:00 -- nvmf/common.sh@294 -- # net_devs=() 00:23:20.064 13:57:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:20.064 13:57:00 -- nvmf/common.sh@295 -- # e810=() 00:23:20.064 13:57:00 -- nvmf/common.sh@295 -- # local -ga e810 00:23:20.064 13:57:00 -- nvmf/common.sh@296 -- # x722=() 00:23:20.064 13:57:00 -- nvmf/common.sh@296 -- # local -ga x722 00:23:20.064 13:57:00 -- nvmf/common.sh@297 -- # mlx=() 00:23:20.064 13:57:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:20.064 13:57:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:20.064 13:57:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:20.064 13:57:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:20.064 13:57:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:20.064 13:57:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:20.064 13:57:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:20.064 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:20.064 13:57:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:20.064 13:57:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:20.064 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:20.064 13:57:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:20.064 13:57:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:20.065 13:57:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:20.065 13:57:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:20.065 13:57:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:20.065 13:57:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:20.065 13:57:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:20.065 13:57:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:20.065 13:57:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:20.065 13:57:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:20.065 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:20.065 13:57:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:20.065 13:57:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:20.065 13:57:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:20.065 13:57:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:20.065 13:57:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:20.065 13:57:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:20.065 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:20.065 13:57:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:20.065 13:57:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:20.065 13:57:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:20.065 13:57:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:20.065 13:57:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:20.065 13:57:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:20.065 13:57:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:20.065 13:57:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:20.065 13:57:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:20.065 13:57:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:20.065 13:57:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:20.065 13:57:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:20.065 13:57:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:20.065 13:57:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:20.065 13:57:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:20.065 13:57:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:20.065 13:57:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:20.065 13:57:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:20.065 13:57:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:20.065 13:57:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:20.065 13:57:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:20.065 13:57:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:20.065 13:57:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:20.065 13:57:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:20.065 13:57:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:20.065 13:57:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:20.065 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:20.065 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:23:20.065 00:23:20.065 --- 10.0.0.2 ping statistics --- 00:23:20.065 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:20.065 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:23:20.065 13:57:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:20.065 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:20.065 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:23:20.065 00:23:20.065 --- 10.0.0.1 ping statistics --- 00:23:20.065 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:20.065 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:23:20.065 13:57:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:20.065 13:57:00 -- nvmf/common.sh@410 -- # return 0 00:23:20.065 13:57:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:20.065 13:57:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:20.066 13:57:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:20.066 13:57:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:20.066 13:57:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:20.066 13:57:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:20.066 13:57:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:20.066 13:57:00 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:20.066 13:57:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:20.066 13:57:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:20.066 13:57:00 -- common/autotest_common.sh@10 -- # set +x 00:23:20.066 13:57:00 -- nvmf/common.sh@469 -- # nvmfpid=2355154 00:23:20.066 13:57:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:20.066 13:57:00 -- nvmf/common.sh@470 -- # waitforlisten 2355154 00:23:20.066 13:57:00 -- common/autotest_common.sh@829 -- # '[' -z 2355154 ']' 00:23:20.066 13:57:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:20.066 13:57:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:20.066 13:57:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:20.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:20.066 13:57:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:20.066 13:57:00 -- common/autotest_common.sh@10 -- # set +x 00:23:20.066 [2024-11-29 13:57:00.331169] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:20.066 [2024-11-29 13:57:00.331262] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:20.326 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.326 [2024-11-29 13:57:00.402990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:20.326 [2024-11-29 13:57:00.495972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:20.326 [2024-11-29 13:57:00.496113] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:20.326 [2024-11-29 13:57:00.496139] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:20.326 [2024-11-29 13:57:00.496153] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:20.326 [2024-11-29 13:57:00.496217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:20.326 [2024-11-29 13:57:00.496282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:20.326 [2024-11-29 13:57:00.496306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:20.326 [2024-11-29 13:57:00.496309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:21.260 13:57:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:21.260 13:57:01 -- common/autotest_common.sh@862 -- # return 0 00:23:21.260 13:57:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:21.260 13:57:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 13:57:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 Malloc0 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 Delay0 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 [2024-11-29 13:57:01.360463] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:21.260 13:57:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.260 13:57:01 -- common/autotest_common.sh@10 -- # set +x 00:23:21.260 [2024-11-29 13:57:01.388746] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:21.260 13:57:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.260 13:57:01 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:21.826 13:57:01 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:21.826 13:57:01 -- common/autotest_common.sh@1187 -- # local i=0 00:23:21.826 13:57:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:21.826 13:57:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:21.826 13:57:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:23.728 13:57:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:23.728 13:57:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:23.728 13:57:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:23.986 13:57:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:23.986 13:57:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:23.986 13:57:04 -- common/autotest_common.sh@1197 -- # return 0 00:23:23.986 13:57:04 -- target/initiator_timeout.sh@35 -- # fio_pid=2355688 00:23:23.986 13:57:04 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:23.986 13:57:04 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:23.986 [global] 00:23:23.986 thread=1 00:23:23.986 invalidate=1 00:23:23.986 rw=write 00:23:23.986 time_based=1 00:23:23.986 runtime=60 00:23:23.986 ioengine=libaio 00:23:23.986 direct=1 00:23:23.986 bs=4096 00:23:23.986 iodepth=1 00:23:23.986 norandommap=0 00:23:23.986 numjobs=1 00:23:23.986 00:23:23.986 verify_dump=1 00:23:23.986 verify_backlog=512 00:23:23.986 verify_state_save=0 00:23:23.986 do_verify=1 00:23:23.986 verify=crc32c-intel 00:23:23.986 [job0] 00:23:23.986 filename=/dev/nvme0n1 00:23:23.986 Could not set queue depth (nvme0n1) 00:23:23.986 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:23.986 fio-3.35 00:23:23.986 Starting 1 thread 00:23:27.312 13:57:07 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:27.312 13:57:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.312 13:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:27.312 true 00:23:27.312 13:57:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.312 13:57:07 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:27.312 13:57:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.312 13:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:27.312 true 00:23:27.312 13:57:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.312 13:57:07 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:27.312 13:57:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.312 13:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:27.312 true 00:23:27.312 13:57:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.312 13:57:07 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:27.312 13:57:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.312 13:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:27.312 true 00:23:27.312 13:57:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.312 13:57:07 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:29.848 13:57:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.848 13:57:10 -- common/autotest_common.sh@10 -- # set +x 00:23:29.848 true 00:23:29.848 13:57:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:29.848 13:57:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.848 13:57:10 -- common/autotest_common.sh@10 -- # set +x 00:23:29.848 true 00:23:29.848 13:57:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:29.848 13:57:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.848 13:57:10 -- common/autotest_common.sh@10 -- # set +x 00:23:29.848 true 00:23:29.848 13:57:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:29.848 13:57:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.848 13:57:10 -- common/autotest_common.sh@10 -- # set +x 00:23:29.848 true 00:23:29.848 13:57:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:29.848 13:57:10 -- target/initiator_timeout.sh@54 -- # wait 2355688 00:24:26.085 00:24:26.085 job0: (groupid=0, jobs=1): err= 0: pid=2355762: Fri Nov 29 13:58:04 2024 00:24:26.085 read: IOPS=21, BW=85.6KiB/s (87.6kB/s)(5136KiB/60015msec) 00:24:26.085 slat (usec): min=4, max=5029, avg=21.31, stdev=140.25 00:24:26.085 clat (usec): min=218, max=41130k, avg=46416.91, stdev=1147583.53 00:24:26.085 lat (usec): min=224, max=41130k, avg=46438.22, stdev=1147584.03 00:24:26.085 clat percentiles (usec): 00:24:26.085 | 1.00th=[ 231], 5.00th=[ 239], 10.00th=[ 243], 00:24:26.085 | 20.00th=[ 249], 30.00th=[ 255], 40.00th=[ 265], 00:24:26.085 | 50.00th=[ 285], 60.00th=[ 343], 70.00th=[ 41157], 00:24:26.085 | 80.00th=[ 41157], 90.00th=[ 41157], 95.00th=[ 42206], 00:24:26.085 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 44827], 00:24:26.085 | 99.95th=[17112761], 99.99th=[17112761] 00:24:26.085 write: IOPS=25, BW=102KiB/s (105kB/s)(6144KiB/60015msec); 0 zone resets 00:24:26.085 slat (nsec): min=5546, max=74606, avg=17826.89, stdev=10863.21 00:24:26.085 clat (usec): min=171, max=420, avg=225.59, stdev=30.16 00:24:26.085 lat (usec): min=177, max=449, avg=243.42, stdev=36.49 00:24:26.085 clat percentiles (usec): 00:24:26.085 | 1.00th=[ 180], 5.00th=[ 186], 10.00th=[ 192], 20.00th=[ 200], 00:24:26.085 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 223], 60.00th=[ 229], 00:24:26.085 | 70.00th=[ 237], 80.00th=[ 245], 90.00th=[ 269], 95.00th=[ 289], 00:24:26.085 | 99.00th=[ 314], 99.50th=[ 330], 99.90th=[ 400], 99.95th=[ 420], 00:24:26.085 | 99.99th=[ 420] 00:24:26.085 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=3 00:24:26.085 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=3 00:24:26.085 lat (usec) : 250=57.30%, 500=26.91% 00:24:26.085 lat (msec) : 10=0.04%, 50=15.71%, >=2000=0.04% 00:24:26.085 cpu : usr=0.06%, sys=0.08%, ctx=2821, majf=0, minf=1 00:24:26.085 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:26.085 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:26.085 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:26.085 issued rwts: total=1284,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:26.085 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:26.085 00:24:26.085 Run status group 0 (all jobs): 00:24:26.085 READ: bw=85.6KiB/s (87.6kB/s), 85.6KiB/s-85.6KiB/s (87.6kB/s-87.6kB/s), io=5136KiB (5259kB), run=60015-60015msec 00:24:26.085 WRITE: bw=102KiB/s (105kB/s), 102KiB/s-102KiB/s (105kB/s-105kB/s), io=6144KiB (6291kB), run=60015-60015msec 00:24:26.085 00:24:26.085 Disk stats (read/write): 00:24:26.085 nvme0n1: ios=1380/1536, merge=0/0, ticks=19544/339, in_queue=19883, util=99.54% 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:26.085 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:26.085 13:58:04 -- common/autotest_common.sh@1208 -- # local i=0 00:24:26.085 13:58:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:26.085 13:58:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:26.085 13:58:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:26.085 13:58:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:26.085 13:58:04 -- common/autotest_common.sh@1220 -- # return 0 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:26.085 nvmf hotplug test: fio successful as expected 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:26.085 13:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:26.085 13:58:04 -- common/autotest_common.sh@10 -- # set +x 00:24:26.085 13:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:26.085 13:58:04 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:26.085 13:58:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:26.085 13:58:04 -- nvmf/common.sh@116 -- # sync 00:24:26.085 13:58:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:26.085 13:58:04 -- nvmf/common.sh@119 -- # set +e 00:24:26.085 13:58:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:26.085 13:58:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:26.085 rmmod nvme_tcp 00:24:26.085 rmmod nvme_fabrics 00:24:26.085 rmmod nvme_keyring 00:24:26.085 13:58:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:26.085 13:58:04 -- nvmf/common.sh@123 -- # set -e 00:24:26.085 13:58:04 -- nvmf/common.sh@124 -- # return 0 00:24:26.085 13:58:04 -- nvmf/common.sh@477 -- # '[' -n 2355154 ']' 00:24:26.085 13:58:04 -- nvmf/common.sh@478 -- # killprocess 2355154 00:24:26.085 13:58:04 -- common/autotest_common.sh@936 -- # '[' -z 2355154 ']' 00:24:26.085 13:58:04 -- common/autotest_common.sh@940 -- # kill -0 2355154 00:24:26.085 13:58:04 -- common/autotest_common.sh@941 -- # uname 00:24:26.085 13:58:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:26.085 13:58:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2355154 00:24:26.085 13:58:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:26.085 13:58:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:26.085 13:58:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2355154' 00:24:26.085 killing process with pid 2355154 00:24:26.085 13:58:04 -- common/autotest_common.sh@955 -- # kill 2355154 00:24:26.085 13:58:04 -- common/autotest_common.sh@960 -- # wait 2355154 00:24:26.085 13:58:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:26.085 13:58:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:26.085 13:58:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:26.085 13:58:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:26.085 13:58:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:26.085 13:58:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:26.085 13:58:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:26.085 13:58:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:26.656 13:58:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:26.656 00:24:26.656 real 1m9.001s 00:24:26.656 user 4m13.620s 00:24:26.656 sys 0m6.624s 00:24:26.656 13:58:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:26.656 13:58:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.656 ************************************ 00:24:26.656 END TEST nvmf_initiator_timeout 00:24:26.656 ************************************ 00:24:26.656 13:58:06 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:26.656 13:58:06 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:26.656 13:58:06 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:26.656 13:58:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:26.656 13:58:06 -- common/autotest_common.sh@10 -- # set +x 00:24:28.574 13:58:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:28.574 13:58:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:28.574 13:58:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:28.574 13:58:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:28.574 13:58:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:28.574 13:58:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:28.574 13:58:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:28.574 13:58:08 -- nvmf/common.sh@294 -- # net_devs=() 00:24:28.574 13:58:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:28.574 13:58:08 -- nvmf/common.sh@295 -- # e810=() 00:24:28.574 13:58:08 -- nvmf/common.sh@295 -- # local -ga e810 00:24:28.574 13:58:08 -- nvmf/common.sh@296 -- # x722=() 00:24:28.574 13:58:08 -- nvmf/common.sh@296 -- # local -ga x722 00:24:28.574 13:58:08 -- nvmf/common.sh@297 -- # mlx=() 00:24:28.574 13:58:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:28.574 13:58:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:28.574 13:58:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:28.574 13:58:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:28.574 13:58:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:28.574 13:58:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:28.574 13:58:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:28.574 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:28.574 13:58:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:28.574 13:58:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:28.574 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:28.574 13:58:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:28.574 13:58:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:28.574 13:58:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:28.574 13:58:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:28.574 13:58:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:28.574 13:58:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:28.574 13:58:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:28.574 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:28.574 13:58:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:28.574 13:58:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:28.574 13:58:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:28.574 13:58:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:28.574 13:58:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:28.574 13:58:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:28.574 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:28.574 13:58:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:28.574 13:58:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:28.574 13:58:08 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:28.574 13:58:08 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:28.574 13:58:08 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:28.574 13:58:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:28.574 13:58:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:28.574 13:58:08 -- common/autotest_common.sh@10 -- # set +x 00:24:28.835 ************************************ 00:24:28.835 START TEST nvmf_perf_adq 00:24:28.835 ************************************ 00:24:28.835 13:58:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:28.835 * Looking for test storage... 00:24:28.835 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:28.835 13:58:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:28.835 13:58:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:28.835 13:58:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:28.835 13:58:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:28.835 13:58:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:28.835 13:58:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:28.835 13:58:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:28.835 13:58:08 -- scripts/common.sh@335 -- # IFS=.-: 00:24:28.835 13:58:08 -- scripts/common.sh@335 -- # read -ra ver1 00:24:28.835 13:58:08 -- scripts/common.sh@336 -- # IFS=.-: 00:24:28.835 13:58:08 -- scripts/common.sh@336 -- # read -ra ver2 00:24:28.835 13:58:08 -- scripts/common.sh@337 -- # local 'op=<' 00:24:28.835 13:58:08 -- scripts/common.sh@339 -- # ver1_l=2 00:24:28.835 13:58:08 -- scripts/common.sh@340 -- # ver2_l=1 00:24:28.835 13:58:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:28.835 13:58:08 -- scripts/common.sh@343 -- # case "$op" in 00:24:28.835 13:58:08 -- scripts/common.sh@344 -- # : 1 00:24:28.835 13:58:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:28.835 13:58:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:28.835 13:58:09 -- scripts/common.sh@364 -- # decimal 1 00:24:28.835 13:58:09 -- scripts/common.sh@352 -- # local d=1 00:24:28.835 13:58:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:28.835 13:58:09 -- scripts/common.sh@354 -- # echo 1 00:24:28.835 13:58:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:28.835 13:58:09 -- scripts/common.sh@365 -- # decimal 2 00:24:28.835 13:58:09 -- scripts/common.sh@352 -- # local d=2 00:24:28.835 13:58:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:28.835 13:58:09 -- scripts/common.sh@354 -- # echo 2 00:24:28.835 13:58:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:28.835 13:58:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:28.835 13:58:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:28.835 13:58:09 -- scripts/common.sh@367 -- # return 0 00:24:28.835 13:58:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:28.835 13:58:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:28.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.835 --rc genhtml_branch_coverage=1 00:24:28.835 --rc genhtml_function_coverage=1 00:24:28.835 --rc genhtml_legend=1 00:24:28.835 --rc geninfo_all_blocks=1 00:24:28.835 --rc geninfo_unexecuted_blocks=1 00:24:28.835 00:24:28.835 ' 00:24:28.835 13:58:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:28.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.835 --rc genhtml_branch_coverage=1 00:24:28.835 --rc genhtml_function_coverage=1 00:24:28.835 --rc genhtml_legend=1 00:24:28.835 --rc geninfo_all_blocks=1 00:24:28.835 --rc geninfo_unexecuted_blocks=1 00:24:28.835 00:24:28.835 ' 00:24:28.835 13:58:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:28.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.835 --rc genhtml_branch_coverage=1 00:24:28.835 --rc genhtml_function_coverage=1 00:24:28.835 --rc genhtml_legend=1 00:24:28.835 --rc geninfo_all_blocks=1 00:24:28.835 --rc geninfo_unexecuted_blocks=1 00:24:28.835 00:24:28.835 ' 00:24:28.835 13:58:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:28.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.835 --rc genhtml_branch_coverage=1 00:24:28.835 --rc genhtml_function_coverage=1 00:24:28.835 --rc genhtml_legend=1 00:24:28.835 --rc geninfo_all_blocks=1 00:24:28.835 --rc geninfo_unexecuted_blocks=1 00:24:28.835 00:24:28.835 ' 00:24:28.835 13:58:09 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:28.835 13:58:09 -- nvmf/common.sh@7 -- # uname -s 00:24:28.835 13:58:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:28.835 13:58:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:28.835 13:58:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:28.835 13:58:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:28.835 13:58:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:28.835 13:58:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:28.835 13:58:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:28.835 13:58:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:28.835 13:58:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:28.835 13:58:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:28.835 13:58:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:28.835 13:58:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:28.835 13:58:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:28.835 13:58:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:28.835 13:58:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:28.835 13:58:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:28.835 13:58:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:28.835 13:58:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:28.835 13:58:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:28.835 13:58:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.835 13:58:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.835 13:58:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.835 13:58:09 -- paths/export.sh@5 -- # export PATH 00:24:28.835 13:58:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.835 13:58:09 -- nvmf/common.sh@46 -- # : 0 00:24:28.835 13:58:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:28.835 13:58:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:28.835 13:58:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:28.835 13:58:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:28.835 13:58:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:28.835 13:58:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:28.835 13:58:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:28.835 13:58:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:28.835 13:58:09 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:28.836 13:58:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:28.836 13:58:09 -- common/autotest_common.sh@10 -- # set +x 00:24:31.368 13:58:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:31.368 13:58:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:31.368 13:58:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:31.368 13:58:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:31.368 13:58:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:31.368 13:58:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:31.368 13:58:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:31.368 13:58:11 -- nvmf/common.sh@294 -- # net_devs=() 00:24:31.368 13:58:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:31.368 13:58:11 -- nvmf/common.sh@295 -- # e810=() 00:24:31.368 13:58:11 -- nvmf/common.sh@295 -- # local -ga e810 00:24:31.368 13:58:11 -- nvmf/common.sh@296 -- # x722=() 00:24:31.368 13:58:11 -- nvmf/common.sh@296 -- # local -ga x722 00:24:31.368 13:58:11 -- nvmf/common.sh@297 -- # mlx=() 00:24:31.368 13:58:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:31.368 13:58:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:31.368 13:58:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:31.368 13:58:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:31.368 13:58:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:31.368 13:58:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.368 13:58:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:31.368 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:31.368 13:58:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.368 13:58:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:31.368 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:31.368 13:58:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:31.368 13:58:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:31.368 13:58:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.368 13:58:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.368 13:58:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.368 13:58:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.368 13:58:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:31.368 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:31.368 13:58:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.368 13:58:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.368 13:58:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.368 13:58:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.368 13:58:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.368 13:58:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:31.368 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:31.368 13:58:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.368 13:58:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:31.368 13:58:11 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:31.368 13:58:11 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:31.368 13:58:11 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:31.368 13:58:11 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:31.368 13:58:11 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:31.626 13:58:11 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:34.163 13:58:14 -- target/perf_adq.sh@54 -- # sleep 5 00:24:39.438 13:58:19 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:39.438 13:58:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:39.438 13:58:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:39.438 13:58:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:39.438 13:58:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:39.438 13:58:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:39.438 13:58:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:39.438 13:58:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:39.438 13:58:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:39.438 13:58:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:39.438 13:58:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:39.438 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.438 13:58:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:39.438 13:58:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:39.438 13:58:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:39.438 13:58:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:39.438 13:58:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:39.438 13:58:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:39.438 13:58:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:39.438 13:58:19 -- nvmf/common.sh@294 -- # net_devs=() 00:24:39.438 13:58:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:39.438 13:58:19 -- nvmf/common.sh@295 -- # e810=() 00:24:39.438 13:58:19 -- nvmf/common.sh@295 -- # local -ga e810 00:24:39.438 13:58:19 -- nvmf/common.sh@296 -- # x722=() 00:24:39.438 13:58:19 -- nvmf/common.sh@296 -- # local -ga x722 00:24:39.438 13:58:19 -- nvmf/common.sh@297 -- # mlx=() 00:24:39.438 13:58:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:39.438 13:58:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:39.438 13:58:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:39.438 13:58:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:39.438 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:39.438 13:58:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:39.438 13:58:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:39.438 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:39.438 13:58:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:39.438 13:58:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:39.438 13:58:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:39.438 13:58:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:39.438 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:39.438 13:58:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:39.438 13:58:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:39.438 13:58:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:39.438 13:58:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:39.438 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:39.438 13:58:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:39.438 13:58:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:39.438 13:58:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:39.438 13:58:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:39.438 13:58:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:39.438 13:58:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:39.438 13:58:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:39.438 13:58:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:39.438 13:58:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:39.438 13:58:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:39.438 13:58:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:39.438 13:58:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:39.438 13:58:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:39.438 13:58:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:39.438 13:58:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:39.438 13:58:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:39.438 13:58:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:39.438 13:58:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:39.438 13:58:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:39.438 13:58:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:39.438 13:58:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:39.438 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:39.438 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:24:39.438 00:24:39.438 --- 10.0.0.2 ping statistics --- 00:24:39.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:39.438 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:24:39.438 13:58:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:39.438 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:39.438 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:24:39.438 00:24:39.438 --- 10.0.0.1 ping statistics --- 00:24:39.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:39.438 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:24:39.438 13:58:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:39.438 13:58:19 -- nvmf/common.sh@410 -- # return 0 00:24:39.438 13:58:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:39.438 13:58:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:39.438 13:58:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:39.438 13:58:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:39.438 13:58:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:39.438 13:58:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:39.438 13:58:19 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:39.438 13:58:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:39.438 13:58:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:39.438 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.438 13:58:19 -- nvmf/common.sh@469 -- # nvmfpid=2368201 00:24:39.438 13:58:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:39.438 13:58:19 -- nvmf/common.sh@470 -- # waitforlisten 2368201 00:24:39.438 13:58:19 -- common/autotest_common.sh@829 -- # '[' -z 2368201 ']' 00:24:39.438 13:58:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:39.438 13:58:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:39.438 13:58:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:39.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:39.438 13:58:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:39.438 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.438 [2024-11-29 13:58:19.299346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:39.438 [2024-11-29 13:58:19.299469] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:39.438 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.438 [2024-11-29 13:58:19.367640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:39.438 [2024-11-29 13:58:19.455736] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:39.438 [2024-11-29 13:58:19.455886] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:39.438 [2024-11-29 13:58:19.455903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:39.438 [2024-11-29 13:58:19.455916] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:39.438 [2024-11-29 13:58:19.455982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:39.438 [2024-11-29 13:58:19.456042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:39.438 [2024-11-29 13:58:19.456106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:39.438 [2024-11-29 13:58:19.456109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:39.438 13:58:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:39.438 13:58:19 -- common/autotest_common.sh@862 -- # return 0 00:24:39.438 13:58:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:39.438 13:58:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:39.438 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.438 13:58:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:39.438 13:58:19 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:39.438 13:58:19 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:39.438 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 [2024-11-29 13:58:19.667028] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 Malloc1 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.439 13:58:19 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:39.439 13:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.439 13:58:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.439 [2024-11-29 13:58:19.718448] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:39.697 13:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.697 13:58:19 -- target/perf_adq.sh@73 -- # perfpid=2368356 00:24:39.697 13:58:19 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:39.697 13:58:19 -- target/perf_adq.sh@74 -- # sleep 2 00:24:39.697 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.592 13:58:21 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:41.592 13:58:21 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:41.592 13:58:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.592 13:58:21 -- target/perf_adq.sh@76 -- # wc -l 00:24:41.592 13:58:21 -- common/autotest_common.sh@10 -- # set +x 00:24:41.592 13:58:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.592 13:58:21 -- target/perf_adq.sh@76 -- # count=4 00:24:41.592 13:58:21 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:41.592 13:58:21 -- target/perf_adq.sh@81 -- # wait 2368356 00:24:49.697 Initializing NVMe Controllers 00:24:49.697 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:49.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:49.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:49.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:49.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:49.697 Initialization complete. Launching workers. 00:24:49.697 ======================================================== 00:24:49.697 Latency(us) 00:24:49.697 Device Information : IOPS MiB/s Average min max 00:24:49.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10339.40 40.39 6192.24 1601.39 9930.25 00:24:49.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11383.00 44.46 5624.00 1663.91 9391.02 00:24:49.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11396.60 44.52 5616.34 1418.58 9515.10 00:24:49.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10645.50 41.58 6012.15 1359.72 10129.20 00:24:49.697 ======================================================== 00:24:49.697 Total : 43764.48 170.96 5850.67 1359.72 10129.20 00:24:49.697 00:24:49.697 13:58:29 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:49.697 13:58:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:49.697 13:58:29 -- nvmf/common.sh@116 -- # sync 00:24:49.697 13:58:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:49.697 13:58:29 -- nvmf/common.sh@119 -- # set +e 00:24:49.697 13:58:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:49.697 13:58:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:49.697 rmmod nvme_tcp 00:24:49.697 rmmod nvme_fabrics 00:24:49.697 rmmod nvme_keyring 00:24:49.697 13:58:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:49.697 13:58:29 -- nvmf/common.sh@123 -- # set -e 00:24:49.697 13:58:29 -- nvmf/common.sh@124 -- # return 0 00:24:49.697 13:58:29 -- nvmf/common.sh@477 -- # '[' -n 2368201 ']' 00:24:49.697 13:58:29 -- nvmf/common.sh@478 -- # killprocess 2368201 00:24:49.697 13:58:29 -- common/autotest_common.sh@936 -- # '[' -z 2368201 ']' 00:24:49.697 13:58:29 -- common/autotest_common.sh@940 -- # kill -0 2368201 00:24:49.697 13:58:29 -- common/autotest_common.sh@941 -- # uname 00:24:49.697 13:58:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:49.697 13:58:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2368201 00:24:49.697 13:58:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:49.697 13:58:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:49.697 13:58:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2368201' 00:24:49.697 killing process with pid 2368201 00:24:49.697 13:58:29 -- common/autotest_common.sh@955 -- # kill 2368201 00:24:49.697 13:58:29 -- common/autotest_common.sh@960 -- # wait 2368201 00:24:49.956 13:58:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:49.956 13:58:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:49.956 13:58:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:49.956 13:58:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:49.956 13:58:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:49.956 13:58:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.956 13:58:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.956 13:58:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:52.491 13:58:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:52.491 13:58:32 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:52.491 13:58:32 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:52.749 13:58:32 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:55.331 13:58:35 -- target/perf_adq.sh@54 -- # sleep 5 00:25:00.606 13:58:40 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:00.606 13:58:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:00.606 13:58:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:00.606 13:58:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:00.606 13:58:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:00.606 13:58:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:00.606 13:58:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.606 13:58:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.606 13:58:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.606 13:58:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:00.606 13:58:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:00.606 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.606 13:58:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:00.606 13:58:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:00.606 13:58:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:00.606 13:58:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:00.606 13:58:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:00.606 13:58:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:00.606 13:58:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:00.606 13:58:40 -- nvmf/common.sh@294 -- # net_devs=() 00:25:00.606 13:58:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:00.606 13:58:40 -- nvmf/common.sh@295 -- # e810=() 00:25:00.606 13:58:40 -- nvmf/common.sh@295 -- # local -ga e810 00:25:00.606 13:58:40 -- nvmf/common.sh@296 -- # x722=() 00:25:00.606 13:58:40 -- nvmf/common.sh@296 -- # local -ga x722 00:25:00.606 13:58:40 -- nvmf/common.sh@297 -- # mlx=() 00:25:00.606 13:58:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:00.606 13:58:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:00.606 13:58:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:00.606 13:58:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:00.606 13:58:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:00.606 13:58:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.606 13:58:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:00.606 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:00.606 13:58:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.606 13:58:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:00.606 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:00.606 13:58:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:00.606 13:58:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.606 13:58:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.606 13:58:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.606 13:58:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.606 13:58:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:00.606 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:00.606 13:58:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.606 13:58:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.606 13:58:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.606 13:58:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.606 13:58:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.606 13:58:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:00.606 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:00.606 13:58:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.606 13:58:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:00.606 13:58:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:00.606 13:58:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:00.606 13:58:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:00.606 13:58:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:00.606 13:58:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:00.606 13:58:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:00.606 13:58:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:00.607 13:58:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:00.607 13:58:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:00.607 13:58:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:00.607 13:58:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:00.607 13:58:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:00.607 13:58:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:00.607 13:58:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:00.607 13:58:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:00.607 13:58:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:00.607 13:58:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:00.607 13:58:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:00.607 13:58:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:00.607 13:58:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:00.607 13:58:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:00.607 13:58:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:00.607 13:58:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:00.607 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:00.607 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:25:00.607 00:25:00.607 --- 10.0.0.2 ping statistics --- 00:25:00.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.607 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:25:00.607 13:58:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:00.607 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:00.607 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:25:00.607 00:25:00.607 --- 10.0.0.1 ping statistics --- 00:25:00.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.607 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:25:00.607 13:58:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:00.607 13:58:40 -- nvmf/common.sh@410 -- # return 0 00:25:00.607 13:58:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:00.607 13:58:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:00.607 13:58:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:00.607 13:58:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:00.607 13:58:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:00.607 13:58:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:00.607 13:58:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:00.607 13:58:40 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:00.607 13:58:40 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:00.607 13:58:40 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:00.607 13:58:40 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:00.607 net.core.busy_poll = 1 00:25:00.607 13:58:40 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:00.607 net.core.busy_read = 1 00:25:00.607 13:58:40 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:00.607 13:58:40 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:00.607 13:58:40 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:00.607 13:58:40 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:00.607 13:58:40 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:00.607 13:58:40 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:00.607 13:58:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:00.607 13:58:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 13:58:40 -- nvmf/common.sh@469 -- # nvmfpid=2371043 00:25:00.607 13:58:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:00.607 13:58:40 -- nvmf/common.sh@470 -- # waitforlisten 2371043 00:25:00.607 13:58:40 -- common/autotest_common.sh@829 -- # '[' -z 2371043 ']' 00:25:00.607 13:58:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:00.607 13:58:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:00.607 13:58:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:00.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:00.607 13:58:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 [2024-11-29 13:58:40.485546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:00.607 [2024-11-29 13:58:40.485622] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:00.607 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.607 [2024-11-29 13:58:40.555429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:00.607 [2024-11-29 13:58:40.647913] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:00.607 [2024-11-29 13:58:40.648053] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:00.607 [2024-11-29 13:58:40.648072] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:00.607 [2024-11-29 13:58:40.648084] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:00.607 [2024-11-29 13:58:40.648138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:00.607 [2024-11-29 13:58:40.648181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:00.607 [2024-11-29 13:58:40.648222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:00.607 [2024-11-29 13:58:40.648224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:00.607 13:58:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:00.607 13:58:40 -- common/autotest_common.sh@862 -- # return 0 00:25:00.607 13:58:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:00.607 13:58:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 13:58:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:00.607 13:58:40 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:00.607 13:58:40 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:00.607 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.607 13:58:40 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:00.607 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.607 13:58:40 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:00.607 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 [2024-11-29 13:58:40.816883] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:00.607 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.607 13:58:40 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:00.607 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.607 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.607 Malloc1 00:25:00.607 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.608 13:58:40 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:00.608 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.608 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.608 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.608 13:58:40 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:00.608 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.608 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.608 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.608 13:58:40 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:00.608 13:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.608 13:58:40 -- common/autotest_common.sh@10 -- # set +x 00:25:00.608 [2024-11-29 13:58:40.867672] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:00.608 13:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.608 13:58:40 -- target/perf_adq.sh@94 -- # perfpid=2371075 00:25:00.608 13:58:40 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:00.608 13:58:40 -- target/perf_adq.sh@95 -- # sleep 2 00:25:00.866 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.767 13:58:42 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:02.767 13:58:42 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:02.767 13:58:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:02.767 13:58:42 -- target/perf_adq.sh@97 -- # wc -l 00:25:02.767 13:58:42 -- common/autotest_common.sh@10 -- # set +x 00:25:02.767 13:58:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:02.767 13:58:42 -- target/perf_adq.sh@97 -- # count=2 00:25:02.767 13:58:42 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:02.767 13:58:42 -- target/perf_adq.sh@103 -- # wait 2371075 00:25:10.876 Initializing NVMe Controllers 00:25:10.876 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:10.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:10.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:10.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:10.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:10.876 Initialization complete. Launching workers. 00:25:10.876 ======================================================== 00:25:10.876 Latency(us) 00:25:10.876 Device Information : IOPS MiB/s Average min max 00:25:10.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5347.91 20.89 11970.63 1783.18 60942.87 00:25:10.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4843.62 18.92 13217.34 1115.09 60449.66 00:25:10.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5346.61 20.89 11973.56 1462.84 58462.94 00:25:10.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 13617.08 53.19 4700.46 1114.63 45331.19 00:25:10.876 ======================================================== 00:25:10.876 Total : 29155.23 113.89 8782.72 1114.63 60942.87 00:25:10.876 00:25:10.876 13:58:51 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:10.876 13:58:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:10.876 13:58:51 -- nvmf/common.sh@116 -- # sync 00:25:10.876 13:58:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:10.876 13:58:51 -- nvmf/common.sh@119 -- # set +e 00:25:10.876 13:58:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:10.876 13:58:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:10.876 rmmod nvme_tcp 00:25:10.876 rmmod nvme_fabrics 00:25:10.876 rmmod nvme_keyring 00:25:10.876 13:58:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:10.876 13:58:51 -- nvmf/common.sh@123 -- # set -e 00:25:10.876 13:58:51 -- nvmf/common.sh@124 -- # return 0 00:25:10.876 13:58:51 -- nvmf/common.sh@477 -- # '[' -n 2371043 ']' 00:25:10.876 13:58:51 -- nvmf/common.sh@478 -- # killprocess 2371043 00:25:10.876 13:58:51 -- common/autotest_common.sh@936 -- # '[' -z 2371043 ']' 00:25:10.876 13:58:51 -- common/autotest_common.sh@940 -- # kill -0 2371043 00:25:10.876 13:58:51 -- common/autotest_common.sh@941 -- # uname 00:25:10.876 13:58:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:10.876 13:58:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2371043 00:25:10.876 13:58:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:10.876 13:58:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:10.876 13:58:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2371043' 00:25:10.876 killing process with pid 2371043 00:25:10.876 13:58:51 -- common/autotest_common.sh@955 -- # kill 2371043 00:25:10.876 13:58:51 -- common/autotest_common.sh@960 -- # wait 2371043 00:25:11.135 13:58:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:11.135 13:58:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:11.135 13:58:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:11.135 13:58:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:11.135 13:58:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:11.135 13:58:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:11.135 13:58:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:11.135 13:58:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.419 13:58:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:14.419 13:58:54 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:14.419 00:25:14.419 real 0m45.516s 00:25:14.419 user 2m33.411s 00:25:14.419 sys 0m11.883s 00:25:14.419 13:58:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:14.419 13:58:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.419 ************************************ 00:25:14.419 END TEST nvmf_perf_adq 00:25:14.419 ************************************ 00:25:14.419 13:58:54 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:14.419 13:58:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:14.419 13:58:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:14.419 13:58:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.419 ************************************ 00:25:14.419 START TEST nvmf_shutdown 00:25:14.419 ************************************ 00:25:14.419 13:58:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:14.419 * Looking for test storage... 00:25:14.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:14.419 13:58:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:14.419 13:58:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:14.419 13:58:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:14.419 13:58:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:14.419 13:58:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:14.419 13:58:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:14.419 13:58:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:14.419 13:58:54 -- scripts/common.sh@335 -- # IFS=.-: 00:25:14.419 13:58:54 -- scripts/common.sh@335 -- # read -ra ver1 00:25:14.420 13:58:54 -- scripts/common.sh@336 -- # IFS=.-: 00:25:14.420 13:58:54 -- scripts/common.sh@336 -- # read -ra ver2 00:25:14.420 13:58:54 -- scripts/common.sh@337 -- # local 'op=<' 00:25:14.420 13:58:54 -- scripts/common.sh@339 -- # ver1_l=2 00:25:14.420 13:58:54 -- scripts/common.sh@340 -- # ver2_l=1 00:25:14.420 13:58:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:14.420 13:58:54 -- scripts/common.sh@343 -- # case "$op" in 00:25:14.420 13:58:54 -- scripts/common.sh@344 -- # : 1 00:25:14.420 13:58:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:14.420 13:58:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:14.420 13:58:54 -- scripts/common.sh@364 -- # decimal 1 00:25:14.420 13:58:54 -- scripts/common.sh@352 -- # local d=1 00:25:14.420 13:58:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:14.420 13:58:54 -- scripts/common.sh@354 -- # echo 1 00:25:14.420 13:58:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:14.420 13:58:54 -- scripts/common.sh@365 -- # decimal 2 00:25:14.420 13:58:54 -- scripts/common.sh@352 -- # local d=2 00:25:14.420 13:58:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:14.420 13:58:54 -- scripts/common.sh@354 -- # echo 2 00:25:14.420 13:58:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:14.420 13:58:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:14.420 13:58:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:14.420 13:58:54 -- scripts/common.sh@367 -- # return 0 00:25:14.420 13:58:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:14.420 13:58:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:14.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:14.420 --rc genhtml_branch_coverage=1 00:25:14.420 --rc genhtml_function_coverage=1 00:25:14.420 --rc genhtml_legend=1 00:25:14.420 --rc geninfo_all_blocks=1 00:25:14.420 --rc geninfo_unexecuted_blocks=1 00:25:14.420 00:25:14.420 ' 00:25:14.420 13:58:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:14.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:14.420 --rc genhtml_branch_coverage=1 00:25:14.420 --rc genhtml_function_coverage=1 00:25:14.420 --rc genhtml_legend=1 00:25:14.420 --rc geninfo_all_blocks=1 00:25:14.420 --rc geninfo_unexecuted_blocks=1 00:25:14.420 00:25:14.420 ' 00:25:14.420 13:58:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:14.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:14.420 --rc genhtml_branch_coverage=1 00:25:14.420 --rc genhtml_function_coverage=1 00:25:14.420 --rc genhtml_legend=1 00:25:14.420 --rc geninfo_all_blocks=1 00:25:14.420 --rc geninfo_unexecuted_blocks=1 00:25:14.420 00:25:14.420 ' 00:25:14.420 13:58:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:14.420 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:14.420 --rc genhtml_branch_coverage=1 00:25:14.420 --rc genhtml_function_coverage=1 00:25:14.420 --rc genhtml_legend=1 00:25:14.420 --rc geninfo_all_blocks=1 00:25:14.420 --rc geninfo_unexecuted_blocks=1 00:25:14.420 00:25:14.420 ' 00:25:14.420 13:58:54 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:14.420 13:58:54 -- nvmf/common.sh@7 -- # uname -s 00:25:14.420 13:58:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:14.420 13:58:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:14.420 13:58:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:14.420 13:58:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:14.420 13:58:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:14.420 13:58:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:14.420 13:58:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:14.420 13:58:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:14.420 13:58:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:14.420 13:58:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:14.420 13:58:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:14.420 13:58:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:14.420 13:58:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:14.420 13:58:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:14.420 13:58:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:14.420 13:58:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:14.420 13:58:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:14.420 13:58:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:14.420 13:58:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:14.420 13:58:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.420 13:58:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.420 13:58:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.420 13:58:54 -- paths/export.sh@5 -- # export PATH 00:25:14.420 13:58:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.420 13:58:54 -- nvmf/common.sh@46 -- # : 0 00:25:14.420 13:58:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:14.420 13:58:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:14.420 13:58:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:14.420 13:58:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:14.420 13:58:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:14.420 13:58:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:14.420 13:58:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:14.420 13:58:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:14.420 13:58:54 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:14.420 13:58:54 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:14.420 13:58:54 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:14.420 13:58:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:14.420 13:58:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:14.420 13:58:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.420 ************************************ 00:25:14.420 START TEST nvmf_shutdown_tc1 00:25:14.420 ************************************ 00:25:14.420 13:58:54 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:14.420 13:58:54 -- target/shutdown.sh@74 -- # starttarget 00:25:14.420 13:58:54 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:14.420 13:58:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:14.420 13:58:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:14.420 13:58:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:14.420 13:58:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:14.420 13:58:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:14.420 13:58:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:14.420 13:58:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:14.420 13:58:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.420 13:58:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:14.420 13:58:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:14.420 13:58:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:14.420 13:58:54 -- common/autotest_common.sh@10 -- # set +x 00:25:16.332 13:58:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:16.332 13:58:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:16.332 13:58:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:16.332 13:58:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:16.332 13:58:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:16.332 13:58:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:16.332 13:58:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:16.332 13:58:56 -- nvmf/common.sh@294 -- # net_devs=() 00:25:16.332 13:58:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:16.332 13:58:56 -- nvmf/common.sh@295 -- # e810=() 00:25:16.332 13:58:56 -- nvmf/common.sh@295 -- # local -ga e810 00:25:16.332 13:58:56 -- nvmf/common.sh@296 -- # x722=() 00:25:16.332 13:58:56 -- nvmf/common.sh@296 -- # local -ga x722 00:25:16.332 13:58:56 -- nvmf/common.sh@297 -- # mlx=() 00:25:16.332 13:58:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:16.332 13:58:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:16.332 13:58:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:16.332 13:58:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:16.332 13:58:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:16.332 13:58:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.332 13:58:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:16.332 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:16.332 13:58:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.332 13:58:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:16.332 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:16.332 13:58:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:16.332 13:58:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.332 13:58:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.332 13:58:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.332 13:58:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.332 13:58:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:16.332 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:16.332 13:58:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.332 13:58:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.332 13:58:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.332 13:58:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.332 13:58:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.332 13:58:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:16.332 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:16.332 13:58:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.332 13:58:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:16.332 13:58:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:16.332 13:58:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:16.332 13:58:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:16.332 13:58:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:16.332 13:58:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:16.332 13:58:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:16.333 13:58:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:16.333 13:58:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:16.333 13:58:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:16.333 13:58:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:16.333 13:58:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:16.333 13:58:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:16.333 13:58:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:16.333 13:58:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:16.333 13:58:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:16.333 13:58:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:16.333 13:58:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:16.333 13:58:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:16.333 13:58:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:16.333 13:58:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:16.333 13:58:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:16.333 13:58:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:16.333 13:58:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:16.333 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:16.333 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:25:16.333 00:25:16.333 --- 10.0.0.2 ping statistics --- 00:25:16.333 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.333 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:25:16.333 13:58:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:16.592 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:16.592 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:25:16.592 00:25:16.592 --- 10.0.0.1 ping statistics --- 00:25:16.592 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.592 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:25:16.592 13:58:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:16.592 13:58:56 -- nvmf/common.sh@410 -- # return 0 00:25:16.592 13:58:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:16.592 13:58:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:16.592 13:58:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:16.592 13:58:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:16.592 13:58:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:16.592 13:58:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:16.592 13:58:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:16.592 13:58:56 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:16.592 13:58:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:16.592 13:58:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:16.592 13:58:56 -- common/autotest_common.sh@10 -- # set +x 00:25:16.592 13:58:56 -- nvmf/common.sh@469 -- # nvmfpid=2374416 00:25:16.592 13:58:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:16.592 13:58:56 -- nvmf/common.sh@470 -- # waitforlisten 2374416 00:25:16.592 13:58:56 -- common/autotest_common.sh@829 -- # '[' -z 2374416 ']' 00:25:16.592 13:58:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:16.592 13:58:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:16.592 13:58:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:16.592 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:16.592 13:58:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:16.592 13:58:56 -- common/autotest_common.sh@10 -- # set +x 00:25:16.592 [2024-11-29 13:58:56.688328] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:16.592 [2024-11-29 13:58:56.688413] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:16.592 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.592 [2024-11-29 13:58:56.752207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:16.592 [2024-11-29 13:58:56.836121] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:16.592 [2024-11-29 13:58:56.836274] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:16.592 [2024-11-29 13:58:56.836291] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:16.592 [2024-11-29 13:58:56.836303] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:16.592 [2024-11-29 13:58:56.836358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:16.592 [2024-11-29 13:58:56.836418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:16.592 [2024-11-29 13:58:56.836487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:16.592 [2024-11-29 13:58:56.836490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:17.526 13:58:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:17.526 13:58:57 -- common/autotest_common.sh@862 -- # return 0 00:25:17.526 13:58:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:17.526 13:58:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:17.526 13:58:57 -- common/autotest_common.sh@10 -- # set +x 00:25:17.526 13:58:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:17.526 13:58:57 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:17.526 13:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.526 13:58:57 -- common/autotest_common.sh@10 -- # set +x 00:25:17.526 [2024-11-29 13:58:57.764292] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:17.526 13:58:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.526 13:58:57 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:17.526 13:58:57 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:17.526 13:58:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:17.526 13:58:57 -- common/autotest_common.sh@10 -- # set +x 00:25:17.526 13:58:57 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:17.526 13:58:57 -- target/shutdown.sh@28 -- # cat 00:25:17.526 13:58:57 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:17.526 13:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.526 13:58:57 -- common/autotest_common.sh@10 -- # set +x 00:25:17.785 Malloc1 00:25:17.785 [2024-11-29 13:58:57.849965] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:17.785 Malloc2 00:25:17.785 Malloc3 00:25:17.785 Malloc4 00:25:17.785 Malloc5 00:25:18.044 Malloc6 00:25:18.044 Malloc7 00:25:18.044 Malloc8 00:25:18.044 Malloc9 00:25:18.044 Malloc10 00:25:18.044 13:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.044 13:58:58 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:18.044 13:58:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:18.044 13:58:58 -- common/autotest_common.sh@10 -- # set +x 00:25:18.044 13:58:58 -- target/shutdown.sh@78 -- # perfpid=2374717 00:25:18.044 13:58:58 -- target/shutdown.sh@79 -- # waitforlisten 2374717 /var/tmp/bdevperf.sock 00:25:18.044 13:58:58 -- common/autotest_common.sh@829 -- # '[' -z 2374717 ']' 00:25:18.044 13:58:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:18.044 13:58:58 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:18.044 13:58:58 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:18.044 13:58:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:18.044 13:58:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:18.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:18.044 13:58:58 -- nvmf/common.sh@520 -- # config=() 00:25:18.044 13:58:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:18.044 13:58:58 -- nvmf/common.sh@520 -- # local subsystem config 00:25:18.044 13:58:58 -- common/autotest_common.sh@10 -- # set +x 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.044 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.044 { 00:25:18.044 "params": { 00:25:18.044 "name": "Nvme$subsystem", 00:25:18.044 "trtype": "$TEST_TRANSPORT", 00:25:18.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.044 "adrfam": "ipv4", 00:25:18.044 "trsvcid": "$NVMF_PORT", 00:25:18.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.044 "hdgst": ${hdgst:-false}, 00:25:18.044 "ddgst": ${ddgst:-false} 00:25:18.044 }, 00:25:18.044 "method": "bdev_nvme_attach_controller" 00:25:18.044 } 00:25:18.044 EOF 00:25:18.044 )") 00:25:18.044 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.303 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.303 { 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme$subsystem", 00:25:18.303 "trtype": "$TEST_TRANSPORT", 00:25:18.303 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "$NVMF_PORT", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.303 "hdgst": ${hdgst:-false}, 00:25:18.303 "ddgst": ${ddgst:-false} 00:25:18.303 }, 00:25:18.303 "method": "bdev_nvme_attach_controller" 00:25:18.303 } 00:25:18.303 EOF 00:25:18.303 )") 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.303 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.303 { 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme$subsystem", 00:25:18.303 "trtype": "$TEST_TRANSPORT", 00:25:18.303 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "$NVMF_PORT", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.303 "hdgst": ${hdgst:-false}, 00:25:18.303 "ddgst": ${ddgst:-false} 00:25:18.303 }, 00:25:18.303 "method": "bdev_nvme_attach_controller" 00:25:18.303 } 00:25:18.303 EOF 00:25:18.303 )") 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.303 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.303 { 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme$subsystem", 00:25:18.303 "trtype": "$TEST_TRANSPORT", 00:25:18.303 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "$NVMF_PORT", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.303 "hdgst": ${hdgst:-false}, 00:25:18.303 "ddgst": ${ddgst:-false} 00:25:18.303 }, 00:25:18.303 "method": "bdev_nvme_attach_controller" 00:25:18.303 } 00:25:18.303 EOF 00:25:18.303 )") 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.303 13:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.303 { 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme$subsystem", 00:25:18.303 "trtype": "$TEST_TRANSPORT", 00:25:18.303 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "$NVMF_PORT", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.303 "hdgst": ${hdgst:-false}, 00:25:18.303 "ddgst": ${ddgst:-false} 00:25:18.303 }, 00:25:18.303 "method": "bdev_nvme_attach_controller" 00:25:18.303 } 00:25:18.303 EOF 00:25:18.303 )") 00:25:18.303 13:58:58 -- nvmf/common.sh@542 -- # cat 00:25:18.303 13:58:58 -- nvmf/common.sh@544 -- # jq . 00:25:18.303 13:58:58 -- nvmf/common.sh@545 -- # IFS=, 00:25:18.303 13:58:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme1", 00:25:18.303 "trtype": "tcp", 00:25:18.303 "traddr": "10.0.0.2", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "4420", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:18.303 "hdgst": false, 00:25:18.303 "ddgst": false 00:25:18.303 }, 00:25:18.303 "method": "bdev_nvme_attach_controller" 00:25:18.303 },{ 00:25:18.303 "params": { 00:25:18.303 "name": "Nvme2", 00:25:18.303 "trtype": "tcp", 00:25:18.303 "traddr": "10.0.0.2", 00:25:18.303 "adrfam": "ipv4", 00:25:18.303 "trsvcid": "4420", 00:25:18.303 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:18.303 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:18.303 "hdgst": false, 00:25:18.303 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme3", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme4", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme5", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme6", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme7", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme8", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme9", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 },{ 00:25:18.304 "params": { 00:25:18.304 "name": "Nvme10", 00:25:18.304 "trtype": "tcp", 00:25:18.304 "traddr": "10.0.0.2", 00:25:18.304 "adrfam": "ipv4", 00:25:18.304 "trsvcid": "4420", 00:25:18.304 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:18.304 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:18.304 "hdgst": false, 00:25:18.304 "ddgst": false 00:25:18.304 }, 00:25:18.304 "method": "bdev_nvme_attach_controller" 00:25:18.304 }' 00:25:18.304 [2024-11-29 13:58:58.345140] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:18.304 [2024-11-29 13:58:58.345212] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:18.304 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.304 [2024-11-29 13:58:58.410366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:18.304 [2024-11-29 13:58:58.495419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:20.203 13:59:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:20.203 13:59:00 -- common/autotest_common.sh@862 -- # return 0 00:25:20.203 13:59:00 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:20.203 13:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.203 13:59:00 -- common/autotest_common.sh@10 -- # set +x 00:25:20.203 13:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:20.203 13:59:00 -- target/shutdown.sh@83 -- # kill -9 2374717 00:25:20.203 13:59:00 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:20.203 13:59:00 -- target/shutdown.sh@87 -- # sleep 1 00:25:21.136 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2374717 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:21.136 13:59:01 -- target/shutdown.sh@88 -- # kill -0 2374416 00:25:21.136 13:59:01 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:21.136 13:59:01 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:21.136 13:59:01 -- nvmf/common.sh@520 -- # config=() 00:25:21.136 13:59:01 -- nvmf/common.sh@520 -- # local subsystem config 00:25:21.136 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.136 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.136 { 00:25:21.136 "params": { 00:25:21.136 "name": "Nvme$subsystem", 00:25:21.136 "trtype": "$TEST_TRANSPORT", 00:25:21.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.136 "adrfam": "ipv4", 00:25:21.136 "trsvcid": "$NVMF_PORT", 00:25:21.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.136 "hdgst": ${hdgst:-false}, 00:25:21.136 "ddgst": ${ddgst:-false} 00:25:21.136 }, 00:25:21.136 "method": "bdev_nvme_attach_controller" 00:25:21.136 } 00:25:21.136 EOF 00:25:21.136 )") 00:25:21.136 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.136 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.136 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.136 { 00:25:21.136 "params": { 00:25:21.136 "name": "Nvme$subsystem", 00:25:21.136 "trtype": "$TEST_TRANSPORT", 00:25:21.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.136 "adrfam": "ipv4", 00:25:21.136 "trsvcid": "$NVMF_PORT", 00:25:21.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.136 "hdgst": ${hdgst:-false}, 00:25:21.136 "ddgst": ${ddgst:-false} 00:25:21.136 }, 00:25:21.136 "method": "bdev_nvme_attach_controller" 00:25:21.136 } 00:25:21.136 EOF 00:25:21.136 )") 00:25:21.136 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.136 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.136 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.136 { 00:25:21.136 "params": { 00:25:21.136 "name": "Nvme$subsystem", 00:25:21.136 "trtype": "$TEST_TRANSPORT", 00:25:21.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.136 "adrfam": "ipv4", 00:25:21.136 "trsvcid": "$NVMF_PORT", 00:25:21.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.137 { 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme$subsystem", 00:25:21.137 "trtype": "$TEST_TRANSPORT", 00:25:21.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "$NVMF_PORT", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.137 "hdgst": ${hdgst:-false}, 00:25:21.137 "ddgst": ${ddgst:-false} 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 } 00:25:21.137 EOF 00:25:21.137 )") 00:25:21.137 13:59:01 -- nvmf/common.sh@542 -- # cat 00:25:21.137 13:59:01 -- nvmf/common.sh@544 -- # jq . 00:25:21.137 13:59:01 -- nvmf/common.sh@545 -- # IFS=, 00:25:21.137 13:59:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme1", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme2", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme3", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme4", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme5", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme6", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme7", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.137 "params": { 00:25:21.137 "name": "Nvme8", 00:25:21.137 "trtype": "tcp", 00:25:21.137 "traddr": "10.0.0.2", 00:25:21.137 "adrfam": "ipv4", 00:25:21.137 "trsvcid": "4420", 00:25:21.137 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:21.137 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:21.137 "hdgst": false, 00:25:21.137 "ddgst": false 00:25:21.137 }, 00:25:21.137 "method": "bdev_nvme_attach_controller" 00:25:21.137 },{ 00:25:21.138 "params": { 00:25:21.138 "name": "Nvme9", 00:25:21.138 "trtype": "tcp", 00:25:21.138 "traddr": "10.0.0.2", 00:25:21.138 "adrfam": "ipv4", 00:25:21.138 "trsvcid": "4420", 00:25:21.138 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:21.138 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:21.138 "hdgst": false, 00:25:21.138 "ddgst": false 00:25:21.138 }, 00:25:21.138 "method": "bdev_nvme_attach_controller" 00:25:21.138 },{ 00:25:21.138 "params": { 00:25:21.138 "name": "Nvme10", 00:25:21.138 "trtype": "tcp", 00:25:21.138 "traddr": "10.0.0.2", 00:25:21.138 "adrfam": "ipv4", 00:25:21.138 "trsvcid": "4420", 00:25:21.138 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:21.138 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:21.138 "hdgst": false, 00:25:21.138 "ddgst": false 00:25:21.138 }, 00:25:21.138 "method": "bdev_nvme_attach_controller" 00:25:21.138 }' 00:25:21.138 [2024-11-29 13:59:01.116960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:21.138 [2024-11-29 13:59:01.117047] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2375044 ] 00:25:21.138 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.138 [2024-11-29 13:59:01.184031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:21.138 [2024-11-29 13:59:01.272826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:22.511 Running I/O for 1 seconds... 00:25:23.885 00:25:23.885 Latency(us) 00:25:23.885 [2024-11-29T12:59:04.167Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme1n1 : 1.10 395.30 24.71 0.00 0.00 158854.50 20388.98 134373.07 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme2n1 : 1.09 396.40 24.78 0.00 0.00 157278.91 20486.07 118838.61 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme3n1 : 1.08 400.24 25.01 0.00 0.00 154867.98 17087.91 116508.44 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme4n1 : 1.09 398.21 24.89 0.00 0.00 154438.45 19029.71 116508.44 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme5n1 : 1.10 395.83 24.74 0.00 0.00 154106.91 20583.16 118838.61 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme6n1 : 1.10 394.31 24.64 0.00 0.00 153749.20 19903.53 119615.34 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme7n1 : 1.10 392.89 24.56 0.00 0.00 153387.91 18544.26 121168.78 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme8n1 : 1.11 392.06 24.50 0.00 0.00 152960.17 15534.46 125829.12 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme9n1 : 1.11 395.03 24.69 0.00 0.00 151676.89 7767.23 126605.84 00:25:23.885 [2024-11-29T12:59:04.167Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.885 Verification LBA range: start 0x0 length 0x400 00:25:23.885 Nvme10n1 : 1.11 389.52 24.34 0.00 0.00 153068.76 5024.43 141363.58 00:25:23.885 [2024-11-29T12:59:04.167Z] =================================================================================================================== 00:25:23.885 [2024-11-29T12:59:04.167Z] Total : 3949.80 246.86 0.00 0.00 154435.79 5024.43 141363.58 00:25:23.885 13:59:04 -- target/shutdown.sh@93 -- # stoptarget 00:25:23.885 13:59:04 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:23.885 13:59:04 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:23.885 13:59:04 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:23.885 13:59:04 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:23.885 13:59:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:23.885 13:59:04 -- nvmf/common.sh@116 -- # sync 00:25:23.885 13:59:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:23.885 13:59:04 -- nvmf/common.sh@119 -- # set +e 00:25:23.885 13:59:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:23.885 13:59:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:23.885 rmmod nvme_tcp 00:25:24.143 rmmod nvme_fabrics 00:25:24.143 rmmod nvme_keyring 00:25:24.143 13:59:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:24.143 13:59:04 -- nvmf/common.sh@123 -- # set -e 00:25:24.143 13:59:04 -- nvmf/common.sh@124 -- # return 0 00:25:24.143 13:59:04 -- nvmf/common.sh@477 -- # '[' -n 2374416 ']' 00:25:24.143 13:59:04 -- nvmf/common.sh@478 -- # killprocess 2374416 00:25:24.143 13:59:04 -- common/autotest_common.sh@936 -- # '[' -z 2374416 ']' 00:25:24.143 13:59:04 -- common/autotest_common.sh@940 -- # kill -0 2374416 00:25:24.143 13:59:04 -- common/autotest_common.sh@941 -- # uname 00:25:24.143 13:59:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:24.143 13:59:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2374416 00:25:24.143 13:59:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:24.143 13:59:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:24.143 13:59:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2374416' 00:25:24.143 killing process with pid 2374416 00:25:24.143 13:59:04 -- common/autotest_common.sh@955 -- # kill 2374416 00:25:24.143 13:59:04 -- common/autotest_common.sh@960 -- # wait 2374416 00:25:24.710 13:59:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:24.710 13:59:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:24.710 13:59:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:24.710 13:59:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:24.710 13:59:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:24.710 13:59:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.710 13:59:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.710 13:59:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.609 13:59:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:26.609 00:25:26.609 real 0m12.259s 00:25:26.609 user 0m36.496s 00:25:26.609 sys 0m3.229s 00:25:26.609 13:59:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:26.609 13:59:06 -- common/autotest_common.sh@10 -- # set +x 00:25:26.609 ************************************ 00:25:26.609 END TEST nvmf_shutdown_tc1 00:25:26.609 ************************************ 00:25:26.609 13:59:06 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:26.609 13:59:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:26.609 13:59:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:26.609 13:59:06 -- common/autotest_common.sh@10 -- # set +x 00:25:26.609 ************************************ 00:25:26.609 START TEST nvmf_shutdown_tc2 00:25:26.609 ************************************ 00:25:26.609 13:59:06 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:26.609 13:59:06 -- target/shutdown.sh@98 -- # starttarget 00:25:26.609 13:59:06 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:26.609 13:59:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:26.609 13:59:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:26.609 13:59:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:26.609 13:59:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:26.609 13:59:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:26.609 13:59:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.609 13:59:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.609 13:59:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.609 13:59:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:26.609 13:59:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:26.609 13:59:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:26.609 13:59:06 -- common/autotest_common.sh@10 -- # set +x 00:25:26.609 13:59:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:26.609 13:59:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:26.609 13:59:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:26.609 13:59:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:26.609 13:59:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:26.609 13:59:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:26.609 13:59:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:26.609 13:59:06 -- nvmf/common.sh@294 -- # net_devs=() 00:25:26.609 13:59:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:26.609 13:59:06 -- nvmf/common.sh@295 -- # e810=() 00:25:26.609 13:59:06 -- nvmf/common.sh@295 -- # local -ga e810 00:25:26.609 13:59:06 -- nvmf/common.sh@296 -- # x722=() 00:25:26.609 13:59:06 -- nvmf/common.sh@296 -- # local -ga x722 00:25:26.609 13:59:06 -- nvmf/common.sh@297 -- # mlx=() 00:25:26.609 13:59:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:26.609 13:59:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:26.610 13:59:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:26.610 13:59:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:26.610 13:59:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:26.610 13:59:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:26.610 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:26.610 13:59:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:26.610 13:59:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:26.610 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:26.610 13:59:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:26.610 13:59:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.610 13:59:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.610 13:59:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:26.610 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:26.610 13:59:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.610 13:59:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:26.610 13:59:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.610 13:59:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.610 13:59:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:26.610 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:26.610 13:59:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.610 13:59:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:26.610 13:59:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:26.610 13:59:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:26.610 13:59:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:26.610 13:59:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:26.610 13:59:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:26.610 13:59:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:26.610 13:59:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:26.610 13:59:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:26.610 13:59:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:26.610 13:59:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:26.610 13:59:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:26.610 13:59:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:26.610 13:59:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:26.610 13:59:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:26.610 13:59:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:26.868 13:59:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:26.868 13:59:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:26.868 13:59:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:26.868 13:59:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:26.868 13:59:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:26.868 13:59:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:26.868 13:59:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:26.868 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:26.868 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:25:26.868 00:25:26.868 --- 10.0.0.2 ping statistics --- 00:25:26.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:26.868 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:25:26.868 13:59:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:26.868 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:26.868 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:25:26.868 00:25:26.868 --- 10.0.0.1 ping statistics --- 00:25:26.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:26.868 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:25:26.868 13:59:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:26.868 13:59:06 -- nvmf/common.sh@410 -- # return 0 00:25:26.868 13:59:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:26.868 13:59:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:26.868 13:59:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:26.868 13:59:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:26.868 13:59:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:26.868 13:59:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:26.868 13:59:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:26.868 13:59:07 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:26.868 13:59:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:26.868 13:59:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:26.868 13:59:07 -- common/autotest_common.sh@10 -- # set +x 00:25:26.868 13:59:07 -- nvmf/common.sh@469 -- # nvmfpid=2375826 00:25:26.868 13:59:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:26.868 13:59:07 -- nvmf/common.sh@470 -- # waitforlisten 2375826 00:25:26.868 13:59:07 -- common/autotest_common.sh@829 -- # '[' -z 2375826 ']' 00:25:26.868 13:59:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:26.868 13:59:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.868 13:59:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:26.868 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:26.868 13:59:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.868 13:59:07 -- common/autotest_common.sh@10 -- # set +x 00:25:26.868 [2024-11-29 13:59:07.055650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:26.868 [2024-11-29 13:59:07.055730] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:26.868 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.868 [2024-11-29 13:59:07.119322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:27.125 [2024-11-29 13:59:07.203911] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:27.125 [2024-11-29 13:59:07.204068] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:27.125 [2024-11-29 13:59:07.204085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:27.125 [2024-11-29 13:59:07.204097] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:27.125 [2024-11-29 13:59:07.204153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:27.125 [2024-11-29 13:59:07.204282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:27.125 [2024-11-29 13:59:07.204349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:27.125 [2024-11-29 13:59:07.204351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:28.055 13:59:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.055 13:59:08 -- common/autotest_common.sh@862 -- # return 0 00:25:28.055 13:59:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:28.055 13:59:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:28.055 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.055 13:59:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:28.055 13:59:08 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:28.055 13:59:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.056 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.056 [2024-11-29 13:59:08.096239] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:28.056 13:59:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.056 13:59:08 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:28.056 13:59:08 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:28.056 13:59:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:28.056 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.056 13:59:08 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.056 13:59:08 -- target/shutdown.sh@28 -- # cat 00:25:28.056 13:59:08 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:28.056 13:59:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.056 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.056 Malloc1 00:25:28.056 [2024-11-29 13:59:08.189582] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.056 Malloc2 00:25:28.056 Malloc3 00:25:28.056 Malloc4 00:25:28.313 Malloc5 00:25:28.313 Malloc6 00:25:28.313 Malloc7 00:25:28.313 Malloc8 00:25:28.313 Malloc9 00:25:28.571 Malloc10 00:25:28.571 13:59:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.571 13:59:08 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:28.571 13:59:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:28.571 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.571 13:59:08 -- target/shutdown.sh@102 -- # perfpid=2376133 00:25:28.571 13:59:08 -- target/shutdown.sh@103 -- # waitforlisten 2376133 /var/tmp/bdevperf.sock 00:25:28.571 13:59:08 -- common/autotest_common.sh@829 -- # '[' -z 2376133 ']' 00:25:28.571 13:59:08 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:28.571 13:59:08 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:28.571 13:59:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:28.571 13:59:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:28.571 13:59:08 -- nvmf/common.sh@520 -- # config=() 00:25:28.571 13:59:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:28.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:28.571 13:59:08 -- nvmf/common.sh@520 -- # local subsystem config 00:25:28.571 13:59:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:28.571 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.571 13:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.571 { 00:25:28.571 "params": { 00:25:28.571 "name": "Nvme$subsystem", 00:25:28.571 "trtype": "$TEST_TRANSPORT", 00:25:28.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.571 "adrfam": "ipv4", 00:25:28.571 "trsvcid": "$NVMF_PORT", 00:25:28.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.571 "hdgst": ${hdgst:-false}, 00:25:28.571 "ddgst": ${ddgst:-false} 00:25:28.571 }, 00:25:28.571 "method": "bdev_nvme_attach_controller" 00:25:28.571 } 00:25:28.571 EOF 00:25:28.571 )") 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.571 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.571 { 00:25:28.571 "params": { 00:25:28.571 "name": "Nvme$subsystem", 00:25:28.571 "trtype": "$TEST_TRANSPORT", 00:25:28.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.571 "adrfam": "ipv4", 00:25:28.571 "trsvcid": "$NVMF_PORT", 00:25:28.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.571 "hdgst": ${hdgst:-false}, 00:25:28.571 "ddgst": ${ddgst:-false} 00:25:28.571 }, 00:25:28.571 "method": "bdev_nvme_attach_controller" 00:25:28.571 } 00:25:28.571 EOF 00:25:28.571 )") 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.571 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.571 { 00:25:28.571 "params": { 00:25:28.571 "name": "Nvme$subsystem", 00:25:28.571 "trtype": "$TEST_TRANSPORT", 00:25:28.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.571 "adrfam": "ipv4", 00:25:28.571 "trsvcid": "$NVMF_PORT", 00:25:28.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.571 "hdgst": ${hdgst:-false}, 00:25:28.571 "ddgst": ${ddgst:-false} 00:25:28.571 }, 00:25:28.571 "method": "bdev_nvme_attach_controller" 00:25:28.571 } 00:25:28.571 EOF 00:25:28.571 )") 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.571 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.571 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:28.572 { 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme$subsystem", 00:25:28.572 "trtype": "$TEST_TRANSPORT", 00:25:28.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "$NVMF_PORT", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:28.572 "hdgst": ${hdgst:-false}, 00:25:28.572 "ddgst": ${ddgst:-false} 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 } 00:25:28.572 EOF 00:25:28.572 )") 00:25:28.572 13:59:08 -- nvmf/common.sh@542 -- # cat 00:25:28.572 13:59:08 -- nvmf/common.sh@544 -- # jq . 00:25:28.572 13:59:08 -- nvmf/common.sh@545 -- # IFS=, 00:25:28.572 13:59:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme1", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme2", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme3", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme4", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme5", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme6", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme7", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme8", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:28.572 "hdgst": false, 00:25:28.572 "ddgst": false 00:25:28.572 }, 00:25:28.572 "method": "bdev_nvme_attach_controller" 00:25:28.572 },{ 00:25:28.572 "params": { 00:25:28.572 "name": "Nvme9", 00:25:28.572 "trtype": "tcp", 00:25:28.572 "traddr": "10.0.0.2", 00:25:28.572 "adrfam": "ipv4", 00:25:28.572 "trsvcid": "4420", 00:25:28.572 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:28.572 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:28.572 "hdgst": false, 00:25:28.573 "ddgst": false 00:25:28.573 }, 00:25:28.573 "method": "bdev_nvme_attach_controller" 00:25:28.573 },{ 00:25:28.573 "params": { 00:25:28.573 "name": "Nvme10", 00:25:28.573 "trtype": "tcp", 00:25:28.573 "traddr": "10.0.0.2", 00:25:28.573 "adrfam": "ipv4", 00:25:28.573 "trsvcid": "4420", 00:25:28.573 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:28.573 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:28.573 "hdgst": false, 00:25:28.573 "ddgst": false 00:25:28.573 }, 00:25:28.573 "method": "bdev_nvme_attach_controller" 00:25:28.573 }' 00:25:28.573 [2024-11-29 13:59:08.693556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:28.573 [2024-11-29 13:59:08.693633] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2376133 ] 00:25:28.573 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.573 [2024-11-29 13:59:08.760016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:28.573 [2024-11-29 13:59:08.845809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:30.471 Running I/O for 10 seconds... 00:25:30.471 13:59:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:30.471 13:59:10 -- common/autotest_common.sh@862 -- # return 0 00:25:30.471 13:59:10 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:30.471 13:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.471 13:59:10 -- common/autotest_common.sh@10 -- # set +x 00:25:30.471 13:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.471 13:59:10 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:30.471 13:59:10 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:30.471 13:59:10 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:30.471 13:59:10 -- target/shutdown.sh@57 -- # local ret=1 00:25:30.471 13:59:10 -- target/shutdown.sh@58 -- # local i 00:25:30.471 13:59:10 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:30.471 13:59:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:30.471 13:59:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:30.471 13:59:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:30.471 13:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.471 13:59:10 -- common/autotest_common.sh@10 -- # set +x 00:25:30.471 13:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.471 13:59:10 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:30.471 13:59:10 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:30.471 13:59:10 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:30.729 13:59:10 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:30.729 13:59:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:30.729 13:59:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:30.729 13:59:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:30.729 13:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.729 13:59:10 -- common/autotest_common.sh@10 -- # set +x 00:25:30.729 13:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:30.729 13:59:10 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:30.729 13:59:10 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:30.729 13:59:10 -- target/shutdown.sh@64 -- # ret=0 00:25:30.729 13:59:10 -- target/shutdown.sh@65 -- # break 00:25:30.729 13:59:10 -- target/shutdown.sh@69 -- # return 0 00:25:30.729 13:59:10 -- target/shutdown.sh@109 -- # killprocess 2376133 00:25:30.729 13:59:10 -- common/autotest_common.sh@936 -- # '[' -z 2376133 ']' 00:25:30.729 13:59:10 -- common/autotest_common.sh@940 -- # kill -0 2376133 00:25:30.729 13:59:10 -- common/autotest_common.sh@941 -- # uname 00:25:30.729 13:59:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:30.729 13:59:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2376133 00:25:30.729 13:59:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:30.729 13:59:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:30.729 13:59:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2376133' 00:25:30.729 killing process with pid 2376133 00:25:30.729 13:59:10 -- common/autotest_common.sh@955 -- # kill 2376133 00:25:30.729 13:59:10 -- common/autotest_common.sh@960 -- # wait 2376133 00:25:30.729 Received shutdown signal, test time was about 0.589478 seconds 00:25:30.729 00:25:30.729 Latency(us) 00:25:30.729 [2024-11-29T12:59:11.011Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme1n1 : 0.57 400.04 25.00 0.00 0.00 153658.29 26214.40 120392.06 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme2n1 : 0.58 392.70 24.54 0.00 0.00 154404.35 26796.94 160781.65 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme3n1 : 0.57 399.03 24.94 0.00 0.00 149806.18 25243.50 119615.34 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme4n1 : 0.57 401.59 25.10 0.00 0.00 147542.02 20583.16 145247.19 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme5n1 : 0.57 396.83 24.80 0.00 0.00 146383.32 26796.94 114955.00 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme6n1 : 0.58 395.93 24.75 0.00 0.00 145186.73 24175.50 114178.28 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme7n1 : 0.58 395.02 24.69 0.00 0.00 142722.84 27962.03 112624.83 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.729 Nvme8n1 : 0.58 390.72 24.42 0.00 0.00 142483.53 27379.48 123498.95 00:25:30.729 [2024-11-29T12:59:11.011Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.729 Verification LBA range: start 0x0 length 0x400 00:25:30.730 Nvme9n1 : 0.59 389.59 24.35 0.00 0.00 141129.16 24758.04 126605.84 00:25:30.730 [2024-11-29T12:59:11.012Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.730 Verification LBA range: start 0x0 length 0x400 00:25:30.730 Nvme10n1 : 0.59 387.31 24.21 0.00 0.00 143292.82 9175.04 127382.57 00:25:30.730 [2024-11-29T12:59:11.012Z] =================================================================================================================== 00:25:30.730 [2024-11-29T12:59:11.012Z] Total : 3948.76 246.80 0.00 0.00 146660.92 9175.04 160781.65 00:25:30.989 13:59:11 -- target/shutdown.sh@112 -- # sleep 1 00:25:31.949 13:59:12 -- target/shutdown.sh@113 -- # kill -0 2375826 00:25:31.949 13:59:12 -- target/shutdown.sh@115 -- # stoptarget 00:25:31.949 13:59:12 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:31.949 13:59:12 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:31.949 13:59:12 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:31.949 13:59:12 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:31.949 13:59:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:31.949 13:59:12 -- nvmf/common.sh@116 -- # sync 00:25:31.949 13:59:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:31.949 13:59:12 -- nvmf/common.sh@119 -- # set +e 00:25:31.949 13:59:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:31.949 13:59:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:31.949 rmmod nvme_tcp 00:25:31.949 rmmod nvme_fabrics 00:25:31.949 rmmod nvme_keyring 00:25:32.208 13:59:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:32.208 13:59:12 -- nvmf/common.sh@123 -- # set -e 00:25:32.208 13:59:12 -- nvmf/common.sh@124 -- # return 0 00:25:32.208 13:59:12 -- nvmf/common.sh@477 -- # '[' -n 2375826 ']' 00:25:32.208 13:59:12 -- nvmf/common.sh@478 -- # killprocess 2375826 00:25:32.208 13:59:12 -- common/autotest_common.sh@936 -- # '[' -z 2375826 ']' 00:25:32.208 13:59:12 -- common/autotest_common.sh@940 -- # kill -0 2375826 00:25:32.208 13:59:12 -- common/autotest_common.sh@941 -- # uname 00:25:32.208 13:59:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:32.208 13:59:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2375826 00:25:32.208 13:59:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:32.208 13:59:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:32.208 13:59:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2375826' 00:25:32.208 killing process with pid 2375826 00:25:32.208 13:59:12 -- common/autotest_common.sh@955 -- # kill 2375826 00:25:32.208 13:59:12 -- common/autotest_common.sh@960 -- # wait 2375826 00:25:32.774 13:59:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:32.774 13:59:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:32.774 13:59:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:32.774 13:59:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:32.774 13:59:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:32.774 13:59:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.774 13:59:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.774 13:59:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.676 13:59:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:34.676 00:25:34.676 real 0m7.952s 00:25:34.676 user 0m24.690s 00:25:34.676 sys 0m1.405s 00:25:34.676 13:59:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:34.676 13:59:14 -- common/autotest_common.sh@10 -- # set +x 00:25:34.676 ************************************ 00:25:34.676 END TEST nvmf_shutdown_tc2 00:25:34.676 ************************************ 00:25:34.676 13:59:14 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:34.676 13:59:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:34.676 13:59:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:34.676 13:59:14 -- common/autotest_common.sh@10 -- # set +x 00:25:34.676 ************************************ 00:25:34.676 START TEST nvmf_shutdown_tc3 00:25:34.676 ************************************ 00:25:34.676 13:59:14 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:34.676 13:59:14 -- target/shutdown.sh@120 -- # starttarget 00:25:34.676 13:59:14 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:34.676 13:59:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:34.676 13:59:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:34.676 13:59:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:34.676 13:59:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:34.676 13:59:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:34.676 13:59:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.676 13:59:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.676 13:59:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.676 13:59:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:34.676 13:59:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:34.676 13:59:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:34.676 13:59:14 -- common/autotest_common.sh@10 -- # set +x 00:25:34.676 13:59:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:34.676 13:59:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:34.676 13:59:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:34.676 13:59:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:34.676 13:59:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:34.676 13:59:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:34.676 13:59:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:34.676 13:59:14 -- nvmf/common.sh@294 -- # net_devs=() 00:25:34.676 13:59:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:34.676 13:59:14 -- nvmf/common.sh@295 -- # e810=() 00:25:34.676 13:59:14 -- nvmf/common.sh@295 -- # local -ga e810 00:25:34.676 13:59:14 -- nvmf/common.sh@296 -- # x722=() 00:25:34.676 13:59:14 -- nvmf/common.sh@296 -- # local -ga x722 00:25:34.676 13:59:14 -- nvmf/common.sh@297 -- # mlx=() 00:25:34.677 13:59:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:34.677 13:59:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:34.677 13:59:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:34.677 13:59:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:34.677 13:59:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.677 13:59:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:34.677 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:34.677 13:59:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.677 13:59:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:34.677 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:34.677 13:59:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.677 13:59:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.677 13:59:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.677 13:59:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:34.677 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:34.677 13:59:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.677 13:59:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.677 13:59:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.677 13:59:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.677 13:59:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:34.677 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:34.677 13:59:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.677 13:59:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:34.677 13:59:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:34.677 13:59:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:34.677 13:59:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:34.677 13:59:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:34.677 13:59:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:34.677 13:59:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:34.677 13:59:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:34.677 13:59:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:34.677 13:59:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:34.677 13:59:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:34.677 13:59:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:34.677 13:59:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:34.677 13:59:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:34.677 13:59:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:34.677 13:59:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:34.677 13:59:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:34.677 13:59:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:34.677 13:59:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:34.677 13:59:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:34.677 13:59:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:34.677 13:59:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:34.936 13:59:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:34.936 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:34.936 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:25:34.936 00:25:34.936 --- 10.0.0.2 ping statistics --- 00:25:34.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.936 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:25:34.936 13:59:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:34.936 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:34.936 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:25:34.936 00:25:34.936 --- 10.0.0.1 ping statistics --- 00:25:34.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.936 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:25:34.936 13:59:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:34.936 13:59:14 -- nvmf/common.sh@410 -- # return 0 00:25:34.936 13:59:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:34.936 13:59:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:34.936 13:59:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:34.936 13:59:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:34.936 13:59:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:34.936 13:59:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:34.936 13:59:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:34.936 13:59:14 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:34.936 13:59:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:34.936 13:59:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:34.936 13:59:14 -- common/autotest_common.sh@10 -- # set +x 00:25:34.936 13:59:14 -- nvmf/common.sh@469 -- # nvmfpid=2376941 00:25:34.936 13:59:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:34.936 13:59:14 -- nvmf/common.sh@470 -- # waitforlisten 2376941 00:25:34.936 13:59:14 -- common/autotest_common.sh@829 -- # '[' -z 2376941 ']' 00:25:34.936 13:59:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:34.936 13:59:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.936 13:59:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:34.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:34.936 13:59:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.936 13:59:14 -- common/autotest_common.sh@10 -- # set +x 00:25:34.936 [2024-11-29 13:59:15.045605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:34.936 [2024-11-29 13:59:15.045693] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:34.936 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.936 [2024-11-29 13:59:15.118912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:34.936 [2024-11-29 13:59:15.208276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:34.936 [2024-11-29 13:59:15.208432] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.936 [2024-11-29 13:59:15.208450] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.936 [2024-11-29 13:59:15.208463] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.936 [2024-11-29 13:59:15.208520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:34.936 [2024-11-29 13:59:15.208611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:34.936 [2024-11-29 13:59:15.208613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:34.936 [2024-11-29 13:59:15.208582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:35.868 13:59:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:35.868 13:59:15 -- common/autotest_common.sh@862 -- # return 0 00:25:35.868 13:59:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:35.868 13:59:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.868 13:59:15 -- common/autotest_common.sh@10 -- # set +x 00:25:35.868 13:59:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:35.868 13:59:16 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:35.868 13:59:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.868 13:59:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.868 [2024-11-29 13:59:16.023983] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:35.868 13:59:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.868 13:59:16 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:35.868 13:59:16 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:35.868 13:59:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:35.868 13:59:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.868 13:59:16 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.868 13:59:16 -- target/shutdown.sh@28 -- # cat 00:25:35.868 13:59:16 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:35.868 13:59:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.868 13:59:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.868 Malloc1 00:25:35.868 [2024-11-29 13:59:16.099231] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:35.868 Malloc2 00:25:36.135 Malloc3 00:25:36.135 Malloc4 00:25:36.135 Malloc5 00:25:36.135 Malloc6 00:25:36.135 Malloc7 00:25:36.394 Malloc8 00:25:36.394 Malloc9 00:25:36.394 Malloc10 00:25:36.394 13:59:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:36.394 13:59:16 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:36.394 13:59:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:36.394 13:59:16 -- common/autotest_common.sh@10 -- # set +x 00:25:36.394 13:59:16 -- target/shutdown.sh@124 -- # perfpid=2377255 00:25:36.394 13:59:16 -- target/shutdown.sh@125 -- # waitforlisten 2377255 /var/tmp/bdevperf.sock 00:25:36.394 13:59:16 -- common/autotest_common.sh@829 -- # '[' -z 2377255 ']' 00:25:36.394 13:59:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:36.394 13:59:16 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:36.394 13:59:16 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:36.394 13:59:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:36.394 13:59:16 -- nvmf/common.sh@520 -- # config=() 00:25:36.394 13:59:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:36.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:36.394 13:59:16 -- nvmf/common.sh@520 -- # local subsystem config 00:25:36.394 13:59:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:36.394 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.394 13:59:16 -- common/autotest_common.sh@10 -- # set +x 00:25:36.394 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.394 { 00:25:36.394 "params": { 00:25:36.394 "name": "Nvme$subsystem", 00:25:36.394 "trtype": "$TEST_TRANSPORT", 00:25:36.394 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.394 "adrfam": "ipv4", 00:25:36.394 "trsvcid": "$NVMF_PORT", 00:25:36.394 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.394 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.394 "hdgst": ${hdgst:-false}, 00:25:36.394 "ddgst": ${ddgst:-false} 00:25:36.394 }, 00:25:36.394 "method": "bdev_nvme_attach_controller" 00:25:36.394 } 00:25:36.394 EOF 00:25:36.394 )") 00:25:36.394 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.394 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.394 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.394 { 00:25:36.394 "params": { 00:25:36.394 "name": "Nvme$subsystem", 00:25:36.394 "trtype": "$TEST_TRANSPORT", 00:25:36.394 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.394 "adrfam": "ipv4", 00:25:36.394 "trsvcid": "$NVMF_PORT", 00:25:36.394 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.394 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.394 "hdgst": ${hdgst:-false}, 00:25:36.394 "ddgst": ${ddgst:-false} 00:25:36.394 }, 00:25:36.394 "method": "bdev_nvme_attach_controller" 00:25:36.394 } 00:25:36.394 EOF 00:25:36.394 )") 00:25:36.394 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.394 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.394 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.394 { 00:25:36.394 "params": { 00:25:36.394 "name": "Nvme$subsystem", 00:25:36.394 "trtype": "$TEST_TRANSPORT", 00:25:36.394 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.394 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:36.395 { 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme$subsystem", 00:25:36.395 "trtype": "$TEST_TRANSPORT", 00:25:36.395 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "$NVMF_PORT", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:36.395 "hdgst": ${hdgst:-false}, 00:25:36.395 "ddgst": ${ddgst:-false} 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 } 00:25:36.395 EOF 00:25:36.395 )") 00:25:36.395 13:59:16 -- nvmf/common.sh@542 -- # cat 00:25:36.395 13:59:16 -- nvmf/common.sh@544 -- # jq . 00:25:36.395 13:59:16 -- nvmf/common.sh@545 -- # IFS=, 00:25:36.395 13:59:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme1", 00:25:36.395 "trtype": "tcp", 00:25:36.395 "traddr": "10.0.0.2", 00:25:36.395 "adrfam": "ipv4", 00:25:36.395 "trsvcid": "4420", 00:25:36.395 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:36.395 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:36.395 "hdgst": false, 00:25:36.395 "ddgst": false 00:25:36.395 }, 00:25:36.395 "method": "bdev_nvme_attach_controller" 00:25:36.395 },{ 00:25:36.395 "params": { 00:25:36.395 "name": "Nvme2", 00:25:36.395 "trtype": "tcp", 00:25:36.395 "traddr": "10.0.0.2", 00:25:36.395 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme3", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme4", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme5", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme6", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme7", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme8", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme9", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 },{ 00:25:36.396 "params": { 00:25:36.396 "name": "Nvme10", 00:25:36.396 "trtype": "tcp", 00:25:36.396 "traddr": "10.0.0.2", 00:25:36.396 "adrfam": "ipv4", 00:25:36.396 "trsvcid": "4420", 00:25:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:36.396 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:36.396 "hdgst": false, 00:25:36.396 "ddgst": false 00:25:36.396 }, 00:25:36.396 "method": "bdev_nvme_attach_controller" 00:25:36.396 }' 00:25:36.396 [2024-11-29 13:59:16.619284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:36.396 [2024-11-29 13:59:16.619358] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2377255 ] 00:25:36.396 EAL: No free 2048 kB hugepages reported on node 1 00:25:36.655 [2024-11-29 13:59:16.683456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:36.655 [2024-11-29 13:59:16.768114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:38.590 Running I/O for 10 seconds... 00:25:38.849 13:59:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:38.849 13:59:19 -- common/autotest_common.sh@862 -- # return 0 00:25:38.849 13:59:19 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:38.849 13:59:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.849 13:59:19 -- common/autotest_common.sh@10 -- # set +x 00:25:38.849 13:59:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.849 13:59:19 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.849 13:59:19 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:38.849 13:59:19 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:38.849 13:59:19 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:38.849 13:59:19 -- target/shutdown.sh@57 -- # local ret=1 00:25:38.849 13:59:19 -- target/shutdown.sh@58 -- # local i 00:25:38.849 13:59:19 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:38.849 13:59:19 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:38.849 13:59:19 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:38.849 13:59:19 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:38.849 13:59:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.849 13:59:19 -- common/autotest_common.sh@10 -- # set +x 00:25:39.123 13:59:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.123 13:59:19 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:39.123 13:59:19 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:39.123 13:59:19 -- target/shutdown.sh@64 -- # ret=0 00:25:39.123 13:59:19 -- target/shutdown.sh@65 -- # break 00:25:39.123 13:59:19 -- target/shutdown.sh@69 -- # return 0 00:25:39.123 13:59:19 -- target/shutdown.sh@134 -- # killprocess 2376941 00:25:39.123 13:59:19 -- common/autotest_common.sh@936 -- # '[' -z 2376941 ']' 00:25:39.123 13:59:19 -- common/autotest_common.sh@940 -- # kill -0 2376941 00:25:39.123 13:59:19 -- common/autotest_common.sh@941 -- # uname 00:25:39.123 13:59:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:39.123 13:59:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2376941 00:25:39.123 13:59:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:39.123 13:59:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:39.123 13:59:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2376941' 00:25:39.123 killing process with pid 2376941 00:25:39.123 13:59:19 -- common/autotest_common.sh@955 -- # kill 2376941 00:25:39.123 13:59:19 -- common/autotest_common.sh@960 -- # wait 2376941 00:25:39.123 [2024-11-29 13:59:19.189470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.189999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.123 [2024-11-29 13:59:19.190290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.190920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4be90 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.193990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.194194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e750 is same with the state(5) to be set 00:25:39.124 [2024-11-29 13:59:19.195596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.124 [2024-11-29 13:59:19.195640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.124 [2024-11-29 13:59:19.195669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.124 [2024-11-29 13:59:19.195693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.124 [2024-11-29 13:59:19.195709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.124 [2024-11-29 13:59:19.195725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.124 [2024-11-29 13:59:19.195740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.124 [2024-11-29 13:59:19.195753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.124 [2024-11-29 13:59:19.195773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.195915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.195929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.195961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.195965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.195974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.195977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.195988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.195988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:12he state(5) to be set 00:25:39.125 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.196091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 he state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25984 len:12he state(5) to be set 00:25:39.125 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.196344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 he state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:39.125 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.125 [2024-11-29 13:59:19.196419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.125 [2024-11-29 13:59:19.196428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.125 [2024-11-29 13:59:19.196432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:12he state(5) to be set 00:25:39.126 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:39.126 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:12he state(5) to be set 00:25:39.126 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.196638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 he state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with the state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:12[2024-11-29 13:59:19.196741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 he state(5) to be set 00:25:39.126 [2024-11-29 13:59:19.196753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c340 is same with t[2024-11-29 13:59:19.196753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:39.126 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.196983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.196997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.126 [2024-11-29 13:59:19.197248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.126 [2024-11-29 13:59:19.197261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.197586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.127 [2024-11-29 13:59:19.197601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198150] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1602f70 was disconnected and freed. reset controller. 00:25:39.127 [2024-11-29 13:59:19.198245] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198283] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1750c50 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198448] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198486] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198542] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x158b6b0 is same [2024-11-29 13:59:19.198575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with twith the state(5) to be set 00:25:39.127 he state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with t[2024-11-29 13:59:19.198620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nshe state(5) to be set 00:25:39.127 id:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with t[2024-11-29 13:59:19.198692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nshe state(5) to be set 00:25:39.127 id:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.127 [2024-11-29 13:59:19.198729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.127 [2024-11-29 13:59:19.198741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.127 [2024-11-29 13:59:19.198755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with t[2024-11-29 13:59:19.198755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1752100 is same he state(5) to be set 00:25:39.128 with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198823] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-29 13:59:19.198830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:39.128 he state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.128 [2024-11-29 13:59:19.198855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.128 [2024-11-29 13:59:19.198867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.128 [2024-11-29 13:59:19.198879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.128 [2024-11-29 13:59:19.198892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.128 [2024-11-29 13:59:19.198904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.128 [2024-11-29 13:59:19.198917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.128 [2024-11-29 13:59:19.198929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1598d30 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.198984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.199265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4c7f0 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.200635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:39.128 [2024-11-29 13:59:19.200686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1750c50 (9): Bad file descriptor 00:25:39.128 [2024-11-29 13:59:19.200770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4cc80 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.200801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4cc80 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.128 [2024-11-29 13:59:19.201892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.201912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.201930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.201952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.201984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d130 is same with the state(5) to be set 00:25:39.129 [2024-11-29 13:59:19.202987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.129 [2024-11-29 13:59:19.203624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.129 [2024-11-29 13:59:19.203641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.203980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.203975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.203993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t[2024-11-29 13:59:19.204008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30976 len:12he state(5) to be set 00:25:39.130 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31232 len:12[2024-11-29 13:59:19.204070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 he state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.204083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 he state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:31872 len:1[2024-11-29 13:59:19.204218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 he state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.204231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 he state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t[2024-11-29 13:59:19.204344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:39.130 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.130 [2024-11-29 13:59:19.204386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.130 [2024-11-29 13:59:19.204391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.130 [2024-11-29 13:59:19.204407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:1[2024-11-29 13:59:19.204421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 he state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t[2024-11-29 13:59:19.204435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:39.131 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:1[2024-11-29 13:59:19.204599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 he state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.204614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 he state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t[2024-11-29 13:59:19.204664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33664 len:1he state(5) to be set 00:25:39.131 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:1[2024-11-29 13:59:19.204736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 he state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-29 13:59:19.204765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 he state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d5e0 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.204843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.204937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.204950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15fd010 is same with the state(5) to be set 00:25:39.131 [2024-11-29 13:59:19.205019] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15fd010 was disconnected and freed. reset controller. 00:25:39.131 [2024-11-29 13:59:19.205234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.131 [2024-11-29 13:59:19.205447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.131 [2024-11-29 13:59:19.205461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.132 [2024-11-29 13:59:19.205833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.132 [2024-11-29 13:59:19.205847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x170ad30 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.205917] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x170ad30 was disconnected and freed. reset controller. 00:25:39.132 [2024-11-29 13:59:19.206212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.132 [2024-11-29 13:59:19.206799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.206996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.207007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.207018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.207029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4da90 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.207445] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.133 [2024-11-29 13:59:19.207975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ddf0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:39.133 [2024-11-29 13:59:19.208776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:39.133 [2024-11-29 13:59:19.208797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.208843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ada30 (9): Bad file descriptor 00:25:39.133 [2024-11-29 13:59:19.208869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x158b6b0 (9): Bad file descriptor 00:25:39.133 [2024-11-29 13:59:19.208917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.208942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.208974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.208990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e0070 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.209102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1752100 (9): Bad file descriptor 00:25:39.133 [2024-11-29 13:59:19.209152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209213] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172cc80 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.209305] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209340] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1741700 is same with the state(5) to be set 00:25:39.133 [2024-11-29 13:59:19.209467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1598d30 (9): Bad file descriptor 00:25:39.133 [2024-11-29 13:59:19.209513] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209547] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.133 [2024-11-29 13:59:19.209559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.133 [2024-11-29 13:59:19.209573] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.134 [2024-11-29 13:59:19.209586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.209599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.134 [2024-11-29 13:59:19.209612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.209624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173c660 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.209737] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.134 [2024-11-29 13:59:19.211992] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.134 [2024-11-29 13:59:19.212063] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.134 [2024-11-29 13:59:19.212161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.212977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.212990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.213004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.213017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.213031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.213043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.134 [2024-11-29 13:59:19.213057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.134 [2024-11-29 13:59:19.221129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.134 [2024-11-29 13:59:19.221402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.221997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.222200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4e2a0 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.226410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.226464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.226492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226585] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16003b0 was disconnected and freed. reset controller. 00:25:39.135 [2024-11-29 13:59:19.226778] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:39.135 [2024-11-29 13:59:19.226803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1750c50 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.226854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e0070 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.226900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.135 [2024-11-29 13:59:19.226921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.135 [2024-11-29 13:59:19.226948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.135 [2024-11-29 13:59:19.226974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.226987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.135 [2024-11-29 13:59:19.227000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.227012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e2650 is same with the state(5) to be set 00:25:39.135 [2024-11-29 13:59:19.227046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x172cc80 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1741700 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x173c660 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ada30 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x158b6b0 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1750c50 (9): Bad file descriptor 00:25:39.135 [2024-11-29 13:59:19.227323] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.135 [2024-11-29 13:59:19.228422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:39.135 [2024-11-29 13:59:19.228505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.135 [2024-11-29 13:59:19.228775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.135 [2024-11-29 13:59:19.228790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.228978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.228994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.136 [2024-11-29 13:59:19.229805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.136 [2024-11-29 13:59:19.229818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.229973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.229986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.230361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.230376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1708950 is same with the state(5) to be set 00:25:39.137 [2024-11-29 13:59:19.231596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.231979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.231991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.137 [2024-11-29 13:59:19.232183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.137 [2024-11-29 13:59:19.232196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.232973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.232986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.138 [2024-11-29 13:59:19.233359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.138 [2024-11-29 13:59:19.233372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.233387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.233411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.233427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.233440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.233457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.233470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.233486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.233503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.233519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1709ef0 is same with the state(5) to be set 00:25:39.139 [2024-11-29 13:59:19.234892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:39.139 [2024-11-29 13:59:19.234925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:39.139 [2024-11-29 13:59:19.235104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.235219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.235245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15e0070 with addr=10.0.0.2, port=4420 00:25:39.139 [2024-11-29 13:59:19.235262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e0070 is same with the state(5) to be set 00:25:39.139 [2024-11-29 13:59:19.235279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.235292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.235309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:39.139 [2024-11-29 13:59:19.235332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.235346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.235359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:39.139 [2024-11-29 13:59:19.235385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.235407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.235421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:39.139 [2024-11-29 13:59:19.235840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.139 [2024-11-29 13:59:19.235864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.139 [2024-11-29 13:59:19.235878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.139 [2024-11-29 13:59:19.235983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.236116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.236141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1598d30 with addr=10.0.0.2, port=4420 00:25:39.139 [2024-11-29 13:59:19.236157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1598d30 is same with the state(5) to be set 00:25:39.139 [2024-11-29 13:59:19.236240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.236340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.139 [2024-11-29 13:59:19.236366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1752100 with addr=10.0.0.2, port=4420 00:25:39.139 [2024-11-29 13:59:19.236382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1752100 is same with the state(5) to be set 00:25:39.139 [2024-11-29 13:59:19.236413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e0070 (9): Bad file descriptor 00:25:39.139 [2024-11-29 13:59:19.236999] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:39.139 [2024-11-29 13:59:19.237037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1598d30 (9): Bad file descriptor 00:25:39.139 [2024-11-29 13:59:19.237067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1752100 (9): Bad file descriptor 00:25:39.139 [2024-11-29 13:59:19.237083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.237096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.237110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:39.139 [2024-11-29 13:59:19.237137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e2650 (9): Bad file descriptor 00:25:39.139 [2024-11-29 13:59:19.237279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.139 [2024-11-29 13:59:19.237332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.237349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.237362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:39.139 [2024-11-29 13:59:19.237380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:39.139 [2024-11-29 13:59:19.237401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:39.139 [2024-11-29 13:59:19.237416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:39.139 [2024-11-29 13:59:19.237494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.237985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.237999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.139 [2024-11-29 13:59:19.238014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.139 [2024-11-29 13:59:19.238027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.238973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.238988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.140 [2024-11-29 13:59:19.239185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.140 [2024-11-29 13:59:19.239202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.239219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.248912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.248927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x170c0e0 is same with the state(5) to be set 00:25:39.141 [2024-11-29 13:59:19.250228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.250973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.250988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.251001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.251017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.251030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.251045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.251059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.141 [2024-11-29 13:59:19.251074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.141 [2024-11-29 13:59:19.251087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.251974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.251989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.252003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.252017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.252031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.252045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.252058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.252073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.252086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.252101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.252114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.252128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15fd8a0 is same with the state(5) to be set 00:25:39.142 [2024-11-29 13:59:19.253335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.253358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.253378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.253400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.253418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.253432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.142 [2024-11-29 13:59:19.253447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.142 [2024-11-29 13:59:19.253465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.253985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.253999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.143 [2024-11-29 13:59:19.254610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.143 [2024-11-29 13:59:19.254622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.254979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.254992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.255198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.255212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15fedd0 is same with the state(5) to be set 00:25:39.144 [2024-11-29 13:59:19.256442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:39.144 [2024-11-29 13:59:19.256472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:39.144 [2024-11-29 13:59:19.256489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:39.144 [2024-11-29 13:59:19.256505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.144 [2024-11-29 13:59:19.256523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.144 [2024-11-29 13:59:19.256536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:39.144 [2024-11-29 13:59:19.256657] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.144 [2024-11-29 13:59:19.256684] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.144 [2024-11-29 13:59:19.256762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:39.144 [2024-11-29 13:59:19.256786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:39.144 [2024-11-29 13:59:19.257032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ada30 with addr=10.0.0.2, port=4420 00:25:39.144 [2024-11-29 13:59:19.257187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ada30 is same with the state(5) to be set 00:25:39.144 [2024-11-29 13:59:19.257280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x158b6b0 with addr=10.0.0.2, port=4420 00:25:39.144 [2024-11-29 13:59:19.257436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x158b6b0 is same with the state(5) to be set 00:25:39.144 [2024-11-29 13:59:19.257541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1750c50 with addr=10.0.0.2, port=4420 00:25:39.144 [2024-11-29 13:59:19.257682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1750c50 is same with the state(5) to be set 00:25:39.144 [2024-11-29 13:59:19.257767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.144 [2024-11-29 13:59:19.257926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x172cc80 with addr=10.0.0.2, port=4420 00:25:39.144 [2024-11-29 13:59:19.257941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172cc80 is same with the state(5) to be set 00:25:39.144 [2024-11-29 13:59:19.258772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.258984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.258999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.259012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.144 [2024-11-29 13:59:19.259027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.144 [2024-11-29 13:59:19.259040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.259983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.259996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.260011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.260028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.145 [2024-11-29 13:59:19.260044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.145 [2024-11-29 13:59:19.260057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.146 [2024-11-29 13:59:19.260678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.146 [2024-11-29 13:59:19.260692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1601990 is same with the state(5) to be set 00:25:39.146 [2024-11-29 13:59:19.262273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:39.146 [2024-11-29 13:59:19.262304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:39.146 [2024-11-29 13:59:19.262324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:39.146 task offset: 29184 on job bdev=Nvme10n1 fails 00:25:39.146 00:25:39.146 Latency(us) 00:25:39.146 [2024-11-29T12:59:19.428Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme1n1 ended in about 0.62 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme1n1 : 0.62 332.85 20.80 102.42 0.00 145882.56 86992.97 118061.89 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme2n1 ended in about 0.65 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme2n1 : 0.65 320.51 20.03 98.62 0.00 149744.76 95148.56 115731.72 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme3n1 ended in about 0.65 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme3n1 : 0.65 318.98 19.94 98.15 0.00 148633.93 96313.65 114955.00 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme4n1 ended in about 0.63 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme4n1 : 0.63 332.29 20.77 31.95 0.00 166831.28 5679.79 151460.98 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme5n1 ended in about 0.67 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme5n1 : 0.67 311.61 19.48 95.88 0.00 148675.34 90488.23 116508.44 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme6n1 ended in about 0.67 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme6n1 : 0.67 310.15 19.38 95.43 0.00 147638.04 91264.95 118061.89 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme7n1 ended in about 0.67 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme7n1 : 0.67 308.72 19.30 94.99 0.00 146604.32 91653.31 118838.61 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme8n1 ended in about 0.65 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme8n1 : 0.65 318.98 19.94 51.10 0.00 155334.64 14272.28 127382.57 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme9n1 ended in about 0.68 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme9n1 : 0.68 306.24 19.14 94.23 0.00 144509.02 86216.25 117285.17 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:39.146 [2024-11-29T12:59:19.428Z] Job: Nvme10n1 ended in about 0.62 seconds with error 00:25:39.146 Verification LBA range: start 0x0 length 0x400 00:25:39.146 Nvme10n1 : 0.62 336.48 21.03 103.53 0.00 128473.76 15243.19 117285.17 00:25:39.146 [2024-11-29T12:59:19.428Z] =================================================================================================================== 00:25:39.146 [2024-11-29T12:59:19.428Z] Total : 3196.82 199.80 866.30 0.00 147834.47 5679.79 151460.98 00:25:39.146 [2024-11-29 13:59:19.289058] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:39.146 [2024-11-29 13:59:19.289139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:39.146 [2024-11-29 13:59:19.289425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.146 [2024-11-29 13:59:19.289541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.146 [2024-11-29 13:59:19.289569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x173c660 with addr=10.0.0.2, port=4420 00:25:39.146 [2024-11-29 13:59:19.289589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173c660 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.289688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.289783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.289820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1741700 with addr=10.0.0.2, port=4420 00:25:39.147 [2024-11-29 13:59:19.289837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1741700 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.289863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ada30 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.289887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x158b6b0 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.289905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1750c50 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.289922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x172cc80 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.290186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15e0070 with addr=10.0.0.2, port=4420 00:25:39.147 [2024-11-29 13:59:19.290334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e0070 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.290426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1752100 with addr=10.0.0.2, port=4420 00:25:39.147 [2024-11-29 13:59:19.290571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1752100 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.290655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.290768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1598d30 with addr=10.0.0.2, port=4420 00:25:39.147 [2024-11-29 13:59:19.290784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1598d30 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.290905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.291002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:39.147 [2024-11-29 13:59:19.291026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15e2650 with addr=10.0.0.2, port=4420 00:25:39.147 [2024-11-29 13:59:19.291042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15e2650 is same with the state(5) to be set 00:25:39.147 [2024-11-29 13:59:19.291060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x173c660 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1741700 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291302] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291326] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291345] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291362] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291381] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291407] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:39.147 [2024-11-29 13:59:19.291746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.291768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.291780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.291791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.291807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e0070 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1752100 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1598d30 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15e2650 (9): Bad file descriptor 00:25:39.147 [2024-11-29 13:59:19.291874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.291928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.291940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:39.147 [2024-11-29 13:59:19.291991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.292010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.292022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.292034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.292047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:39.147 [2024-11-29 13:59:19.292068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.292082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.292094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:39.147 [2024-11-29 13:59:19.292111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.292124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.292136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:39.147 [2024-11-29 13:59:19.292151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:39.147 [2024-11-29 13:59:19.292163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:39.147 [2024-11-29 13:59:19.292175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:39.147 [2024-11-29 13:59:19.292221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.292240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.292251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.147 [2024-11-29 13:59:19.292261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.716 13:59:19 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:39.716 13:59:19 -- target/shutdown.sh@138 -- # sleep 1 00:25:40.654 13:59:20 -- target/shutdown.sh@141 -- # kill -9 2377255 00:25:40.654 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2377255) - No such process 00:25:40.654 13:59:20 -- target/shutdown.sh@141 -- # true 00:25:40.654 13:59:20 -- target/shutdown.sh@143 -- # stoptarget 00:25:40.654 13:59:20 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:40.654 13:59:20 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:40.654 13:59:20 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:40.654 13:59:20 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:40.654 13:59:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:40.654 13:59:20 -- nvmf/common.sh@116 -- # sync 00:25:40.654 13:59:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:40.654 13:59:20 -- nvmf/common.sh@119 -- # set +e 00:25:40.654 13:59:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:40.654 13:59:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:40.654 rmmod nvme_tcp 00:25:40.654 rmmod nvme_fabrics 00:25:40.654 rmmod nvme_keyring 00:25:40.654 13:59:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:40.654 13:59:20 -- nvmf/common.sh@123 -- # set -e 00:25:40.654 13:59:20 -- nvmf/common.sh@124 -- # return 0 00:25:40.654 13:59:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:40.654 13:59:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:40.654 13:59:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:40.654 13:59:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:40.654 13:59:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:40.654 13:59:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:40.654 13:59:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.654 13:59:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.654 13:59:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.557 13:59:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:42.557 00:25:42.557 real 0m8.017s 00:25:42.557 user 0m20.889s 00:25:42.557 sys 0m1.467s 00:25:42.557 13:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:42.557 13:59:22 -- common/autotest_common.sh@10 -- # set +x 00:25:42.557 ************************************ 00:25:42.557 END TEST nvmf_shutdown_tc3 00:25:42.557 ************************************ 00:25:42.816 13:59:22 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:42.816 00:25:42.816 real 0m28.457s 00:25:42.816 user 1m22.211s 00:25:42.816 sys 0m6.216s 00:25:42.816 13:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:42.816 13:59:22 -- common/autotest_common.sh@10 -- # set +x 00:25:42.816 ************************************ 00:25:42.816 END TEST nvmf_shutdown 00:25:42.816 ************************************ 00:25:42.816 13:59:22 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:42.816 13:59:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.816 13:59:22 -- common/autotest_common.sh@10 -- # set +x 00:25:42.816 13:59:22 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:42.816 13:59:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:42.816 13:59:22 -- common/autotest_common.sh@10 -- # set +x 00:25:42.816 13:59:22 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:42.816 13:59:22 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:42.816 13:59:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:42.816 13:59:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:42.816 13:59:22 -- common/autotest_common.sh@10 -- # set +x 00:25:42.816 ************************************ 00:25:42.816 START TEST nvmf_multicontroller 00:25:42.816 ************************************ 00:25:42.816 13:59:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:42.816 * Looking for test storage... 00:25:42.816 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:42.816 13:59:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:42.816 13:59:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:42.816 13:59:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:42.816 13:59:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:42.816 13:59:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:42.816 13:59:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:42.816 13:59:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:42.816 13:59:23 -- scripts/common.sh@335 -- # IFS=.-: 00:25:42.816 13:59:23 -- scripts/common.sh@335 -- # read -ra ver1 00:25:42.816 13:59:23 -- scripts/common.sh@336 -- # IFS=.-: 00:25:42.816 13:59:23 -- scripts/common.sh@336 -- # read -ra ver2 00:25:42.816 13:59:23 -- scripts/common.sh@337 -- # local 'op=<' 00:25:42.816 13:59:23 -- scripts/common.sh@339 -- # ver1_l=2 00:25:42.816 13:59:23 -- scripts/common.sh@340 -- # ver2_l=1 00:25:42.816 13:59:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:42.816 13:59:23 -- scripts/common.sh@343 -- # case "$op" in 00:25:42.816 13:59:23 -- scripts/common.sh@344 -- # : 1 00:25:42.816 13:59:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:42.816 13:59:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:42.816 13:59:23 -- scripts/common.sh@364 -- # decimal 1 00:25:42.816 13:59:23 -- scripts/common.sh@352 -- # local d=1 00:25:42.816 13:59:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:42.816 13:59:23 -- scripts/common.sh@354 -- # echo 1 00:25:42.816 13:59:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:42.816 13:59:23 -- scripts/common.sh@365 -- # decimal 2 00:25:42.816 13:59:23 -- scripts/common.sh@352 -- # local d=2 00:25:42.816 13:59:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:42.816 13:59:23 -- scripts/common.sh@354 -- # echo 2 00:25:42.816 13:59:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:42.816 13:59:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:42.816 13:59:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:42.816 13:59:23 -- scripts/common.sh@367 -- # return 0 00:25:42.816 13:59:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:42.816 13:59:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:42.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.817 --rc genhtml_branch_coverage=1 00:25:42.817 --rc genhtml_function_coverage=1 00:25:42.817 --rc genhtml_legend=1 00:25:42.817 --rc geninfo_all_blocks=1 00:25:42.817 --rc geninfo_unexecuted_blocks=1 00:25:42.817 00:25:42.817 ' 00:25:42.817 13:59:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:42.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.817 --rc genhtml_branch_coverage=1 00:25:42.817 --rc genhtml_function_coverage=1 00:25:42.817 --rc genhtml_legend=1 00:25:42.817 --rc geninfo_all_blocks=1 00:25:42.817 --rc geninfo_unexecuted_blocks=1 00:25:42.817 00:25:42.817 ' 00:25:42.817 13:59:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:42.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.817 --rc genhtml_branch_coverage=1 00:25:42.817 --rc genhtml_function_coverage=1 00:25:42.817 --rc genhtml_legend=1 00:25:42.817 --rc geninfo_all_blocks=1 00:25:42.817 --rc geninfo_unexecuted_blocks=1 00:25:42.817 00:25:42.817 ' 00:25:42.817 13:59:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:42.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.817 --rc genhtml_branch_coverage=1 00:25:42.817 --rc genhtml_function_coverage=1 00:25:42.817 --rc genhtml_legend=1 00:25:42.817 --rc geninfo_all_blocks=1 00:25:42.817 --rc geninfo_unexecuted_blocks=1 00:25:42.817 00:25:42.817 ' 00:25:42.817 13:59:23 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:42.817 13:59:23 -- nvmf/common.sh@7 -- # uname -s 00:25:42.817 13:59:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:42.817 13:59:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:42.817 13:59:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:42.817 13:59:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:42.817 13:59:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:42.817 13:59:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:42.817 13:59:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:42.817 13:59:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:42.817 13:59:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:42.817 13:59:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:42.817 13:59:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:42.817 13:59:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:42.817 13:59:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:42.817 13:59:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:42.817 13:59:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:42.817 13:59:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:42.817 13:59:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:42.817 13:59:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:42.817 13:59:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:42.817 13:59:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.817 13:59:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.817 13:59:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.817 13:59:23 -- paths/export.sh@5 -- # export PATH 00:25:42.817 13:59:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.817 13:59:23 -- nvmf/common.sh@46 -- # : 0 00:25:42.817 13:59:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:42.817 13:59:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:42.817 13:59:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:42.817 13:59:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:42.817 13:59:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:42.817 13:59:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:42.817 13:59:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:42.817 13:59:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:42.817 13:59:23 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:42.817 13:59:23 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:42.817 13:59:23 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:42.817 13:59:23 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:42.817 13:59:23 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:42.817 13:59:23 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:42.817 13:59:23 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:42.817 13:59:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:42.817 13:59:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:42.817 13:59:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:42.817 13:59:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:42.817 13:59:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:42.817 13:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:42.817 13:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:42.817 13:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.817 13:59:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:42.817 13:59:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:42.817 13:59:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:42.817 13:59:23 -- common/autotest_common.sh@10 -- # set +x 00:25:44.719 13:59:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:44.719 13:59:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:44.719 13:59:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:44.719 13:59:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:44.719 13:59:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:44.719 13:59:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:44.719 13:59:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:44.719 13:59:24 -- nvmf/common.sh@294 -- # net_devs=() 00:25:44.719 13:59:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:44.719 13:59:24 -- nvmf/common.sh@295 -- # e810=() 00:25:44.719 13:59:24 -- nvmf/common.sh@295 -- # local -ga e810 00:25:44.719 13:59:24 -- nvmf/common.sh@296 -- # x722=() 00:25:44.719 13:59:24 -- nvmf/common.sh@296 -- # local -ga x722 00:25:44.719 13:59:24 -- nvmf/common.sh@297 -- # mlx=() 00:25:44.719 13:59:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:44.719 13:59:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:44.719 13:59:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:44.720 13:59:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:44.720 13:59:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:44.720 13:59:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:44.720 13:59:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:44.720 13:59:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:44.720 13:59:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:44.720 13:59:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:44.720 13:59:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:44.720 13:59:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:44.720 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:44.720 13:59:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:44.720 13:59:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:44.720 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:44.720 13:59:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:44.720 13:59:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:44.720 13:59:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:44.720 13:59:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:44.720 13:59:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:44.720 13:59:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:44.979 13:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:44.979 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:44.979 13:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:44.979 13:59:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:44.979 13:59:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:44.979 13:59:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:44.979 13:59:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:44.979 13:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:44.979 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:44.979 13:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:44.979 13:59:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:44.979 13:59:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:44.979 13:59:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:44.979 13:59:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:44.979 13:59:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:44.979 13:59:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:44.979 13:59:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:44.979 13:59:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:44.979 13:59:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:44.979 13:59:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:44.979 13:59:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:44.979 13:59:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:44.979 13:59:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:44.979 13:59:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:44.979 13:59:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:44.979 13:59:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:44.979 13:59:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:44.979 13:59:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:44.979 13:59:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:44.979 13:59:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:44.979 13:59:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:44.979 13:59:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:44.979 13:59:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:44.979 13:59:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:44.979 13:59:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:44.979 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:44.979 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:25:44.979 00:25:44.979 --- 10.0.0.2 ping statistics --- 00:25:44.979 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:44.979 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:25:44.979 13:59:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:44.979 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:44.979 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:25:44.979 00:25:44.979 --- 10.0.0.1 ping statistics --- 00:25:44.979 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:44.979 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:25:44.979 13:59:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:44.979 13:59:25 -- nvmf/common.sh@410 -- # return 0 00:25:44.979 13:59:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:44.979 13:59:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:44.979 13:59:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:44.979 13:59:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:44.979 13:59:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:44.979 13:59:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:44.979 13:59:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:44.979 13:59:25 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:44.979 13:59:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:44.979 13:59:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:44.979 13:59:25 -- common/autotest_common.sh@10 -- # set +x 00:25:44.979 13:59:25 -- nvmf/common.sh@469 -- # nvmfpid=2379683 00:25:44.979 13:59:25 -- nvmf/common.sh@470 -- # waitforlisten 2379683 00:25:44.979 13:59:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:44.979 13:59:25 -- common/autotest_common.sh@829 -- # '[' -z 2379683 ']' 00:25:44.979 13:59:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:44.979 13:59:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:44.979 13:59:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:44.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:44.979 13:59:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:44.979 13:59:25 -- common/autotest_common.sh@10 -- # set +x 00:25:44.979 [2024-11-29 13:59:25.196627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:44.979 [2024-11-29 13:59:25.196700] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:44.979 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.236 [2024-11-29 13:59:25.267677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:45.236 [2024-11-29 13:59:25.356406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:45.236 [2024-11-29 13:59:25.356580] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:45.236 [2024-11-29 13:59:25.356609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:45.236 [2024-11-29 13:59:25.356623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:45.236 [2024-11-29 13:59:25.356722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:45.236 [2024-11-29 13:59:25.356828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:45.236 [2024-11-29 13:59:25.356831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.167 13:59:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.167 13:59:26 -- common/autotest_common.sh@862 -- # return 0 00:25:46.167 13:59:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:46.167 13:59:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 13:59:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:46.167 13:59:26 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:46.167 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 [2024-11-29 13:59:26.177173] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:46.167 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.167 13:59:26 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:46.167 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 Malloc0 00:25:46.167 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.167 13:59:26 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:46.167 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.167 13:59:26 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:46.167 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.167 13:59:26 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:46.167 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.167 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.167 [2024-11-29 13:59:26.231927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:46.167 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 [2024-11-29 13:59:26.239824] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 Malloc1 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:46.168 13:59:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:46.168 13:59:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.168 13:59:26 -- host/multicontroller.sh@44 -- # bdevperf_pid=2379846 00:25:46.168 13:59:26 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:46.168 13:59:26 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:46.168 13:59:26 -- host/multicontroller.sh@47 -- # waitforlisten 2379846 /var/tmp/bdevperf.sock 00:25:46.168 13:59:26 -- common/autotest_common.sh@829 -- # '[' -z 2379846 ']' 00:25:46.168 13:59:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:46.168 13:59:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.168 13:59:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:46.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:46.168 13:59:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.168 13:59:26 -- common/autotest_common.sh@10 -- # set +x 00:25:47.102 13:59:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.102 13:59:27 -- common/autotest_common.sh@862 -- # return 0 00:25:47.102 13:59:27 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:47.102 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.102 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.102 NVMe0n1 00:25:47.102 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.102 13:59:27 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:47.102 13:59:27 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:47.102 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.102 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.102 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.102 1 00:25:47.102 13:59:27 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:47.102 13:59:27 -- common/autotest_common.sh@650 -- # local es=0 00:25:47.102 13:59:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:47.102 13:59:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:47.102 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.102 13:59:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:47.102 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.102 13:59:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:47.102 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.102 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 request: 00:25:47.360 { 00:25:47.360 "name": "NVMe0", 00:25:47.360 "trtype": "tcp", 00:25:47.360 "traddr": "10.0.0.2", 00:25:47.360 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:47.360 "hostaddr": "10.0.0.2", 00:25:47.360 "hostsvcid": "60000", 00:25:47.360 "adrfam": "ipv4", 00:25:47.360 "trsvcid": "4420", 00:25:47.360 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:47.360 "method": "bdev_nvme_attach_controller", 00:25:47.360 "req_id": 1 00:25:47.360 } 00:25:47.360 Got JSON-RPC error response 00:25:47.360 response: 00:25:47.360 { 00:25:47.360 "code": -114, 00:25:47.360 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:47.360 } 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # es=1 00:25:47.360 13:59:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:47.360 13:59:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:47.360 13:59:27 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:47.360 13:59:27 -- common/autotest_common.sh@650 -- # local es=0 00:25:47.360 13:59:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:47.360 13:59:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 request: 00:25:47.360 { 00:25:47.360 "name": "NVMe0", 00:25:47.360 "trtype": "tcp", 00:25:47.360 "traddr": "10.0.0.2", 00:25:47.360 "hostaddr": "10.0.0.2", 00:25:47.360 "hostsvcid": "60000", 00:25:47.360 "adrfam": "ipv4", 00:25:47.360 "trsvcid": "4420", 00:25:47.360 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:47.360 "method": "bdev_nvme_attach_controller", 00:25:47.360 "req_id": 1 00:25:47.360 } 00:25:47.360 Got JSON-RPC error response 00:25:47.360 response: 00:25:47.360 { 00:25:47.360 "code": -114, 00:25:47.360 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:47.360 } 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # es=1 00:25:47.360 13:59:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:47.360 13:59:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:47.360 13:59:27 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@650 -- # local es=0 00:25:47.360 13:59:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 request: 00:25:47.360 { 00:25:47.360 "name": "NVMe0", 00:25:47.360 "trtype": "tcp", 00:25:47.360 "traddr": "10.0.0.2", 00:25:47.360 "hostaddr": "10.0.0.2", 00:25:47.360 "hostsvcid": "60000", 00:25:47.360 "adrfam": "ipv4", 00:25:47.360 "trsvcid": "4420", 00:25:47.360 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:47.360 "multipath": "disable", 00:25:47.360 "method": "bdev_nvme_attach_controller", 00:25:47.360 "req_id": 1 00:25:47.360 } 00:25:47.360 Got JSON-RPC error response 00:25:47.360 response: 00:25:47.360 { 00:25:47.360 "code": -114, 00:25:47.360 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:47.360 } 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # es=1 00:25:47.360 13:59:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:47.360 13:59:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:47.360 13:59:27 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:47.360 13:59:27 -- common/autotest_common.sh@650 -- # local es=0 00:25:47.360 13:59:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:47.360 13:59:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:47.360 13:59:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 request: 00:25:47.360 { 00:25:47.360 "name": "NVMe0", 00:25:47.360 "trtype": "tcp", 00:25:47.360 "traddr": "10.0.0.2", 00:25:47.360 "hostaddr": "10.0.0.2", 00:25:47.360 "hostsvcid": "60000", 00:25:47.360 "adrfam": "ipv4", 00:25:47.360 "trsvcid": "4420", 00:25:47.360 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:47.360 "multipath": "failover", 00:25:47.360 "method": "bdev_nvme_attach_controller", 00:25:47.360 "req_id": 1 00:25:47.360 } 00:25:47.360 Got JSON-RPC error response 00:25:47.360 response: 00:25:47.360 { 00:25:47.360 "code": -114, 00:25:47.360 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:47.360 } 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@653 -- # es=1 00:25:47.360 13:59:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:47.360 13:59:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:47.360 13:59:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:47.360 13:59:27 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.360 13:59:27 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.360 13:59:27 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.360 00:25:47.360 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.360 13:59:27 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:47.360 13:59:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.360 13:59:27 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:47.360 13:59:27 -- common/autotest_common.sh@10 -- # set +x 00:25:47.361 13:59:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.361 13:59:27 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:47.361 13:59:27 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:48.735 0 00:25:48.735 13:59:28 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:48.735 13:59:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.735 13:59:28 -- common/autotest_common.sh@10 -- # set +x 00:25:48.735 13:59:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.735 13:59:28 -- host/multicontroller.sh@100 -- # killprocess 2379846 00:25:48.735 13:59:28 -- common/autotest_common.sh@936 -- # '[' -z 2379846 ']' 00:25:48.735 13:59:28 -- common/autotest_common.sh@940 -- # kill -0 2379846 00:25:48.735 13:59:28 -- common/autotest_common.sh@941 -- # uname 00:25:48.735 13:59:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.735 13:59:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2379846 00:25:48.735 13:59:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:48.735 13:59:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:48.735 13:59:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2379846' 00:25:48.735 killing process with pid 2379846 00:25:48.735 13:59:28 -- common/autotest_common.sh@955 -- # kill 2379846 00:25:48.735 13:59:28 -- common/autotest_common.sh@960 -- # wait 2379846 00:25:48.735 13:59:28 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:48.735 13:59:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.735 13:59:28 -- common/autotest_common.sh@10 -- # set +x 00:25:48.735 13:59:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.735 13:59:28 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:48.735 13:59:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.735 13:59:28 -- common/autotest_common.sh@10 -- # set +x 00:25:48.735 13:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.735 13:59:29 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:48.735 13:59:29 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:48.735 13:59:29 -- common/autotest_common.sh@1607 -- # read -r file 00:25:48.735 13:59:29 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:48.735 13:59:29 -- common/autotest_common.sh@1606 -- # sort -u 00:25:48.735 13:59:29 -- common/autotest_common.sh@1608 -- # cat 00:25:48.735 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:48.735 [2024-11-29 13:59:26.334604] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:48.735 [2024-11-29 13:59:26.334710] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2379846 ] 00:25:48.735 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.735 [2024-11-29 13:59:26.396139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:48.735 [2024-11-29 13:59:26.480365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:48.735 [2024-11-29 13:59:27.579382] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 2a863cdb-3c50-4252-b57e-6ec1bd5ecb46 already exists 00:25:48.735 [2024-11-29 13:59:27.579429] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:2a863cdb-3c50-4252-b57e-6ec1bd5ecb46 alias for bdev NVMe1n1 00:25:48.735 [2024-11-29 13:59:27.579446] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:48.735 Running I/O for 1 seconds... 00:25:48.735 00:25:48.735 Latency(us) 00:25:48.735 [2024-11-29T12:59:29.017Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.735 [2024-11-29T12:59:29.017Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:48.735 NVMe0n1 : 1.00 19871.56 77.62 0.00 0.00 6433.55 1978.22 11456.66 00:25:48.735 [2024-11-29T12:59:29.017Z] =================================================================================================================== 00:25:48.735 [2024-11-29T12:59:29.017Z] Total : 19871.56 77.62 0.00 0.00 6433.55 1978.22 11456.66 00:25:48.735 Received shutdown signal, test time was about 1.000000 seconds 00:25:48.735 00:25:48.735 Latency(us) 00:25:48.735 [2024-11-29T12:59:29.017Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.735 [2024-11-29T12:59:29.017Z] =================================================================================================================== 00:25:48.735 [2024-11-29T12:59:29.017Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:48.735 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:48.735 13:59:29 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:48.993 13:59:29 -- common/autotest_common.sh@1607 -- # read -r file 00:25:48.993 13:59:29 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:48.993 13:59:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:48.993 13:59:29 -- nvmf/common.sh@116 -- # sync 00:25:48.993 13:59:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:48.993 13:59:29 -- nvmf/common.sh@119 -- # set +e 00:25:48.993 13:59:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:48.993 13:59:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:48.993 rmmod nvme_tcp 00:25:48.993 rmmod nvme_fabrics 00:25:48.993 rmmod nvme_keyring 00:25:48.993 13:59:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:48.993 13:59:29 -- nvmf/common.sh@123 -- # set -e 00:25:48.993 13:59:29 -- nvmf/common.sh@124 -- # return 0 00:25:48.993 13:59:29 -- nvmf/common.sh@477 -- # '[' -n 2379683 ']' 00:25:48.993 13:59:29 -- nvmf/common.sh@478 -- # killprocess 2379683 00:25:48.993 13:59:29 -- common/autotest_common.sh@936 -- # '[' -z 2379683 ']' 00:25:48.993 13:59:29 -- common/autotest_common.sh@940 -- # kill -0 2379683 00:25:48.993 13:59:29 -- common/autotest_common.sh@941 -- # uname 00:25:48.993 13:59:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.993 13:59:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2379683 00:25:48.993 13:59:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:48.993 13:59:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:48.993 13:59:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2379683' 00:25:48.993 killing process with pid 2379683 00:25:48.993 13:59:29 -- common/autotest_common.sh@955 -- # kill 2379683 00:25:48.993 13:59:29 -- common/autotest_common.sh@960 -- # wait 2379683 00:25:49.251 13:59:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:49.251 13:59:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:49.251 13:59:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:49.251 13:59:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:49.251 13:59:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:49.251 13:59:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:49.251 13:59:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:49.251 13:59:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:51.154 13:59:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:51.154 00:25:51.154 real 0m8.523s 00:25:51.154 user 0m15.951s 00:25:51.154 sys 0m2.292s 00:25:51.154 13:59:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:51.154 13:59:31 -- common/autotest_common.sh@10 -- # set +x 00:25:51.154 ************************************ 00:25:51.154 END TEST nvmf_multicontroller 00:25:51.154 ************************************ 00:25:51.412 13:59:31 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:51.412 13:59:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:51.412 13:59:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:51.412 13:59:31 -- common/autotest_common.sh@10 -- # set +x 00:25:51.412 ************************************ 00:25:51.412 START TEST nvmf_aer 00:25:51.412 ************************************ 00:25:51.412 13:59:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:51.412 * Looking for test storage... 00:25:51.412 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:51.413 13:59:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:51.413 13:59:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:51.413 13:59:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:51.413 13:59:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:51.413 13:59:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:51.413 13:59:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:51.413 13:59:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:51.413 13:59:31 -- scripts/common.sh@335 -- # IFS=.-: 00:25:51.413 13:59:31 -- scripts/common.sh@335 -- # read -ra ver1 00:25:51.413 13:59:31 -- scripts/common.sh@336 -- # IFS=.-: 00:25:51.413 13:59:31 -- scripts/common.sh@336 -- # read -ra ver2 00:25:51.413 13:59:31 -- scripts/common.sh@337 -- # local 'op=<' 00:25:51.413 13:59:31 -- scripts/common.sh@339 -- # ver1_l=2 00:25:51.413 13:59:31 -- scripts/common.sh@340 -- # ver2_l=1 00:25:51.413 13:59:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:51.413 13:59:31 -- scripts/common.sh@343 -- # case "$op" in 00:25:51.413 13:59:31 -- scripts/common.sh@344 -- # : 1 00:25:51.413 13:59:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:51.413 13:59:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:51.413 13:59:31 -- scripts/common.sh@364 -- # decimal 1 00:25:51.413 13:59:31 -- scripts/common.sh@352 -- # local d=1 00:25:51.413 13:59:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:51.413 13:59:31 -- scripts/common.sh@354 -- # echo 1 00:25:51.413 13:59:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:51.413 13:59:31 -- scripts/common.sh@365 -- # decimal 2 00:25:51.413 13:59:31 -- scripts/common.sh@352 -- # local d=2 00:25:51.413 13:59:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:51.413 13:59:31 -- scripts/common.sh@354 -- # echo 2 00:25:51.413 13:59:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:51.413 13:59:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:51.413 13:59:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:51.413 13:59:31 -- scripts/common.sh@367 -- # return 0 00:25:51.413 13:59:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:51.413 13:59:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:51.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:51.413 --rc genhtml_branch_coverage=1 00:25:51.413 --rc genhtml_function_coverage=1 00:25:51.413 --rc genhtml_legend=1 00:25:51.413 --rc geninfo_all_blocks=1 00:25:51.413 --rc geninfo_unexecuted_blocks=1 00:25:51.413 00:25:51.413 ' 00:25:51.413 13:59:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:51.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:51.413 --rc genhtml_branch_coverage=1 00:25:51.413 --rc genhtml_function_coverage=1 00:25:51.413 --rc genhtml_legend=1 00:25:51.413 --rc geninfo_all_blocks=1 00:25:51.413 --rc geninfo_unexecuted_blocks=1 00:25:51.413 00:25:51.413 ' 00:25:51.413 13:59:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:51.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:51.413 --rc genhtml_branch_coverage=1 00:25:51.413 --rc genhtml_function_coverage=1 00:25:51.413 --rc genhtml_legend=1 00:25:51.413 --rc geninfo_all_blocks=1 00:25:51.413 --rc geninfo_unexecuted_blocks=1 00:25:51.413 00:25:51.413 ' 00:25:51.413 13:59:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:51.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:51.413 --rc genhtml_branch_coverage=1 00:25:51.413 --rc genhtml_function_coverage=1 00:25:51.413 --rc genhtml_legend=1 00:25:51.413 --rc geninfo_all_blocks=1 00:25:51.413 --rc geninfo_unexecuted_blocks=1 00:25:51.413 00:25:51.413 ' 00:25:51.413 13:59:31 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:51.413 13:59:31 -- nvmf/common.sh@7 -- # uname -s 00:25:51.413 13:59:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:51.413 13:59:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:51.413 13:59:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:51.413 13:59:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:51.413 13:59:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:51.413 13:59:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:51.413 13:59:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:51.413 13:59:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:51.413 13:59:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:51.413 13:59:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:51.413 13:59:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:51.413 13:59:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:51.413 13:59:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:51.413 13:59:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:51.413 13:59:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:51.413 13:59:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:51.413 13:59:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:51.413 13:59:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:51.413 13:59:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:51.413 13:59:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:51.413 13:59:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:51.413 13:59:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:51.413 13:59:31 -- paths/export.sh@5 -- # export PATH 00:25:51.413 13:59:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:51.413 13:59:31 -- nvmf/common.sh@46 -- # : 0 00:25:51.413 13:59:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:51.413 13:59:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:51.413 13:59:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:51.413 13:59:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:51.413 13:59:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:51.413 13:59:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:51.413 13:59:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:51.413 13:59:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:51.413 13:59:31 -- host/aer.sh@11 -- # nvmftestinit 00:25:51.413 13:59:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:51.413 13:59:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:51.413 13:59:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:51.413 13:59:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:51.413 13:59:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:51.413 13:59:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:51.413 13:59:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:51.413 13:59:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:51.413 13:59:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:51.413 13:59:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:51.414 13:59:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:51.414 13:59:31 -- common/autotest_common.sh@10 -- # set +x 00:25:53.319 13:59:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:53.319 13:59:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:53.319 13:59:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:53.319 13:59:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:53.319 13:59:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:53.319 13:59:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:53.319 13:59:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:53.319 13:59:33 -- nvmf/common.sh@294 -- # net_devs=() 00:25:53.319 13:59:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:53.319 13:59:33 -- nvmf/common.sh@295 -- # e810=() 00:25:53.319 13:59:33 -- nvmf/common.sh@295 -- # local -ga e810 00:25:53.319 13:59:33 -- nvmf/common.sh@296 -- # x722=() 00:25:53.319 13:59:33 -- nvmf/common.sh@296 -- # local -ga x722 00:25:53.319 13:59:33 -- nvmf/common.sh@297 -- # mlx=() 00:25:53.319 13:59:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:53.319 13:59:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:53.319 13:59:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:53.319 13:59:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:53.319 13:59:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:53.319 13:59:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:53.319 13:59:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:53.319 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:53.319 13:59:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:53.319 13:59:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:53.320 13:59:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:53.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:53.320 13:59:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:53.320 13:59:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:53.320 13:59:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:53.320 13:59:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:53.320 13:59:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:53.320 13:59:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:53.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:53.320 13:59:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:53.320 13:59:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:53.320 13:59:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:53.320 13:59:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:53.320 13:59:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:53.320 13:59:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:53.320 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:53.320 13:59:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:53.320 13:59:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:53.320 13:59:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:53.320 13:59:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:53.320 13:59:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:53.320 13:59:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:53.320 13:59:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:53.320 13:59:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:53.320 13:59:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:53.320 13:59:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:53.320 13:59:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:53.320 13:59:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:53.320 13:59:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:53.320 13:59:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:53.320 13:59:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:53.320 13:59:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:53.320 13:59:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:53.320 13:59:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:53.320 13:59:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:53.320 13:59:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:53.320 13:59:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:53.320 13:59:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:53.578 13:59:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:53.578 13:59:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:53.579 13:59:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:53.579 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:53.579 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:25:53.579 00:25:53.579 --- 10.0.0.2 ping statistics --- 00:25:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:53.579 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:25:53.579 13:59:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:53.579 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:53.579 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:25:53.579 00:25:53.579 --- 10.0.0.1 ping statistics --- 00:25:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:53.579 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:25:53.579 13:59:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:53.579 13:59:33 -- nvmf/common.sh@410 -- # return 0 00:25:53.579 13:59:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:53.579 13:59:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:53.579 13:59:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:53.579 13:59:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:53.579 13:59:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:53.579 13:59:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:53.579 13:59:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:53.579 13:59:33 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:53.579 13:59:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:53.579 13:59:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:53.579 13:59:33 -- common/autotest_common.sh@10 -- # set +x 00:25:53.579 13:59:33 -- nvmf/common.sh@469 -- # nvmfpid=2382207 00:25:53.579 13:59:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:53.579 13:59:33 -- nvmf/common.sh@470 -- # waitforlisten 2382207 00:25:53.579 13:59:33 -- common/autotest_common.sh@829 -- # '[' -z 2382207 ']' 00:25:53.579 13:59:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:53.579 13:59:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:53.579 13:59:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:53.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:53.579 13:59:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:53.579 13:59:33 -- common/autotest_common.sh@10 -- # set +x 00:25:53.579 [2024-11-29 13:59:33.794197] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:53.579 [2024-11-29 13:59:33.794293] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:53.579 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.837 [2024-11-29 13:59:33.866390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:53.837 [2024-11-29 13:59:33.953574] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:53.837 [2024-11-29 13:59:33.953728] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:53.837 [2024-11-29 13:59:33.953746] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:53.837 [2024-11-29 13:59:33.953758] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:53.837 [2024-11-29 13:59:33.953810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:53.837 [2024-11-29 13:59:33.953835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:53.837 [2024-11-29 13:59:33.953892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:53.837 [2024-11-29 13:59:33.953895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:54.771 13:59:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:54.771 13:59:34 -- common/autotest_common.sh@862 -- # return 0 00:25:54.771 13:59:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:54.771 13:59:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:54.771 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.771 13:59:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:54.771 13:59:34 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:54.771 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.771 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.771 [2024-11-29 13:59:34.813177] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:54.771 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.771 13:59:34 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:54.771 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.771 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.771 Malloc0 00:25:54.771 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.771 13:59:34 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:54.771 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.771 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.771 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.771 13:59:34 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:54.771 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.771 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.771 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.772 13:59:34 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:54.772 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.772 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.772 [2024-11-29 13:59:34.864023] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:54.772 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.772 13:59:34 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:54.772 13:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.772 13:59:34 -- common/autotest_common.sh@10 -- # set +x 00:25:54.772 [2024-11-29 13:59:34.871781] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:54.772 [ 00:25:54.772 { 00:25:54.772 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:54.772 "subtype": "Discovery", 00:25:54.772 "listen_addresses": [], 00:25:54.772 "allow_any_host": true, 00:25:54.772 "hosts": [] 00:25:54.772 }, 00:25:54.772 { 00:25:54.772 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.772 "subtype": "NVMe", 00:25:54.772 "listen_addresses": [ 00:25:54.772 { 00:25:54.772 "transport": "TCP", 00:25:54.772 "trtype": "TCP", 00:25:54.772 "adrfam": "IPv4", 00:25:54.772 "traddr": "10.0.0.2", 00:25:54.772 "trsvcid": "4420" 00:25:54.772 } 00:25:54.772 ], 00:25:54.772 "allow_any_host": true, 00:25:54.772 "hosts": [], 00:25:54.772 "serial_number": "SPDK00000000000001", 00:25:54.772 "model_number": "SPDK bdev Controller", 00:25:54.772 "max_namespaces": 2, 00:25:54.772 "min_cntlid": 1, 00:25:54.772 "max_cntlid": 65519, 00:25:54.772 "namespaces": [ 00:25:54.772 { 00:25:54.772 "nsid": 1, 00:25:54.772 "bdev_name": "Malloc0", 00:25:54.772 "name": "Malloc0", 00:25:54.772 "nguid": "D3FDA3FDAAE1453CA98B32ACB338C2F6", 00:25:54.772 "uuid": "d3fda3fd-aae1-453c-a98b-32acb338c2f6" 00:25:54.772 } 00:25:54.772 ] 00:25:54.772 } 00:25:54.772 ] 00:25:54.772 13:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.772 13:59:34 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:54.772 13:59:34 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:54.772 13:59:34 -- host/aer.sh@33 -- # aerpid=2382366 00:25:54.772 13:59:34 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:54.772 13:59:34 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:54.772 13:59:34 -- common/autotest_common.sh@1254 -- # local i=0 00:25:54.772 13:59:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.772 13:59:34 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:54.772 13:59:34 -- common/autotest_common.sh@1257 -- # i=1 00:25:54.772 13:59:34 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:54.772 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.772 13:59:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.772 13:59:34 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:54.772 13:59:34 -- common/autotest_common.sh@1257 -- # i=2 00:25:54.772 13:59:34 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:55.030 13:59:35 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:55.030 13:59:35 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:55.030 13:59:35 -- common/autotest_common.sh@1265 -- # return 0 00:25:55.030 13:59:35 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 Malloc1 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 Asynchronous Event Request test 00:25:55.030 Attaching to 10.0.0.2 00:25:55.030 Attached to 10.0.0.2 00:25:55.030 Registering asynchronous event callbacks... 00:25:55.030 Starting namespace attribute notice tests for all controllers... 00:25:55.030 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:55.030 aer_cb - Changed Namespace 00:25:55.030 Cleaning up... 00:25:55.030 [ 00:25:55.030 { 00:25:55.030 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:55.030 "subtype": "Discovery", 00:25:55.030 "listen_addresses": [], 00:25:55.030 "allow_any_host": true, 00:25:55.030 "hosts": [] 00:25:55.030 }, 00:25:55.030 { 00:25:55.030 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:55.030 "subtype": "NVMe", 00:25:55.030 "listen_addresses": [ 00:25:55.030 { 00:25:55.030 "transport": "TCP", 00:25:55.030 "trtype": "TCP", 00:25:55.030 "adrfam": "IPv4", 00:25:55.030 "traddr": "10.0.0.2", 00:25:55.030 "trsvcid": "4420" 00:25:55.030 } 00:25:55.030 ], 00:25:55.030 "allow_any_host": true, 00:25:55.030 "hosts": [], 00:25:55.030 "serial_number": "SPDK00000000000001", 00:25:55.030 "model_number": "SPDK bdev Controller", 00:25:55.030 "max_namespaces": 2, 00:25:55.030 "min_cntlid": 1, 00:25:55.030 "max_cntlid": 65519, 00:25:55.030 "namespaces": [ 00:25:55.030 { 00:25:55.030 "nsid": 1, 00:25:55.030 "bdev_name": "Malloc0", 00:25:55.030 "name": "Malloc0", 00:25:55.030 "nguid": "D3FDA3FDAAE1453CA98B32ACB338C2F6", 00:25:55.030 "uuid": "d3fda3fd-aae1-453c-a98b-32acb338c2f6" 00:25:55.030 }, 00:25:55.030 { 00:25:55.030 "nsid": 2, 00:25:55.030 "bdev_name": "Malloc1", 00:25:55.030 "name": "Malloc1", 00:25:55.030 "nguid": "68556321D2C446DEA7BBB05DD20A4E46", 00:25:55.030 "uuid": "68556321-d2c4-46de-a7bb-b05dd20a4e46" 00:25:55.030 } 00:25:55.030 ] 00:25:55.030 } 00:25:55.030 ] 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@43 -- # wait 2382366 00:25:55.030 13:59:35 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:55.030 13:59:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.030 13:59:35 -- common/autotest_common.sh@10 -- # set +x 00:25:55.030 13:59:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.030 13:59:35 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:55.030 13:59:35 -- host/aer.sh@51 -- # nvmftestfini 00:25:55.030 13:59:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:55.030 13:59:35 -- nvmf/common.sh@116 -- # sync 00:25:55.030 13:59:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:55.030 13:59:35 -- nvmf/common.sh@119 -- # set +e 00:25:55.030 13:59:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:55.030 13:59:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:55.030 rmmod nvme_tcp 00:25:55.030 rmmod nvme_fabrics 00:25:55.030 rmmod nvme_keyring 00:25:55.030 13:59:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:55.030 13:59:35 -- nvmf/common.sh@123 -- # set -e 00:25:55.030 13:59:35 -- nvmf/common.sh@124 -- # return 0 00:25:55.030 13:59:35 -- nvmf/common.sh@477 -- # '[' -n 2382207 ']' 00:25:55.030 13:59:35 -- nvmf/common.sh@478 -- # killprocess 2382207 00:25:55.030 13:59:35 -- common/autotest_common.sh@936 -- # '[' -z 2382207 ']' 00:25:55.030 13:59:35 -- common/autotest_common.sh@940 -- # kill -0 2382207 00:25:55.030 13:59:35 -- common/autotest_common.sh@941 -- # uname 00:25:55.030 13:59:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.030 13:59:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2382207 00:25:55.289 13:59:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:55.289 13:59:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:55.289 13:59:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2382207' 00:25:55.289 killing process with pid 2382207 00:25:55.289 13:59:35 -- common/autotest_common.sh@955 -- # kill 2382207 00:25:55.289 [2024-11-29 13:59:35.313512] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:55.289 13:59:35 -- common/autotest_common.sh@960 -- # wait 2382207 00:25:55.289 13:59:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:55.289 13:59:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:55.289 13:59:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:55.289 13:59:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:55.289 13:59:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:55.289 13:59:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.289 13:59:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.289 13:59:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.827 13:59:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:57.827 00:25:57.827 real 0m6.132s 00:25:57.827 user 0m7.274s 00:25:57.827 sys 0m1.860s 00:25:57.827 13:59:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.827 13:59:37 -- common/autotest_common.sh@10 -- # set +x 00:25:57.827 ************************************ 00:25:57.827 END TEST nvmf_aer 00:25:57.827 ************************************ 00:25:57.827 13:59:37 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:57.827 13:59:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:57.827 13:59:37 -- common/autotest_common.sh@10 -- # set +x 00:25:57.827 ************************************ 00:25:57.827 START TEST nvmf_async_init 00:25:57.827 ************************************ 00:25:57.827 13:59:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:57.827 * Looking for test storage... 00:25:57.827 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:57.827 13:59:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:57.827 13:59:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:57.827 13:59:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.827 13:59:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.827 13:59:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.827 13:59:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.827 13:59:37 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.827 13:59:37 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.827 13:59:37 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.827 13:59:37 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.827 13:59:37 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.827 13:59:37 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.827 13:59:37 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.827 13:59:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.827 13:59:37 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.827 13:59:37 -- scripts/common.sh@344 -- # : 1 00:25:57.827 13:59:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.827 13:59:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.827 13:59:37 -- scripts/common.sh@364 -- # decimal 1 00:25:57.827 13:59:37 -- scripts/common.sh@352 -- # local d=1 00:25:57.827 13:59:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.827 13:59:37 -- scripts/common.sh@354 -- # echo 1 00:25:57.827 13:59:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.827 13:59:37 -- scripts/common.sh@365 -- # decimal 2 00:25:57.827 13:59:37 -- scripts/common.sh@352 -- # local d=2 00:25:57.827 13:59:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.827 13:59:37 -- scripts/common.sh@354 -- # echo 2 00:25:57.827 13:59:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.827 13:59:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.827 13:59:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.827 13:59:37 -- scripts/common.sh@367 -- # return 0 00:25:57.827 13:59:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.827 --rc genhtml_branch_coverage=1 00:25:57.827 --rc genhtml_function_coverage=1 00:25:57.827 --rc genhtml_legend=1 00:25:57.827 --rc geninfo_all_blocks=1 00:25:57.827 --rc geninfo_unexecuted_blocks=1 00:25:57.827 00:25:57.827 ' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.827 --rc genhtml_branch_coverage=1 00:25:57.827 --rc genhtml_function_coverage=1 00:25:57.827 --rc genhtml_legend=1 00:25:57.827 --rc geninfo_all_blocks=1 00:25:57.827 --rc geninfo_unexecuted_blocks=1 00:25:57.827 00:25:57.827 ' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.827 --rc genhtml_branch_coverage=1 00:25:57.827 --rc genhtml_function_coverage=1 00:25:57.827 --rc genhtml_legend=1 00:25:57.827 --rc geninfo_all_blocks=1 00:25:57.827 --rc geninfo_unexecuted_blocks=1 00:25:57.827 00:25:57.827 ' 00:25:57.827 13:59:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.827 --rc genhtml_branch_coverage=1 00:25:57.827 --rc genhtml_function_coverage=1 00:25:57.827 --rc genhtml_legend=1 00:25:57.827 --rc geninfo_all_blocks=1 00:25:57.827 --rc geninfo_unexecuted_blocks=1 00:25:57.827 00:25:57.827 ' 00:25:57.827 13:59:37 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.827 13:59:37 -- nvmf/common.sh@7 -- # uname -s 00:25:57.827 13:59:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.827 13:59:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.827 13:59:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.827 13:59:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.827 13:59:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.827 13:59:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.827 13:59:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.827 13:59:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.827 13:59:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.827 13:59:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.827 13:59:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.827 13:59:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.827 13:59:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.827 13:59:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.827 13:59:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.827 13:59:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.827 13:59:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.827 13:59:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.827 13:59:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.828 13:59:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.828 13:59:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.828 13:59:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.828 13:59:37 -- paths/export.sh@5 -- # export PATH 00:25:57.828 13:59:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.828 13:59:37 -- nvmf/common.sh@46 -- # : 0 00:25:57.828 13:59:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.828 13:59:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.828 13:59:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.828 13:59:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.828 13:59:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.828 13:59:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.828 13:59:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.828 13:59:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.828 13:59:37 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:57.828 13:59:37 -- host/async_init.sh@14 -- # null_block_size=512 00:25:57.828 13:59:37 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:57.828 13:59:37 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:57.828 13:59:37 -- host/async_init.sh@20 -- # uuidgen 00:25:57.828 13:59:37 -- host/async_init.sh@20 -- # tr -d - 00:25:57.828 13:59:37 -- host/async_init.sh@20 -- # nguid=5a47f32e057e493a819debf7353fafa5 00:25:57.828 13:59:37 -- host/async_init.sh@22 -- # nvmftestinit 00:25:57.828 13:59:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:57.828 13:59:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:57.828 13:59:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:57.828 13:59:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:57.828 13:59:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:57.828 13:59:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.828 13:59:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.828 13:59:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.828 13:59:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:57.828 13:59:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:57.828 13:59:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:57.828 13:59:37 -- common/autotest_common.sh@10 -- # set +x 00:25:59.758 13:59:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.758 13:59:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:59.758 13:59:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:59.758 13:59:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:59.758 13:59:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:59.758 13:59:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:59.758 13:59:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:59.759 13:59:39 -- nvmf/common.sh@294 -- # net_devs=() 00:25:59.759 13:59:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:59.759 13:59:39 -- nvmf/common.sh@295 -- # e810=() 00:25:59.759 13:59:39 -- nvmf/common.sh@295 -- # local -ga e810 00:25:59.759 13:59:39 -- nvmf/common.sh@296 -- # x722=() 00:25:59.759 13:59:39 -- nvmf/common.sh@296 -- # local -ga x722 00:25:59.759 13:59:39 -- nvmf/common.sh@297 -- # mlx=() 00:25:59.759 13:59:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:59.759 13:59:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.759 13:59:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.759 13:59:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:59.759 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:59.759 13:59:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.759 13:59:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:59.759 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:59.759 13:59:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.759 13:59:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.759 13:59:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.759 13:59:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:59.759 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:59.759 13:59:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.759 13:59:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.759 13:59:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.759 13:59:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:59.759 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:59.759 13:59:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:59.759 13:59:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:59.759 13:59:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:59.759 13:59:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:59.759 13:59:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:59.759 13:59:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:59.759 13:59:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:59.759 13:59:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:59.759 13:59:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:59.759 13:59:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:59.759 13:59:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:59.759 13:59:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:59.759 13:59:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:59.759 13:59:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:59.759 13:59:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:59.759 13:59:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:59.759 13:59:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:59.759 13:59:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:59.759 13:59:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:59.759 13:59:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:59.759 13:59:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:59.759 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:59.759 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:25:59.759 00:25:59.759 --- 10.0.0.2 ping statistics --- 00:25:59.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.759 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:25:59.759 13:59:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:59.759 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:59.759 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:25:59.759 00:25:59.759 --- 10.0.0.1 ping statistics --- 00:25:59.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.759 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:25:59.759 13:59:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:59.759 13:59:39 -- nvmf/common.sh@410 -- # return 0 00:25:59.759 13:59:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:59.759 13:59:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:59.759 13:59:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:59.759 13:59:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:59.759 13:59:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:59.759 13:59:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:59.759 13:59:39 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:59.759 13:59:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:59.759 13:59:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:59.759 13:59:39 -- common/autotest_common.sh@10 -- # set +x 00:25:59.759 13:59:39 -- nvmf/common.sh@469 -- # nvmfpid=2384327 00:25:59.759 13:59:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:59.759 13:59:39 -- nvmf/common.sh@470 -- # waitforlisten 2384327 00:25:59.759 13:59:39 -- common/autotest_common.sh@829 -- # '[' -z 2384327 ']' 00:25:59.759 13:59:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:59.759 13:59:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.759 13:59:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:59.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:59.759 13:59:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.759 13:59:39 -- common/autotest_common.sh@10 -- # set +x 00:25:59.759 [2024-11-29 13:59:39.912449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.759 [2024-11-29 13:59:39.912521] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.759 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.759 [2024-11-29 13:59:39.975704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:00.042 [2024-11-29 13:59:40.067551] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:00.042 [2024-11-29 13:59:40.067712] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:00.042 [2024-11-29 13:59:40.067740] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:00.042 [2024-11-29 13:59:40.067753] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:00.042 [2024-11-29 13:59:40.067783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.975 13:59:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.975 13:59:40 -- common/autotest_common.sh@862 -- # return 0 00:26:00.975 13:59:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:00.975 13:59:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 13:59:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:00.975 13:59:40 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 [2024-11-29 13:59:40.963132] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.975 13:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:40 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 null0 00:26:00.975 13:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:40 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 13:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:40 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 13:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:40 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 5a47f32e057e493a819debf7353fafa5 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 13:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:40 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:00.975 13:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:40 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 [2024-11-29 13:59:41.003367] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.975 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:41 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:00.975 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 nvme0n1 00:26:00.975 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.975 13:59:41 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.975 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.975 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:00.975 [ 00:26:00.975 { 00:26:00.975 "name": "nvme0n1", 00:26:00.975 "aliases": [ 00:26:00.975 "5a47f32e-057e-493a-819d-ebf7353fafa5" 00:26:00.975 ], 00:26:00.975 "product_name": "NVMe disk", 00:26:00.975 "block_size": 512, 00:26:00.975 "num_blocks": 2097152, 00:26:00.975 "uuid": "5a47f32e-057e-493a-819d-ebf7353fafa5", 00:26:00.975 "assigned_rate_limits": { 00:26:00.975 "rw_ios_per_sec": 0, 00:26:00.975 "rw_mbytes_per_sec": 0, 00:26:00.975 "r_mbytes_per_sec": 0, 00:26:00.976 "w_mbytes_per_sec": 0 00:26:00.976 }, 00:26:00.976 "claimed": false, 00:26:00.976 "zoned": false, 00:26:00.976 "supported_io_types": { 00:26:00.976 "read": true, 00:26:00.976 "write": true, 00:26:00.976 "unmap": false, 00:26:00.976 "write_zeroes": true, 00:26:00.976 "flush": true, 00:26:00.976 "reset": true, 00:26:00.976 "compare": true, 00:26:00.976 "compare_and_write": true, 00:26:00.976 "abort": true, 00:26:00.976 "nvme_admin": true, 00:26:00.976 "nvme_io": true 00:26:00.976 }, 00:26:00.976 "driver_specific": { 00:26:00.976 "nvme": [ 00:26:00.976 { 00:26:00.976 "trid": { 00:26:00.976 "trtype": "TCP", 00:26:00.976 "adrfam": "IPv4", 00:26:00.976 "traddr": "10.0.0.2", 00:26:00.976 "trsvcid": "4420", 00:26:00.976 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.976 }, 00:26:00.976 "ctrlr_data": { 00:26:00.976 "cntlid": 1, 00:26:00.976 "vendor_id": "0x8086", 00:26:00.976 "model_number": "SPDK bdev Controller", 00:26:00.976 "serial_number": "00000000000000000000", 00:26:00.976 "firmware_revision": "24.01.1", 00:26:00.976 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.976 "oacs": { 00:26:00.976 "security": 0, 00:26:00.976 "format": 0, 00:26:00.976 "firmware": 0, 00:26:00.976 "ns_manage": 0 00:26:00.976 }, 00:26:00.976 "multi_ctrlr": true, 00:26:00.976 "ana_reporting": false 00:26:00.976 }, 00:26:00.976 "vs": { 00:26:00.976 "nvme_version": "1.3" 00:26:00.976 }, 00:26:00.976 "ns_data": { 00:26:00.976 "id": 1, 00:26:00.976 "can_share": true 00:26:00.976 } 00:26:00.976 } 00:26:00.976 ], 00:26:00.976 "mp_policy": "active_passive" 00:26:00.976 } 00:26:00.976 } 00:26:00.976 ] 00:26:00.976 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.976 13:59:41 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:00.976 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.976 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:00.976 [2024-11-29 13:59:41.252006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:00.976 [2024-11-29 13:59:41.252095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24963f0 (9): Bad file descriptor 00:26:01.234 [2024-11-29 13:59:41.384561] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:01.234 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.234 13:59:41 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:01.234 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.234 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.234 [ 00:26:01.234 { 00:26:01.234 "name": "nvme0n1", 00:26:01.234 "aliases": [ 00:26:01.234 "5a47f32e-057e-493a-819d-ebf7353fafa5" 00:26:01.234 ], 00:26:01.234 "product_name": "NVMe disk", 00:26:01.234 "block_size": 512, 00:26:01.234 "num_blocks": 2097152, 00:26:01.234 "uuid": "5a47f32e-057e-493a-819d-ebf7353fafa5", 00:26:01.234 "assigned_rate_limits": { 00:26:01.234 "rw_ios_per_sec": 0, 00:26:01.234 "rw_mbytes_per_sec": 0, 00:26:01.234 "r_mbytes_per_sec": 0, 00:26:01.234 "w_mbytes_per_sec": 0 00:26:01.234 }, 00:26:01.234 "claimed": false, 00:26:01.234 "zoned": false, 00:26:01.234 "supported_io_types": { 00:26:01.234 "read": true, 00:26:01.235 "write": true, 00:26:01.235 "unmap": false, 00:26:01.235 "write_zeroes": true, 00:26:01.235 "flush": true, 00:26:01.235 "reset": true, 00:26:01.235 "compare": true, 00:26:01.235 "compare_and_write": true, 00:26:01.235 "abort": true, 00:26:01.235 "nvme_admin": true, 00:26:01.235 "nvme_io": true 00:26:01.235 }, 00:26:01.235 "driver_specific": { 00:26:01.235 "nvme": [ 00:26:01.235 { 00:26:01.235 "trid": { 00:26:01.235 "trtype": "TCP", 00:26:01.235 "adrfam": "IPv4", 00:26:01.235 "traddr": "10.0.0.2", 00:26:01.235 "trsvcid": "4420", 00:26:01.235 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:01.235 }, 00:26:01.235 "ctrlr_data": { 00:26:01.235 "cntlid": 2, 00:26:01.235 "vendor_id": "0x8086", 00:26:01.235 "model_number": "SPDK bdev Controller", 00:26:01.235 "serial_number": "00000000000000000000", 00:26:01.235 "firmware_revision": "24.01.1", 00:26:01.235 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:01.235 "oacs": { 00:26:01.235 "security": 0, 00:26:01.235 "format": 0, 00:26:01.235 "firmware": 0, 00:26:01.235 "ns_manage": 0 00:26:01.235 }, 00:26:01.235 "multi_ctrlr": true, 00:26:01.235 "ana_reporting": false 00:26:01.235 }, 00:26:01.235 "vs": { 00:26:01.235 "nvme_version": "1.3" 00:26:01.235 }, 00:26:01.235 "ns_data": { 00:26:01.235 "id": 1, 00:26:01.235 "can_share": true 00:26:01.235 } 00:26:01.235 } 00:26:01.235 ], 00:26:01.235 "mp_policy": "active_passive" 00:26:01.235 } 00:26:01.235 } 00:26:01.235 ] 00:26:01.235 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.235 13:59:41 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:01.235 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.235 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.235 13:59:41 -- host/async_init.sh@53 -- # mktemp 00:26:01.235 13:59:41 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.vYOxXZ45Sy 00:26:01.235 13:59:41 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:01.235 13:59:41 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.vYOxXZ45Sy 00:26:01.235 13:59:41 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.235 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.235 13:59:41 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:01.235 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.235 [2024-11-29 13:59:41.432655] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:01.235 [2024-11-29 13:59:41.432796] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:01.235 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.235 13:59:41 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.vYOxXZ45Sy 00:26:01.235 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.235 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.235 13:59:41 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.vYOxXZ45Sy 00:26:01.235 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.235 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.235 [2024-11-29 13:59:41.448696] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:01.494 nvme0n1 00:26:01.494 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.494 13:59:41 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:01.494 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.494 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.494 [ 00:26:01.494 { 00:26:01.494 "name": "nvme0n1", 00:26:01.494 "aliases": [ 00:26:01.494 "5a47f32e-057e-493a-819d-ebf7353fafa5" 00:26:01.494 ], 00:26:01.494 "product_name": "NVMe disk", 00:26:01.494 "block_size": 512, 00:26:01.494 "num_blocks": 2097152, 00:26:01.494 "uuid": "5a47f32e-057e-493a-819d-ebf7353fafa5", 00:26:01.494 "assigned_rate_limits": { 00:26:01.494 "rw_ios_per_sec": 0, 00:26:01.494 "rw_mbytes_per_sec": 0, 00:26:01.494 "r_mbytes_per_sec": 0, 00:26:01.494 "w_mbytes_per_sec": 0 00:26:01.494 }, 00:26:01.494 "claimed": false, 00:26:01.494 "zoned": false, 00:26:01.494 "supported_io_types": { 00:26:01.494 "read": true, 00:26:01.494 "write": true, 00:26:01.494 "unmap": false, 00:26:01.494 "write_zeroes": true, 00:26:01.494 "flush": true, 00:26:01.494 "reset": true, 00:26:01.494 "compare": true, 00:26:01.494 "compare_and_write": true, 00:26:01.494 "abort": true, 00:26:01.494 "nvme_admin": true, 00:26:01.494 "nvme_io": true 00:26:01.494 }, 00:26:01.494 "driver_specific": { 00:26:01.494 "nvme": [ 00:26:01.494 { 00:26:01.494 "trid": { 00:26:01.494 "trtype": "TCP", 00:26:01.494 "adrfam": "IPv4", 00:26:01.494 "traddr": "10.0.0.2", 00:26:01.494 "trsvcid": "4421", 00:26:01.494 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:01.494 }, 00:26:01.494 "ctrlr_data": { 00:26:01.494 "cntlid": 3, 00:26:01.494 "vendor_id": "0x8086", 00:26:01.494 "model_number": "SPDK bdev Controller", 00:26:01.494 "serial_number": "00000000000000000000", 00:26:01.494 "firmware_revision": "24.01.1", 00:26:01.494 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:01.494 "oacs": { 00:26:01.494 "security": 0, 00:26:01.494 "format": 0, 00:26:01.494 "firmware": 0, 00:26:01.494 "ns_manage": 0 00:26:01.494 }, 00:26:01.494 "multi_ctrlr": true, 00:26:01.494 "ana_reporting": false 00:26:01.494 }, 00:26:01.494 "vs": { 00:26:01.494 "nvme_version": "1.3" 00:26:01.494 }, 00:26:01.494 "ns_data": { 00:26:01.494 "id": 1, 00:26:01.494 "can_share": true 00:26:01.494 } 00:26:01.494 } 00:26:01.494 ], 00:26:01.494 "mp_policy": "active_passive" 00:26:01.494 } 00:26:01.494 } 00:26:01.494 ] 00:26:01.494 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.494 13:59:41 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:01.494 13:59:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.494 13:59:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.494 13:59:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.494 13:59:41 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.vYOxXZ45Sy 00:26:01.494 13:59:41 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:01.494 13:59:41 -- host/async_init.sh@78 -- # nvmftestfini 00:26:01.494 13:59:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:01.494 13:59:41 -- nvmf/common.sh@116 -- # sync 00:26:01.494 13:59:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:01.494 13:59:41 -- nvmf/common.sh@119 -- # set +e 00:26:01.494 13:59:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:01.494 13:59:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:01.494 rmmod nvme_tcp 00:26:01.494 rmmod nvme_fabrics 00:26:01.494 rmmod nvme_keyring 00:26:01.494 13:59:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:01.494 13:59:41 -- nvmf/common.sh@123 -- # set -e 00:26:01.494 13:59:41 -- nvmf/common.sh@124 -- # return 0 00:26:01.494 13:59:41 -- nvmf/common.sh@477 -- # '[' -n 2384327 ']' 00:26:01.494 13:59:41 -- nvmf/common.sh@478 -- # killprocess 2384327 00:26:01.494 13:59:41 -- common/autotest_common.sh@936 -- # '[' -z 2384327 ']' 00:26:01.494 13:59:41 -- common/autotest_common.sh@940 -- # kill -0 2384327 00:26:01.494 13:59:41 -- common/autotest_common.sh@941 -- # uname 00:26:01.494 13:59:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:01.494 13:59:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2384327 00:26:01.494 13:59:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:01.494 13:59:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:01.494 13:59:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2384327' 00:26:01.494 killing process with pid 2384327 00:26:01.494 13:59:41 -- common/autotest_common.sh@955 -- # kill 2384327 00:26:01.494 13:59:41 -- common/autotest_common.sh@960 -- # wait 2384327 00:26:01.753 13:59:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:01.753 13:59:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:01.753 13:59:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:01.753 13:59:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:01.753 13:59:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:01.753 13:59:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.753 13:59:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.753 13:59:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.657 13:59:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:03.657 00:26:03.657 real 0m6.273s 00:26:03.657 user 0m3.093s 00:26:03.657 sys 0m1.821s 00:26:03.657 13:59:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:03.657 13:59:43 -- common/autotest_common.sh@10 -- # set +x 00:26:03.657 ************************************ 00:26:03.657 END TEST nvmf_async_init 00:26:03.657 ************************************ 00:26:03.657 13:59:43 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:03.657 13:59:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.657 13:59:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.657 13:59:43 -- common/autotest_common.sh@10 -- # set +x 00:26:03.657 ************************************ 00:26:03.657 START TEST dma 00:26:03.657 ************************************ 00:26:03.657 13:59:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:03.916 * Looking for test storage... 00:26:03.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.916 13:59:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.916 13:59:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.916 13:59:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:03.916 13:59:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:03.916 13:59:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:03.916 13:59:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:03.916 13:59:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:03.916 13:59:44 -- scripts/common.sh@335 -- # IFS=.-: 00:26:03.916 13:59:44 -- scripts/common.sh@335 -- # read -ra ver1 00:26:03.916 13:59:44 -- scripts/common.sh@336 -- # IFS=.-: 00:26:03.916 13:59:44 -- scripts/common.sh@336 -- # read -ra ver2 00:26:03.916 13:59:44 -- scripts/common.sh@337 -- # local 'op=<' 00:26:03.916 13:59:44 -- scripts/common.sh@339 -- # ver1_l=2 00:26:03.916 13:59:44 -- scripts/common.sh@340 -- # ver2_l=1 00:26:03.916 13:59:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:03.916 13:59:44 -- scripts/common.sh@343 -- # case "$op" in 00:26:03.916 13:59:44 -- scripts/common.sh@344 -- # : 1 00:26:03.916 13:59:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:03.916 13:59:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:03.916 13:59:44 -- scripts/common.sh@364 -- # decimal 1 00:26:03.916 13:59:44 -- scripts/common.sh@352 -- # local d=1 00:26:03.916 13:59:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:03.916 13:59:44 -- scripts/common.sh@354 -- # echo 1 00:26:03.916 13:59:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:03.916 13:59:44 -- scripts/common.sh@365 -- # decimal 2 00:26:03.916 13:59:44 -- scripts/common.sh@352 -- # local d=2 00:26:03.916 13:59:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:03.916 13:59:44 -- scripts/common.sh@354 -- # echo 2 00:26:03.916 13:59:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:03.916 13:59:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:03.916 13:59:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:03.916 13:59:44 -- scripts/common.sh@367 -- # return 0 00:26:03.916 13:59:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:03.916 13:59:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:03.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.916 --rc genhtml_branch_coverage=1 00:26:03.916 --rc genhtml_function_coverage=1 00:26:03.916 --rc genhtml_legend=1 00:26:03.916 --rc geninfo_all_blocks=1 00:26:03.916 --rc geninfo_unexecuted_blocks=1 00:26:03.917 00:26:03.917 ' 00:26:03.917 13:59:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:03.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.917 --rc genhtml_branch_coverage=1 00:26:03.917 --rc genhtml_function_coverage=1 00:26:03.917 --rc genhtml_legend=1 00:26:03.917 --rc geninfo_all_blocks=1 00:26:03.917 --rc geninfo_unexecuted_blocks=1 00:26:03.917 00:26:03.917 ' 00:26:03.917 13:59:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:03.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.917 --rc genhtml_branch_coverage=1 00:26:03.917 --rc genhtml_function_coverage=1 00:26:03.917 --rc genhtml_legend=1 00:26:03.917 --rc geninfo_all_blocks=1 00:26:03.917 --rc geninfo_unexecuted_blocks=1 00:26:03.917 00:26:03.917 ' 00:26:03.917 13:59:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:03.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.917 --rc genhtml_branch_coverage=1 00:26:03.917 --rc genhtml_function_coverage=1 00:26:03.917 --rc genhtml_legend=1 00:26:03.917 --rc geninfo_all_blocks=1 00:26:03.917 --rc geninfo_unexecuted_blocks=1 00:26:03.917 00:26:03.917 ' 00:26:03.917 13:59:44 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.917 13:59:44 -- nvmf/common.sh@7 -- # uname -s 00:26:03.917 13:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.917 13:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.917 13:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.917 13:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.917 13:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.917 13:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.917 13:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.917 13:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.917 13:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.917 13:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.917 13:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.917 13:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.917 13:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.917 13:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.917 13:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.917 13:59:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:03.917 13:59:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.917 13:59:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.917 13:59:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.917 13:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.917 13:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.917 13:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.917 13:59:44 -- paths/export.sh@5 -- # export PATH 00:26:03.917 13:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.917 13:59:44 -- nvmf/common.sh@46 -- # : 0 00:26:03.917 13:59:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:03.917 13:59:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:03.917 13:59:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:03.917 13:59:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.917 13:59:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.917 13:59:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:03.917 13:59:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:03.917 13:59:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:03.917 13:59:44 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:03.917 13:59:44 -- host/dma.sh@13 -- # exit 0 00:26:03.917 00:26:03.917 real 0m0.153s 00:26:03.917 user 0m0.105s 00:26:03.917 sys 0m0.057s 00:26:03.917 13:59:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:03.917 13:59:44 -- common/autotest_common.sh@10 -- # set +x 00:26:03.917 ************************************ 00:26:03.917 END TEST dma 00:26:03.917 ************************************ 00:26:03.917 13:59:44 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:03.917 13:59:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.917 13:59:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.917 13:59:44 -- common/autotest_common.sh@10 -- # set +x 00:26:03.917 ************************************ 00:26:03.917 START TEST nvmf_identify 00:26:03.917 ************************************ 00:26:03.917 13:59:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:03.917 * Looking for test storage... 00:26:03.917 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.917 13:59:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.917 13:59:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.917 13:59:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:04.175 13:59:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:04.175 13:59:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:04.175 13:59:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:04.175 13:59:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:04.175 13:59:44 -- scripts/common.sh@335 -- # IFS=.-: 00:26:04.175 13:59:44 -- scripts/common.sh@335 -- # read -ra ver1 00:26:04.175 13:59:44 -- scripts/common.sh@336 -- # IFS=.-: 00:26:04.175 13:59:44 -- scripts/common.sh@336 -- # read -ra ver2 00:26:04.175 13:59:44 -- scripts/common.sh@337 -- # local 'op=<' 00:26:04.175 13:59:44 -- scripts/common.sh@339 -- # ver1_l=2 00:26:04.175 13:59:44 -- scripts/common.sh@340 -- # ver2_l=1 00:26:04.175 13:59:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:04.175 13:59:44 -- scripts/common.sh@343 -- # case "$op" in 00:26:04.175 13:59:44 -- scripts/common.sh@344 -- # : 1 00:26:04.175 13:59:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:04.175 13:59:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:04.175 13:59:44 -- scripts/common.sh@364 -- # decimal 1 00:26:04.175 13:59:44 -- scripts/common.sh@352 -- # local d=1 00:26:04.175 13:59:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:04.175 13:59:44 -- scripts/common.sh@354 -- # echo 1 00:26:04.175 13:59:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:04.175 13:59:44 -- scripts/common.sh@365 -- # decimal 2 00:26:04.175 13:59:44 -- scripts/common.sh@352 -- # local d=2 00:26:04.175 13:59:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:04.175 13:59:44 -- scripts/common.sh@354 -- # echo 2 00:26:04.175 13:59:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:04.175 13:59:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:04.175 13:59:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:04.175 13:59:44 -- scripts/common.sh@367 -- # return 0 00:26:04.175 13:59:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:04.175 13:59:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:04.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.175 --rc genhtml_branch_coverage=1 00:26:04.175 --rc genhtml_function_coverage=1 00:26:04.175 --rc genhtml_legend=1 00:26:04.175 --rc geninfo_all_blocks=1 00:26:04.175 --rc geninfo_unexecuted_blocks=1 00:26:04.175 00:26:04.175 ' 00:26:04.175 13:59:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:04.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.175 --rc genhtml_branch_coverage=1 00:26:04.175 --rc genhtml_function_coverage=1 00:26:04.175 --rc genhtml_legend=1 00:26:04.175 --rc geninfo_all_blocks=1 00:26:04.175 --rc geninfo_unexecuted_blocks=1 00:26:04.175 00:26:04.175 ' 00:26:04.175 13:59:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:04.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.175 --rc genhtml_branch_coverage=1 00:26:04.175 --rc genhtml_function_coverage=1 00:26:04.175 --rc genhtml_legend=1 00:26:04.175 --rc geninfo_all_blocks=1 00:26:04.175 --rc geninfo_unexecuted_blocks=1 00:26:04.175 00:26:04.175 ' 00:26:04.175 13:59:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:04.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.175 --rc genhtml_branch_coverage=1 00:26:04.175 --rc genhtml_function_coverage=1 00:26:04.175 --rc genhtml_legend=1 00:26:04.175 --rc geninfo_all_blocks=1 00:26:04.175 --rc geninfo_unexecuted_blocks=1 00:26:04.175 00:26:04.175 ' 00:26:04.175 13:59:44 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:04.175 13:59:44 -- nvmf/common.sh@7 -- # uname -s 00:26:04.175 13:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:04.175 13:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:04.175 13:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:04.176 13:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:04.176 13:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:04.176 13:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:04.176 13:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:04.176 13:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:04.176 13:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:04.176 13:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:04.176 13:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:04.176 13:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:04.176 13:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:04.176 13:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:04.176 13:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:04.176 13:59:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:04.176 13:59:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:04.176 13:59:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:04.176 13:59:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:04.176 13:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.176 13:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.176 13:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.176 13:59:44 -- paths/export.sh@5 -- # export PATH 00:26:04.176 13:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.176 13:59:44 -- nvmf/common.sh@46 -- # : 0 00:26:04.176 13:59:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:04.176 13:59:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:04.176 13:59:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:04.176 13:59:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:04.176 13:59:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:04.176 13:59:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:04.176 13:59:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:04.176 13:59:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:04.176 13:59:44 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:04.176 13:59:44 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:04.176 13:59:44 -- host/identify.sh@14 -- # nvmftestinit 00:26:04.176 13:59:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:04.176 13:59:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:04.176 13:59:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:04.176 13:59:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:04.176 13:59:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:04.176 13:59:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.176 13:59:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.176 13:59:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:04.176 13:59:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:04.176 13:59:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:04.176 13:59:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:04.176 13:59:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.077 13:59:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:06.077 13:59:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:06.077 13:59:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:06.077 13:59:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:06.077 13:59:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:06.077 13:59:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:06.077 13:59:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:06.077 13:59:46 -- nvmf/common.sh@294 -- # net_devs=() 00:26:06.077 13:59:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:06.077 13:59:46 -- nvmf/common.sh@295 -- # e810=() 00:26:06.077 13:59:46 -- nvmf/common.sh@295 -- # local -ga e810 00:26:06.077 13:59:46 -- nvmf/common.sh@296 -- # x722=() 00:26:06.077 13:59:46 -- nvmf/common.sh@296 -- # local -ga x722 00:26:06.077 13:59:46 -- nvmf/common.sh@297 -- # mlx=() 00:26:06.077 13:59:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:06.077 13:59:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:06.077 13:59:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:06.077 13:59:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:06.077 13:59:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:06.077 13:59:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.077 13:59:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:06.077 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:06.077 13:59:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.077 13:59:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:06.077 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:06.077 13:59:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:06.077 13:59:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:06.077 13:59:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.077 13:59:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.077 13:59:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.077 13:59:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.077 13:59:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:06.077 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:06.077 13:59:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.077 13:59:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.077 13:59:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.077 13:59:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.077 13:59:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.077 13:59:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:06.077 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:06.077 13:59:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.077 13:59:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:06.077 13:59:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:06.077 13:59:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:06.078 13:59:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:06.078 13:59:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:06.078 13:59:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:06.078 13:59:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:06.078 13:59:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:06.078 13:59:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:06.078 13:59:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:06.078 13:59:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:06.078 13:59:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:06.078 13:59:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:06.078 13:59:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:06.078 13:59:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:06.078 13:59:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:06.078 13:59:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:06.078 13:59:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:06.336 13:59:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:06.336 13:59:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:06.336 13:59:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:06.336 13:59:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:06.336 13:59:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:06.336 13:59:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:06.336 13:59:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:06.336 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:06.336 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:26:06.336 00:26:06.336 --- 10.0.0.2 ping statistics --- 00:26:06.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.336 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:26:06.336 13:59:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:06.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:06.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:26:06.336 00:26:06.336 --- 10.0.0.1 ping statistics --- 00:26:06.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.336 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:26:06.336 13:59:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:06.336 13:59:46 -- nvmf/common.sh@410 -- # return 0 00:26:06.336 13:59:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:06.336 13:59:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:06.337 13:59:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:06.337 13:59:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:06.337 13:59:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:06.337 13:59:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:06.337 13:59:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:06.337 13:59:46 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:06.337 13:59:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:06.337 13:59:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.337 13:59:46 -- host/identify.sh@19 -- # nvmfpid=2386607 00:26:06.337 13:59:46 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:06.337 13:59:46 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:06.337 13:59:46 -- host/identify.sh@23 -- # waitforlisten 2386607 00:26:06.337 13:59:46 -- common/autotest_common.sh@829 -- # '[' -z 2386607 ']' 00:26:06.337 13:59:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:06.337 13:59:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:06.337 13:59:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:06.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:06.337 13:59:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:06.337 13:59:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.337 [2024-11-29 13:59:46.514428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.337 [2024-11-29 13:59:46.514521] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:06.337 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.337 [2024-11-29 13:59:46.579005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:06.595 [2024-11-29 13:59:46.669426] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:06.595 [2024-11-29 13:59:46.669605] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:06.595 [2024-11-29 13:59:46.669624] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:06.595 [2024-11-29 13:59:46.669636] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:06.595 [2024-11-29 13:59:46.669691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:06.595 [2024-11-29 13:59:46.669756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:06.595 [2024-11-29 13:59:46.669823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:06.595 [2024-11-29 13:59:46.669825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:07.532 13:59:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:07.532 13:59:47 -- common/autotest_common.sh@862 -- # return 0 00:26:07.532 13:59:47 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:07.532 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.532 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.532 [2024-11-29 13:59:47.490971] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:07.532 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.532 13:59:47 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:07.532 13:59:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:07.532 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.532 13:59:47 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:07.532 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.532 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 Malloc0 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:07.533 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.533 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:07.533 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.533 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:07.533 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.533 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 [2024-11-29 13:59:47.562038] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:07.533 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.533 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:07.533 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.533 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.533 [2024-11-29 13:59:47.577812] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:07.533 [ 00:26:07.533 { 00:26:07.533 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:07.533 "subtype": "Discovery", 00:26:07.533 "listen_addresses": [ 00:26:07.533 { 00:26:07.533 "transport": "TCP", 00:26:07.533 "trtype": "TCP", 00:26:07.533 "adrfam": "IPv4", 00:26:07.533 "traddr": "10.0.0.2", 00:26:07.533 "trsvcid": "4420" 00:26:07.533 } 00:26:07.533 ], 00:26:07.533 "allow_any_host": true, 00:26:07.533 "hosts": [] 00:26:07.533 }, 00:26:07.533 { 00:26:07.533 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:07.533 "subtype": "NVMe", 00:26:07.533 "listen_addresses": [ 00:26:07.533 { 00:26:07.533 "transport": "TCP", 00:26:07.533 "trtype": "TCP", 00:26:07.533 "adrfam": "IPv4", 00:26:07.533 "traddr": "10.0.0.2", 00:26:07.533 "trsvcid": "4420" 00:26:07.533 } 00:26:07.533 ], 00:26:07.533 "allow_any_host": true, 00:26:07.533 "hosts": [], 00:26:07.533 "serial_number": "SPDK00000000000001", 00:26:07.533 "model_number": "SPDK bdev Controller", 00:26:07.533 "max_namespaces": 32, 00:26:07.533 "min_cntlid": 1, 00:26:07.533 "max_cntlid": 65519, 00:26:07.533 "namespaces": [ 00:26:07.533 { 00:26:07.533 "nsid": 1, 00:26:07.533 "bdev_name": "Malloc0", 00:26:07.533 "name": "Malloc0", 00:26:07.533 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:07.533 "eui64": "ABCDEF0123456789", 00:26:07.533 "uuid": "62ddac7d-11b5-43cf-87dd-958735492181" 00:26:07.533 } 00:26:07.533 ] 00:26:07.533 } 00:26:07.533 ] 00:26:07.533 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.533 13:59:47 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:07.533 [2024-11-29 13:59:47.600974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:07.533 [2024-11-29 13:59:47.601019] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2386771 ] 00:26:07.533 EAL: No free 2048 kB hugepages reported on node 1 00:26:07.533 [2024-11-29 13:59:47.634019] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:07.533 [2024-11-29 13:59:47.634073] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:07.533 [2024-11-29 13:59:47.634082] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:07.533 [2024-11-29 13:59:47.634098] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:07.533 [2024-11-29 13:59:47.634111] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:07.533 [2024-11-29 13:59:47.637456] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:07.533 [2024-11-29 13:59:47.637529] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2297420 0 00:26:07.533 [2024-11-29 13:59:47.644620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:07.533 [2024-11-29 13:59:47.644642] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:07.533 [2024-11-29 13:59:47.644652] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:07.533 [2024-11-29 13:59:47.644658] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:07.533 [2024-11-29 13:59:47.644719] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.644733] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.644741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.533 [2024-11-29 13:59:47.644759] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:07.533 [2024-11-29 13:59:47.644787] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.533 [2024-11-29 13:59:47.652427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.533 [2024-11-29 13:59:47.652446] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.533 [2024-11-29 13:59:47.652453] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.533 [2024-11-29 13:59:47.652482] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:07.533 [2024-11-29 13:59:47.652493] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:07.533 [2024-11-29 13:59:47.652503] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:07.533 [2024-11-29 13:59:47.652525] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652534] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652541] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.533 [2024-11-29 13:59:47.652552] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.533 [2024-11-29 13:59:47.652577] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.533 [2024-11-29 13:59:47.652695] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.533 [2024-11-29 13:59:47.652711] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.533 [2024-11-29 13:59:47.652718] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652725] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.533 [2024-11-29 13:59:47.652736] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:07.533 [2024-11-29 13:59:47.652757] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:07.533 [2024-11-29 13:59:47.652770] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652785] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.533 [2024-11-29 13:59:47.652796] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.533 [2024-11-29 13:59:47.652817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.533 [2024-11-29 13:59:47.652903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.533 [2024-11-29 13:59:47.652919] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.533 [2024-11-29 13:59:47.652926] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652932] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.533 [2024-11-29 13:59:47.652942] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:07.533 [2024-11-29 13:59:47.652958] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:07.533 [2024-11-29 13:59:47.652970] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652978] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.652984] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.533 [2024-11-29 13:59:47.652995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.533 [2024-11-29 13:59:47.653015] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.533 [2024-11-29 13:59:47.653107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.533 [2024-11-29 13:59:47.653122] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.533 [2024-11-29 13:59:47.653129] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.653135] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.533 [2024-11-29 13:59:47.653146] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:07.533 [2024-11-29 13:59:47.653163] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.653172] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.533 [2024-11-29 13:59:47.653179] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.533 [2024-11-29 13:59:47.653189] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.533 [2024-11-29 13:59:47.653210] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.653294] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.653306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.653313] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653319] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.653329] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:07.534 [2024-11-29 13:59:47.653338] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:07.534 [2024-11-29 13:59:47.653356] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:07.534 [2024-11-29 13:59:47.653468] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:07.534 [2024-11-29 13:59:47.653478] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:07.534 [2024-11-29 13:59:47.653494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653501] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653508] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.653519] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.534 [2024-11-29 13:59:47.653540] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.653624] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.653637] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.653643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.653660] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:07.534 [2024-11-29 13:59:47.653687] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653697] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653703] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.653714] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.534 [2024-11-29 13:59:47.653734] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.653812] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.653824] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.653831] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653837] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.653847] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:07.534 [2024-11-29 13:59:47.653856] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.653869] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:07.534 [2024-11-29 13:59:47.653883] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.653899] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653906] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.653913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.653924] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.534 [2024-11-29 13:59:47.653945] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.654072] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.534 [2024-11-29 13:59:47.654088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.534 [2024-11-29 13:59:47.654095] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654102] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2297420): datao=0, datal=4096, cccid=0 00:26:07.534 [2024-11-29 13:59:47.654110] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22fcb00) on tqpair(0x2297420): expected_datao=0, payload_size=4096 00:26:07.534 [2024-11-29 13:59:47.654123] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654131] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.654154] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.654161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654167] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.654181] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:07.534 [2024-11-29 13:59:47.654190] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:07.534 [2024-11-29 13:59:47.654198] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:07.534 [2024-11-29 13:59:47.654206] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:07.534 [2024-11-29 13:59:47.654214] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:07.534 [2024-11-29 13:59:47.654222] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.654242] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.654256] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654264] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654270] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654281] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:07.534 [2024-11-29 13:59:47.654303] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.654406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.654420] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.654427] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654433] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcb00) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.654447] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654461] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.534 [2024-11-29 13:59:47.654481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654488] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.534 [2024-11-29 13:59:47.654518] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654525] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654541] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.534 [2024-11-29 13:59:47.654550] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654557] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654563] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654572] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.534 [2024-11-29 13:59:47.654581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.654600] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:07.534 [2024-11-29 13:59:47.654613] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654620] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654627] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2297420) 00:26:07.534 [2024-11-29 13:59:47.654637] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.534 [2024-11-29 13:59:47.654660] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcb00, cid 0, qid 0 00:26:07.534 [2024-11-29 13:59:47.654671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcc60, cid 1, qid 0 00:26:07.534 [2024-11-29 13:59:47.654679] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcdc0, cid 2, qid 0 00:26:07.534 [2024-11-29 13:59:47.654687] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.534 [2024-11-29 13:59:47.654694] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd080, cid 4, qid 0 00:26:07.534 [2024-11-29 13:59:47.654821] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.534 [2024-11-29 13:59:47.654833] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.534 [2024-11-29 13:59:47.654840] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.534 [2024-11-29 13:59:47.654847] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd080) on tqpair=0x2297420 00:26:07.534 [2024-11-29 13:59:47.654858] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:07.534 [2024-11-29 13:59:47.654867] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:07.534 [2024-11-29 13:59:47.654883] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.654893] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.654900] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2297420) 00:26:07.535 [2024-11-29 13:59:47.654910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.535 [2024-11-29 13:59:47.654930] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd080, cid 4, qid 0 00:26:07.535 [2024-11-29 13:59:47.655030] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.535 [2024-11-29 13:59:47.655045] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.535 [2024-11-29 13:59:47.655056] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655063] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2297420): datao=0, datal=4096, cccid=4 00:26:07.535 [2024-11-29 13:59:47.655071] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22fd080) on tqpair(0x2297420): expected_datao=0, payload_size=4096 00:26:07.535 [2024-11-29 13:59:47.655089] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655098] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.535 [2024-11-29 13:59:47.655156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.535 [2024-11-29 13:59:47.655163] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655169] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd080) on tqpair=0x2297420 00:26:07.535 [2024-11-29 13:59:47.655190] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:07.535 [2024-11-29 13:59:47.655227] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655239] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2297420) 00:26:07.535 [2024-11-29 13:59:47.655256] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.535 [2024-11-29 13:59:47.655268] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655275] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655281] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2297420) 00:26:07.535 [2024-11-29 13:59:47.655290] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.535 [2024-11-29 13:59:47.655317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd080, cid 4, qid 0 00:26:07.535 [2024-11-29 13:59:47.655329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd1e0, cid 5, qid 0 00:26:07.535 [2024-11-29 13:59:47.655477] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.535 [2024-11-29 13:59:47.655491] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.535 [2024-11-29 13:59:47.655499] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655505] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2297420): datao=0, datal=1024, cccid=4 00:26:07.535 [2024-11-29 13:59:47.655512] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22fd080) on tqpair(0x2297420): expected_datao=0, payload_size=1024 00:26:07.535 [2024-11-29 13:59:47.655523] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655530] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.535 [2024-11-29 13:59:47.655548] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.535 [2024-11-29 13:59:47.655554] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.655561] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd1e0) on tqpair=0x2297420 00:26:07.535 [2024-11-29 13:59:47.698412] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.535 [2024-11-29 13:59:47.698431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.535 [2024-11-29 13:59:47.698439] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.698446] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd080) on tqpair=0x2297420 00:26:07.535 [2024-11-29 13:59:47.698465] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.698474] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.698485] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2297420) 00:26:07.535 [2024-11-29 13:59:47.698497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.535 [2024-11-29 13:59:47.698541] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd080, cid 4, qid 0 00:26:07.535 [2024-11-29 13:59:47.698743] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.535 [2024-11-29 13:59:47.698756] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.535 [2024-11-29 13:59:47.698763] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.698769] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2297420): datao=0, datal=3072, cccid=4 00:26:07.535 [2024-11-29 13:59:47.698776] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22fd080) on tqpair(0x2297420): expected_datao=0, payload_size=3072 00:26:07.535 [2024-11-29 13:59:47.698796] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.698805] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.535 [2024-11-29 13:59:47.739490] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.535 [2024-11-29 13:59:47.739497] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739504] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd080) on tqpair=0x2297420 00:26:07.535 [2024-11-29 13:59:47.739521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739530] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739536] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2297420) 00:26:07.535 [2024-11-29 13:59:47.739547] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.535 [2024-11-29 13:59:47.739577] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fd080, cid 4, qid 0 00:26:07.535 [2024-11-29 13:59:47.739674] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.535 [2024-11-29 13:59:47.739687] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.535 [2024-11-29 13:59:47.739694] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739700] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2297420): datao=0, datal=8, cccid=4 00:26:07.535 [2024-11-29 13:59:47.739707] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22fd080) on tqpair(0x2297420): expected_datao=0, payload_size=8 00:26:07.535 [2024-11-29 13:59:47.739717] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.739724] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.780475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.535 [2024-11-29 13:59:47.780494] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.535 [2024-11-29 13:59:47.780502] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.535 [2024-11-29 13:59:47.780509] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fd080) on tqpair=0x2297420 00:26:07.535 ===================================================== 00:26:07.535 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:07.535 ===================================================== 00:26:07.535 Controller Capabilities/Features 00:26:07.535 ================================ 00:26:07.535 Vendor ID: 0000 00:26:07.535 Subsystem Vendor ID: 0000 00:26:07.535 Serial Number: .................... 00:26:07.535 Model Number: ........................................ 00:26:07.535 Firmware Version: 24.01.1 00:26:07.535 Recommended Arb Burst: 0 00:26:07.535 IEEE OUI Identifier: 00 00 00 00:26:07.535 Multi-path I/O 00:26:07.535 May have multiple subsystem ports: No 00:26:07.535 May have multiple controllers: No 00:26:07.535 Associated with SR-IOV VF: No 00:26:07.535 Max Data Transfer Size: 131072 00:26:07.535 Max Number of Namespaces: 0 00:26:07.535 Max Number of I/O Queues: 1024 00:26:07.535 NVMe Specification Version (VS): 1.3 00:26:07.535 NVMe Specification Version (Identify): 1.3 00:26:07.535 Maximum Queue Entries: 128 00:26:07.535 Contiguous Queues Required: Yes 00:26:07.535 Arbitration Mechanisms Supported 00:26:07.535 Weighted Round Robin: Not Supported 00:26:07.535 Vendor Specific: Not Supported 00:26:07.535 Reset Timeout: 15000 ms 00:26:07.535 Doorbell Stride: 4 bytes 00:26:07.535 NVM Subsystem Reset: Not Supported 00:26:07.535 Command Sets Supported 00:26:07.535 NVM Command Set: Supported 00:26:07.535 Boot Partition: Not Supported 00:26:07.535 Memory Page Size Minimum: 4096 bytes 00:26:07.535 Memory Page Size Maximum: 4096 bytes 00:26:07.535 Persistent Memory Region: Not Supported 00:26:07.535 Optional Asynchronous Events Supported 00:26:07.535 Namespace Attribute Notices: Not Supported 00:26:07.535 Firmware Activation Notices: Not Supported 00:26:07.535 ANA Change Notices: Not Supported 00:26:07.535 PLE Aggregate Log Change Notices: Not Supported 00:26:07.535 LBA Status Info Alert Notices: Not Supported 00:26:07.535 EGE Aggregate Log Change Notices: Not Supported 00:26:07.535 Normal NVM Subsystem Shutdown event: Not Supported 00:26:07.535 Zone Descriptor Change Notices: Not Supported 00:26:07.535 Discovery Log Change Notices: Supported 00:26:07.535 Controller Attributes 00:26:07.535 128-bit Host Identifier: Not Supported 00:26:07.535 Non-Operational Permissive Mode: Not Supported 00:26:07.535 NVM Sets: Not Supported 00:26:07.535 Read Recovery Levels: Not Supported 00:26:07.535 Endurance Groups: Not Supported 00:26:07.535 Predictable Latency Mode: Not Supported 00:26:07.535 Traffic Based Keep ALive: Not Supported 00:26:07.535 Namespace Granularity: Not Supported 00:26:07.535 SQ Associations: Not Supported 00:26:07.535 UUID List: Not Supported 00:26:07.535 Multi-Domain Subsystem: Not Supported 00:26:07.536 Fixed Capacity Management: Not Supported 00:26:07.536 Variable Capacity Management: Not Supported 00:26:07.536 Delete Endurance Group: Not Supported 00:26:07.536 Delete NVM Set: Not Supported 00:26:07.536 Extended LBA Formats Supported: Not Supported 00:26:07.536 Flexible Data Placement Supported: Not Supported 00:26:07.536 00:26:07.536 Controller Memory Buffer Support 00:26:07.536 ================================ 00:26:07.536 Supported: No 00:26:07.536 00:26:07.536 Persistent Memory Region Support 00:26:07.536 ================================ 00:26:07.536 Supported: No 00:26:07.536 00:26:07.536 Admin Command Set Attributes 00:26:07.536 ============================ 00:26:07.536 Security Send/Receive: Not Supported 00:26:07.536 Format NVM: Not Supported 00:26:07.536 Firmware Activate/Download: Not Supported 00:26:07.536 Namespace Management: Not Supported 00:26:07.536 Device Self-Test: Not Supported 00:26:07.536 Directives: Not Supported 00:26:07.536 NVMe-MI: Not Supported 00:26:07.536 Virtualization Management: Not Supported 00:26:07.536 Doorbell Buffer Config: Not Supported 00:26:07.536 Get LBA Status Capability: Not Supported 00:26:07.536 Command & Feature Lockdown Capability: Not Supported 00:26:07.536 Abort Command Limit: 1 00:26:07.536 Async Event Request Limit: 4 00:26:07.536 Number of Firmware Slots: N/A 00:26:07.536 Firmware Slot 1 Read-Only: N/A 00:26:07.536 Firmware Activation Without Reset: N/A 00:26:07.536 Multiple Update Detection Support: N/A 00:26:07.536 Firmware Update Granularity: No Information Provided 00:26:07.536 Per-Namespace SMART Log: No 00:26:07.536 Asymmetric Namespace Access Log Page: Not Supported 00:26:07.536 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:07.536 Command Effects Log Page: Not Supported 00:26:07.536 Get Log Page Extended Data: Supported 00:26:07.536 Telemetry Log Pages: Not Supported 00:26:07.536 Persistent Event Log Pages: Not Supported 00:26:07.536 Supported Log Pages Log Page: May Support 00:26:07.536 Commands Supported & Effects Log Page: Not Supported 00:26:07.536 Feature Identifiers & Effects Log Page:May Support 00:26:07.536 NVMe-MI Commands & Effects Log Page: May Support 00:26:07.536 Data Area 4 for Telemetry Log: Not Supported 00:26:07.536 Error Log Page Entries Supported: 128 00:26:07.536 Keep Alive: Not Supported 00:26:07.536 00:26:07.536 NVM Command Set Attributes 00:26:07.536 ========================== 00:26:07.536 Submission Queue Entry Size 00:26:07.536 Max: 1 00:26:07.536 Min: 1 00:26:07.536 Completion Queue Entry Size 00:26:07.536 Max: 1 00:26:07.536 Min: 1 00:26:07.536 Number of Namespaces: 0 00:26:07.536 Compare Command: Not Supported 00:26:07.536 Write Uncorrectable Command: Not Supported 00:26:07.536 Dataset Management Command: Not Supported 00:26:07.536 Write Zeroes Command: Not Supported 00:26:07.536 Set Features Save Field: Not Supported 00:26:07.536 Reservations: Not Supported 00:26:07.536 Timestamp: Not Supported 00:26:07.536 Copy: Not Supported 00:26:07.536 Volatile Write Cache: Not Present 00:26:07.536 Atomic Write Unit (Normal): 1 00:26:07.536 Atomic Write Unit (PFail): 1 00:26:07.536 Atomic Compare & Write Unit: 1 00:26:07.536 Fused Compare & Write: Supported 00:26:07.536 Scatter-Gather List 00:26:07.536 SGL Command Set: Supported 00:26:07.536 SGL Keyed: Supported 00:26:07.536 SGL Bit Bucket Descriptor: Not Supported 00:26:07.536 SGL Metadata Pointer: Not Supported 00:26:07.536 Oversized SGL: Not Supported 00:26:07.536 SGL Metadata Address: Not Supported 00:26:07.536 SGL Offset: Supported 00:26:07.536 Transport SGL Data Block: Not Supported 00:26:07.536 Replay Protected Memory Block: Not Supported 00:26:07.536 00:26:07.536 Firmware Slot Information 00:26:07.536 ========================= 00:26:07.536 Active slot: 0 00:26:07.536 00:26:07.536 00:26:07.536 Error Log 00:26:07.536 ========= 00:26:07.536 00:26:07.536 Active Namespaces 00:26:07.536 ================= 00:26:07.536 Discovery Log Page 00:26:07.536 ================== 00:26:07.536 Generation Counter: 2 00:26:07.536 Number of Records: 2 00:26:07.536 Record Format: 0 00:26:07.536 00:26:07.536 Discovery Log Entry 0 00:26:07.536 ---------------------- 00:26:07.536 Transport Type: 3 (TCP) 00:26:07.536 Address Family: 1 (IPv4) 00:26:07.536 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:07.536 Entry Flags: 00:26:07.536 Duplicate Returned Information: 1 00:26:07.536 Explicit Persistent Connection Support for Discovery: 1 00:26:07.536 Transport Requirements: 00:26:07.536 Secure Channel: Not Required 00:26:07.536 Port ID: 0 (0x0000) 00:26:07.536 Controller ID: 65535 (0xffff) 00:26:07.536 Admin Max SQ Size: 128 00:26:07.536 Transport Service Identifier: 4420 00:26:07.536 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:07.536 Transport Address: 10.0.0.2 00:26:07.536 Discovery Log Entry 1 00:26:07.536 ---------------------- 00:26:07.536 Transport Type: 3 (TCP) 00:26:07.536 Address Family: 1 (IPv4) 00:26:07.536 Subsystem Type: 2 (NVM Subsystem) 00:26:07.536 Entry Flags: 00:26:07.536 Duplicate Returned Information: 0 00:26:07.536 Explicit Persistent Connection Support for Discovery: 0 00:26:07.536 Transport Requirements: 00:26:07.536 Secure Channel: Not Required 00:26:07.536 Port ID: 0 (0x0000) 00:26:07.536 Controller ID: 65535 (0xffff) 00:26:07.536 Admin Max SQ Size: 128 00:26:07.536 Transport Service Identifier: 4420 00:26:07.536 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:07.536 Transport Address: 10.0.0.2 [2024-11-29 13:59:47.780627] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:07.536 [2024-11-29 13:59:47.780655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.536 [2024-11-29 13:59:47.780667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.536 [2024-11-29 13:59:47.780677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.536 [2024-11-29 13:59:47.780686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.536 [2024-11-29 13:59:47.780704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.780713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.780719] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.536 [2024-11-29 13:59:47.780730] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.536 [2024-11-29 13:59:47.780771] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.536 [2024-11-29 13:59:47.780880] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.536 [2024-11-29 13:59:47.780896] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.536 [2024-11-29 13:59:47.780903] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.780910] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.536 [2024-11-29 13:59:47.780923] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.780931] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.780938] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.536 [2024-11-29 13:59:47.780949] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.536 [2024-11-29 13:59:47.780975] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.536 [2024-11-29 13:59:47.781108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.536 [2024-11-29 13:59:47.781120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.536 [2024-11-29 13:59:47.781127] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.781133] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.536 [2024-11-29 13:59:47.781143] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:07.536 [2024-11-29 13:59:47.781152] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:07.536 [2024-11-29 13:59:47.781168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.781177] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.781183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.536 [2024-11-29 13:59:47.781194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.536 [2024-11-29 13:59:47.781214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.536 [2024-11-29 13:59:47.781315] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.536 [2024-11-29 13:59:47.781327] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.536 [2024-11-29 13:59:47.781334] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.781340] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.536 [2024-11-29 13:59:47.781358] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.536 [2024-11-29 13:59:47.781367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781374] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.781384] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.781416] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.781509] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.781529] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.781537] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781543] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.781561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781571] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.781588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.781608] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.781694] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.781709] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.781716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781722] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.781740] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781750] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781756] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.781767] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.781787] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.781873] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.781888] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.781895] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781901] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.781918] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781928] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.781935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.781945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.781965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.782056] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.782069] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.782076] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782082] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.782099] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782109] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782115] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.782126] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.782146] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.782228] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.782240] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.782250] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782258] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.782275] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782284] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.782291] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.782301] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.782322] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.786403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.786420] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.786427] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.786434] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.786467] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.786478] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.786484] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2297420) 00:26:07.537 [2024-11-29 13:59:47.786495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.537 [2024-11-29 13:59:47.786517] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22fcf20, cid 3, qid 0 00:26:07.537 [2024-11-29 13:59:47.786610] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.537 [2024-11-29 13:59:47.786622] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.537 [2024-11-29 13:59:47.786629] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.537 [2024-11-29 13:59:47.786635] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22fcf20) on tqpair=0x2297420 00:26:07.537 [2024-11-29 13:59:47.786650] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:26:07.537 00:26:07.537 13:59:47 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:07.800 [2024-11-29 13:59:47.821207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:07.800 [2024-11-29 13:59:47.821253] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2386777 ] 00:26:07.800 EAL: No free 2048 kB hugepages reported on node 1 00:26:07.800 [2024-11-29 13:59:47.856111] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:07.800 [2024-11-29 13:59:47.856163] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:07.800 [2024-11-29 13:59:47.856173] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:07.800 [2024-11-29 13:59:47.856189] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:07.800 [2024-11-29 13:59:47.856200] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:07.800 [2024-11-29 13:59:47.856437] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:07.800 [2024-11-29 13:59:47.856485] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1f5d420 0 00:26:07.800 [2024-11-29 13:59:47.863411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:07.800 [2024-11-29 13:59:47.863430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:07.800 [2024-11-29 13:59:47.863438] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:07.800 [2024-11-29 13:59:47.863444] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:07.800 [2024-11-29 13:59:47.863482] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.800 [2024-11-29 13:59:47.863495] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.863502] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.863516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:07.801 [2024-11-29 13:59:47.863542] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.871412] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.871429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.871436] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.871461] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:07.801 [2024-11-29 13:59:47.871472] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:07.801 [2024-11-29 13:59:47.871481] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:07.801 [2024-11-29 13:59:47.871497] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871506] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871512] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.871523] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.871546] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.871672] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.871684] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.871691] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871698] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.871707] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:07.801 [2024-11-29 13:59:47.871721] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:07.801 [2024-11-29 13:59:47.871733] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871741] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871747] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.871758] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.871779] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.871878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.871890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.871897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871907] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.871918] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:07.801 [2024-11-29 13:59:47.871933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.871946] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871953] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.871960] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.871970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.871990] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.872079] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.872094] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.872100] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872107] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.872117] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.872134] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872150] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.872160] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.872181] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.872267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.872281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.872288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872295] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.872303] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:07.801 [2024-11-29 13:59:47.872312] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.872325] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.872436] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:07.801 [2024-11-29 13:59:47.872445] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.872457] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872465] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872471] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.872482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.872503] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.872626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.872642] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.872649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872656] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.872665] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:07.801 [2024-11-29 13:59:47.872683] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872698] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.872709] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.872729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.872816] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.872830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.872837] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872843] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.872852] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:07.801 [2024-11-29 13:59:47.872861] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:07.801 [2024-11-29 13:59:47.872875] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:07.801 [2024-11-29 13:59:47.872894] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:07.801 [2024-11-29 13:59:47.872907] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.872922] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.801 [2024-11-29 13:59:47.872932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.801 [2024-11-29 13:59:47.872954] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.801 [2024-11-29 13:59:47.873092] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.801 [2024-11-29 13:59:47.873104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.801 [2024-11-29 13:59:47.873111] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.873117] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=4096, cccid=0 00:26:07.801 [2024-11-29 13:59:47.873125] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc2b00) on tqpair(0x1f5d420): expected_datao=0, payload_size=4096 00:26:07.801 [2024-11-29 13:59:47.873142] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.873150] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.913536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.801 [2024-11-29 13:59:47.913555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.801 [2024-11-29 13:59:47.913563] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.801 [2024-11-29 13:59:47.913570] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.801 [2024-11-29 13:59:47.913582] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:07.801 [2024-11-29 13:59:47.913595] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:07.801 [2024-11-29 13:59:47.913603] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:07.802 [2024-11-29 13:59:47.913610] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:07.802 [2024-11-29 13:59:47.913617] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:07.802 [2024-11-29 13:59:47.913625] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.913644] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.913658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913665] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913672] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.913683] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:07.802 [2024-11-29 13:59:47.913707] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.802 [2024-11-29 13:59:47.913796] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.802 [2024-11-29 13:59:47.913810] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.802 [2024-11-29 13:59:47.913817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913824] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2b00) on tqpair=0x1f5d420 00:26:07.802 [2024-11-29 13:59:47.913835] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913849] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.913859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.802 [2024-11-29 13:59:47.913869] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913883] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.913891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.802 [2024-11-29 13:59:47.913901] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.913922] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.802 [2024-11-29 13:59:47.913931] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.913944] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.913953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.802 [2024-11-29 13:59:47.913962] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.913980] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914013] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914027] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.914037] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.802 [2024-11-29 13:59:47.914073] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2b00, cid 0, qid 0 00:26:07.802 [2024-11-29 13:59:47.914084] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2c60, cid 1, qid 0 00:26:07.802 [2024-11-29 13:59:47.914091] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2dc0, cid 2, qid 0 00:26:07.802 [2024-11-29 13:59:47.914098] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.802 [2024-11-29 13:59:47.914105] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.802 [2024-11-29 13:59:47.914303] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.802 [2024-11-29 13:59:47.914316] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.802 [2024-11-29 13:59:47.914322] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914329] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.802 [2024-11-29 13:59:47.914338] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:07.802 [2024-11-29 13:59:47.914347] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914361] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914378] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914406] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914412] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.914423] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:07.802 [2024-11-29 13:59:47.914445] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.802 [2024-11-29 13:59:47.914571] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.802 [2024-11-29 13:59:47.914586] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.802 [2024-11-29 13:59:47.914593] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914599] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.802 [2024-11-29 13:59:47.914666] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914685] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.914700] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914708] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.914714] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.914724] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.802 [2024-11-29 13:59:47.914749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.802 [2024-11-29 13:59:47.914971] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.802 [2024-11-29 13:59:47.914986] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.802 [2024-11-29 13:59:47.914993] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915000] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=4096, cccid=4 00:26:07.802 [2024-11-29 13:59:47.915007] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc3080) on tqpair(0x1f5d420): expected_datao=0, payload_size=4096 00:26:07.802 [2024-11-29 13:59:47.915018] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915025] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915036] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.802 [2024-11-29 13:59:47.915046] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.802 [2024-11-29 13:59:47.915053] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915059] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.802 [2024-11-29 13:59:47.915083] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:07.802 [2024-11-29 13:59:47.915101] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.915119] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.915133] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915140] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.802 [2024-11-29 13:59:47.915157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.802 [2024-11-29 13:59:47.915178] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.802 [2024-11-29 13:59:47.915307] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.802 [2024-11-29 13:59:47.915322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.802 [2024-11-29 13:59:47.915329] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915335] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=4096, cccid=4 00:26:07.802 [2024-11-29 13:59:47.915342] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc3080) on tqpair(0x1f5d420): expected_datao=0, payload_size=4096 00:26:07.802 [2024-11-29 13:59:47.915353] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915360] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.915372] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.802 [2024-11-29 13:59:47.915381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.802 [2024-11-29 13:59:47.915388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.919406] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.802 [2024-11-29 13:59:47.919435] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.919456] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:07.802 [2024-11-29 13:59:47.919470] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.919478] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.802 [2024-11-29 13:59:47.919487] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.919498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.919520] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.803 [2024-11-29 13:59:47.919668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.803 [2024-11-29 13:59:47.919683] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.803 [2024-11-29 13:59:47.919690] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919696] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=4096, cccid=4 00:26:07.803 [2024-11-29 13:59:47.919704] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc3080) on tqpair(0x1f5d420): expected_datao=0, payload_size=4096 00:26:07.803 [2024-11-29 13:59:47.919714] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919722] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919733] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.919743] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.919749] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919755] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.919771] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919786] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919802] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919814] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919823] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919832] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:07.803 [2024-11-29 13:59:47.919840] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:07.803 [2024-11-29 13:59:47.919848] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:07.803 [2024-11-29 13:59:47.919867] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919882] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.919893] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.919904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919911] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.919917] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.919926] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.803 [2024-11-29 13:59:47.919966] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.803 [2024-11-29 13:59:47.919978] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc31e0, cid 5, qid 0 00:26:07.803 [2024-11-29 13:59:47.920169] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.920185] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.920191] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920198] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.920209] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.920219] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.920225] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920232] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc31e0) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.920249] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920258] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920265] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920275] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920296] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc31e0, cid 5, qid 0 00:26:07.803 [2024-11-29 13:59:47.920437] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.920452] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.920459] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920466] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc31e0) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.920483] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920492] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920499] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920509] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920530] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc31e0, cid 5, qid 0 00:26:07.803 [2024-11-29 13:59:47.920621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.920636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.920642] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920649] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc31e0) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.920666] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920675] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920682] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920692] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920713] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc31e0, cid 5, qid 0 00:26:07.803 [2024-11-29 13:59:47.920798] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.803 [2024-11-29 13:59:47.920810] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.803 [2024-11-29 13:59:47.920816] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc31e0) on tqpair=0x1f5d420 00:26:07.803 [2024-11-29 13:59:47.920842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920863] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920875] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920886] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920894] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920900] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920927] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920934] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.920954] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.920968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1f5d420) 00:26:07.803 [2024-11-29 13:59:47.920977] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.803 [2024-11-29 13:59:47.921014] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc31e0, cid 5, qid 0 00:26:07.803 [2024-11-29 13:59:47.921025] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3080, cid 4, qid 0 00:26:07.803 [2024-11-29 13:59:47.921032] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc3340, cid 6, qid 0 00:26:07.803 [2024-11-29 13:59:47.921040] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc34a0, cid 7, qid 0 00:26:07.803 [2024-11-29 13:59:47.921279] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.803 [2024-11-29 13:59:47.921291] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.803 [2024-11-29 13:59:47.921298] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921304] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=8192, cccid=5 00:26:07.803 [2024-11-29 13:59:47.921312] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc31e0) on tqpair(0x1f5d420): expected_datao=0, payload_size=8192 00:26:07.803 [2024-11-29 13:59:47.921352] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921362] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921371] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.803 [2024-11-29 13:59:47.921379] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.803 [2024-11-29 13:59:47.921386] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921399] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=512, cccid=4 00:26:07.803 [2024-11-29 13:59:47.921408] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc3080) on tqpair(0x1f5d420): expected_datao=0, payload_size=512 00:26:07.803 [2024-11-29 13:59:47.921418] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921424] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.803 [2024-11-29 13:59:47.921433] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.803 [2024-11-29 13:59:47.921441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.804 [2024-11-29 13:59:47.921451] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921458] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=512, cccid=6 00:26:07.804 [2024-11-29 13:59:47.921465] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc3340) on tqpair(0x1f5d420): expected_datao=0, payload_size=512 00:26:07.804 [2024-11-29 13:59:47.921475] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921482] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921490] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.804 [2024-11-29 13:59:47.921499] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.804 [2024-11-29 13:59:47.921505] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921511] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f5d420): datao=0, datal=4096, cccid=7 00:26:07.804 [2024-11-29 13:59:47.921518] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fc34a0) on tqpair(0x1f5d420): expected_datao=0, payload_size=4096 00:26:07.804 [2024-11-29 13:59:47.921528] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921535] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921547] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.804 [2024-11-29 13:59:47.921556] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.804 [2024-11-29 13:59:47.921562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc31e0) on tqpair=0x1f5d420 00:26:07.804 [2024-11-29 13:59:47.921589] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.804 [2024-11-29 13:59:47.921600] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.804 [2024-11-29 13:59:47.921607] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921613] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3080) on tqpair=0x1f5d420 00:26:07.804 [2024-11-29 13:59:47.921628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.804 [2024-11-29 13:59:47.921639] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.804 [2024-11-29 13:59:47.921646] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921652] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc3340) on tqpair=0x1f5d420 00:26:07.804 [2024-11-29 13:59:47.921678] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.804 [2024-11-29 13:59:47.921688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.804 [2024-11-29 13:59:47.921694] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.804 [2024-11-29 13:59:47.921701] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc34a0) on tqpair=0x1f5d420 00:26:07.804 ===================================================== 00:26:07.804 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:07.804 ===================================================== 00:26:07.804 Controller Capabilities/Features 00:26:07.804 ================================ 00:26:07.804 Vendor ID: 8086 00:26:07.804 Subsystem Vendor ID: 8086 00:26:07.804 Serial Number: SPDK00000000000001 00:26:07.804 Model Number: SPDK bdev Controller 00:26:07.804 Firmware Version: 24.01.1 00:26:07.804 Recommended Arb Burst: 6 00:26:07.804 IEEE OUI Identifier: e4 d2 5c 00:26:07.804 Multi-path I/O 00:26:07.804 May have multiple subsystem ports: Yes 00:26:07.804 May have multiple controllers: Yes 00:26:07.804 Associated with SR-IOV VF: No 00:26:07.804 Max Data Transfer Size: 131072 00:26:07.804 Max Number of Namespaces: 32 00:26:07.804 Max Number of I/O Queues: 127 00:26:07.804 NVMe Specification Version (VS): 1.3 00:26:07.804 NVMe Specification Version (Identify): 1.3 00:26:07.804 Maximum Queue Entries: 128 00:26:07.804 Contiguous Queues Required: Yes 00:26:07.804 Arbitration Mechanisms Supported 00:26:07.804 Weighted Round Robin: Not Supported 00:26:07.804 Vendor Specific: Not Supported 00:26:07.804 Reset Timeout: 15000 ms 00:26:07.804 Doorbell Stride: 4 bytes 00:26:07.804 NVM Subsystem Reset: Not Supported 00:26:07.804 Command Sets Supported 00:26:07.804 NVM Command Set: Supported 00:26:07.804 Boot Partition: Not Supported 00:26:07.804 Memory Page Size Minimum: 4096 bytes 00:26:07.804 Memory Page Size Maximum: 4096 bytes 00:26:07.804 Persistent Memory Region: Not Supported 00:26:07.804 Optional Asynchronous Events Supported 00:26:07.804 Namespace Attribute Notices: Supported 00:26:07.804 Firmware Activation Notices: Not Supported 00:26:07.804 ANA Change Notices: Not Supported 00:26:07.804 PLE Aggregate Log Change Notices: Not Supported 00:26:07.804 LBA Status Info Alert Notices: Not Supported 00:26:07.804 EGE Aggregate Log Change Notices: Not Supported 00:26:07.804 Normal NVM Subsystem Shutdown event: Not Supported 00:26:07.804 Zone Descriptor Change Notices: Not Supported 00:26:07.804 Discovery Log Change Notices: Not Supported 00:26:07.804 Controller Attributes 00:26:07.804 128-bit Host Identifier: Supported 00:26:07.804 Non-Operational Permissive Mode: Not Supported 00:26:07.804 NVM Sets: Not Supported 00:26:07.804 Read Recovery Levels: Not Supported 00:26:07.804 Endurance Groups: Not Supported 00:26:07.804 Predictable Latency Mode: Not Supported 00:26:07.804 Traffic Based Keep ALive: Not Supported 00:26:07.804 Namespace Granularity: Not Supported 00:26:07.804 SQ Associations: Not Supported 00:26:07.804 UUID List: Not Supported 00:26:07.804 Multi-Domain Subsystem: Not Supported 00:26:07.804 Fixed Capacity Management: Not Supported 00:26:07.804 Variable Capacity Management: Not Supported 00:26:07.804 Delete Endurance Group: Not Supported 00:26:07.804 Delete NVM Set: Not Supported 00:26:07.804 Extended LBA Formats Supported: Not Supported 00:26:07.804 Flexible Data Placement Supported: Not Supported 00:26:07.804 00:26:07.804 Controller Memory Buffer Support 00:26:07.804 ================================ 00:26:07.804 Supported: No 00:26:07.804 00:26:07.804 Persistent Memory Region Support 00:26:07.804 ================================ 00:26:07.804 Supported: No 00:26:07.804 00:26:07.804 Admin Command Set Attributes 00:26:07.804 ============================ 00:26:07.804 Security Send/Receive: Not Supported 00:26:07.804 Format NVM: Not Supported 00:26:07.804 Firmware Activate/Download: Not Supported 00:26:07.804 Namespace Management: Not Supported 00:26:07.804 Device Self-Test: Not Supported 00:26:07.804 Directives: Not Supported 00:26:07.804 NVMe-MI: Not Supported 00:26:07.804 Virtualization Management: Not Supported 00:26:07.804 Doorbell Buffer Config: Not Supported 00:26:07.804 Get LBA Status Capability: Not Supported 00:26:07.804 Command & Feature Lockdown Capability: Not Supported 00:26:07.804 Abort Command Limit: 4 00:26:07.804 Async Event Request Limit: 4 00:26:07.804 Number of Firmware Slots: N/A 00:26:07.804 Firmware Slot 1 Read-Only: N/A 00:26:07.804 Firmware Activation Without Reset: N/A 00:26:07.804 Multiple Update Detection Support: N/A 00:26:07.804 Firmware Update Granularity: No Information Provided 00:26:07.804 Per-Namespace SMART Log: No 00:26:07.804 Asymmetric Namespace Access Log Page: Not Supported 00:26:07.804 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:07.804 Command Effects Log Page: Supported 00:26:07.804 Get Log Page Extended Data: Supported 00:26:07.804 Telemetry Log Pages: Not Supported 00:26:07.804 Persistent Event Log Pages: Not Supported 00:26:07.804 Supported Log Pages Log Page: May Support 00:26:07.804 Commands Supported & Effects Log Page: Not Supported 00:26:07.804 Feature Identifiers & Effects Log Page:May Support 00:26:07.804 NVMe-MI Commands & Effects Log Page: May Support 00:26:07.804 Data Area 4 for Telemetry Log: Not Supported 00:26:07.804 Error Log Page Entries Supported: 128 00:26:07.804 Keep Alive: Supported 00:26:07.804 Keep Alive Granularity: 10000 ms 00:26:07.804 00:26:07.804 NVM Command Set Attributes 00:26:07.804 ========================== 00:26:07.804 Submission Queue Entry Size 00:26:07.804 Max: 64 00:26:07.804 Min: 64 00:26:07.804 Completion Queue Entry Size 00:26:07.804 Max: 16 00:26:07.804 Min: 16 00:26:07.804 Number of Namespaces: 32 00:26:07.804 Compare Command: Supported 00:26:07.804 Write Uncorrectable Command: Not Supported 00:26:07.804 Dataset Management Command: Supported 00:26:07.804 Write Zeroes Command: Supported 00:26:07.804 Set Features Save Field: Not Supported 00:26:07.804 Reservations: Supported 00:26:07.804 Timestamp: Not Supported 00:26:07.804 Copy: Supported 00:26:07.804 Volatile Write Cache: Present 00:26:07.804 Atomic Write Unit (Normal): 1 00:26:07.804 Atomic Write Unit (PFail): 1 00:26:07.804 Atomic Compare & Write Unit: 1 00:26:07.804 Fused Compare & Write: Supported 00:26:07.804 Scatter-Gather List 00:26:07.804 SGL Command Set: Supported 00:26:07.804 SGL Keyed: Supported 00:26:07.804 SGL Bit Bucket Descriptor: Not Supported 00:26:07.804 SGL Metadata Pointer: Not Supported 00:26:07.804 Oversized SGL: Not Supported 00:26:07.804 SGL Metadata Address: Not Supported 00:26:07.804 SGL Offset: Supported 00:26:07.804 Transport SGL Data Block: Not Supported 00:26:07.804 Replay Protected Memory Block: Not Supported 00:26:07.804 00:26:07.804 Firmware Slot Information 00:26:07.804 ========================= 00:26:07.804 Active slot: 1 00:26:07.804 Slot 1 Firmware Revision: 24.01.1 00:26:07.804 00:26:07.804 00:26:07.804 Commands Supported and Effects 00:26:07.805 ============================== 00:26:07.805 Admin Commands 00:26:07.805 -------------- 00:26:07.805 Get Log Page (02h): Supported 00:26:07.805 Identify (06h): Supported 00:26:07.805 Abort (08h): Supported 00:26:07.805 Set Features (09h): Supported 00:26:07.805 Get Features (0Ah): Supported 00:26:07.805 Asynchronous Event Request (0Ch): Supported 00:26:07.805 Keep Alive (18h): Supported 00:26:07.805 I/O Commands 00:26:07.805 ------------ 00:26:07.805 Flush (00h): Supported LBA-Change 00:26:07.805 Write (01h): Supported LBA-Change 00:26:07.805 Read (02h): Supported 00:26:07.805 Compare (05h): Supported 00:26:07.805 Write Zeroes (08h): Supported LBA-Change 00:26:07.805 Dataset Management (09h): Supported LBA-Change 00:26:07.805 Copy (19h): Supported LBA-Change 00:26:07.805 Unknown (79h): Supported LBA-Change 00:26:07.805 Unknown (7Ah): Supported 00:26:07.805 00:26:07.805 Error Log 00:26:07.805 ========= 00:26:07.805 00:26:07.805 Arbitration 00:26:07.805 =========== 00:26:07.805 Arbitration Burst: 1 00:26:07.805 00:26:07.805 Power Management 00:26:07.805 ================ 00:26:07.805 Number of Power States: 1 00:26:07.805 Current Power State: Power State #0 00:26:07.805 Power State #0: 00:26:07.805 Max Power: 0.00 W 00:26:07.805 Non-Operational State: Operational 00:26:07.805 Entry Latency: Not Reported 00:26:07.805 Exit Latency: Not Reported 00:26:07.805 Relative Read Throughput: 0 00:26:07.805 Relative Read Latency: 0 00:26:07.805 Relative Write Throughput: 0 00:26:07.805 Relative Write Latency: 0 00:26:07.805 Idle Power: Not Reported 00:26:07.805 Active Power: Not Reported 00:26:07.805 Non-Operational Permissive Mode: Not Supported 00:26:07.805 00:26:07.805 Health Information 00:26:07.805 ================== 00:26:07.805 Critical Warnings: 00:26:07.805 Available Spare Space: OK 00:26:07.805 Temperature: OK 00:26:07.805 Device Reliability: OK 00:26:07.805 Read Only: No 00:26:07.805 Volatile Memory Backup: OK 00:26:07.805 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:07.805 Temperature Threshold: [2024-11-29 13:59:47.921831] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.921843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.921850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.921860] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.921881] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc34a0, cid 7, qid 0 00:26:07.805 [2024-11-29 13:59:47.922081] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.922094] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.922101] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922108] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc34a0) on tqpair=0x1f5d420 00:26:07.805 [2024-11-29 13:59:47.922148] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:07.805 [2024-11-29 13:59:47.922173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.805 [2024-11-29 13:59:47.922186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.805 [2024-11-29 13:59:47.922196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.805 [2024-11-29 13:59:47.922206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.805 [2024-11-29 13:59:47.922218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922226] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.922243] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.922281] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.805 [2024-11-29 13:59:47.922467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.922481] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.922488] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.805 [2024-11-29 13:59:47.922506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922514] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922521] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.922531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.922558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.805 [2024-11-29 13:59:47.922670] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.922685] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.922692] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922698] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.805 [2024-11-29 13:59:47.922707] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:07.805 [2024-11-29 13:59:47.922715] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:07.805 [2024-11-29 13:59:47.922731] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922740] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922747] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.922757] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.922777] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.805 [2024-11-29 13:59:47.922868] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.922883] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.922889] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922896] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.805 [2024-11-29 13:59:47.922914] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922927] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.922935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.922945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.922966] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.805 [2024-11-29 13:59:47.923072] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.923087] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.923093] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.923100] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.805 [2024-11-29 13:59:47.923117] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.923127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.805 [2024-11-29 13:59:47.923134] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.805 [2024-11-29 13:59:47.923144] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.805 [2024-11-29 13:59:47.923164] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.805 [2024-11-29 13:59:47.923274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.805 [2024-11-29 13:59:47.923288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.805 [2024-11-29 13:59:47.923295] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.923301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.806 [2024-11-29 13:59:47.923319] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.923329] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.923335] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.806 [2024-11-29 13:59:47.923346] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.806 [2024-11-29 13:59:47.923366] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.806 [2024-11-29 13:59:47.927404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.806 [2024-11-29 13:59:47.927421] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.806 [2024-11-29 13:59:47.927428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.927434] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.806 [2024-11-29 13:59:47.927453] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.927463] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.927469] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f5d420) 00:26:07.806 [2024-11-29 13:59:47.927480] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.806 [2024-11-29 13:59:47.927501] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fc2f20, cid 3, qid 0 00:26:07.806 [2024-11-29 13:59:47.927628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.806 [2024-11-29 13:59:47.927643] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.806 [2024-11-29 13:59:47.927650] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.806 [2024-11-29 13:59:47.927656] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fc2f20) on tqpair=0x1f5d420 00:26:07.806 [2024-11-29 13:59:47.927671] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:26:07.806 0 Kelvin (-273 Celsius) 00:26:07.806 Available Spare: 0% 00:26:07.806 Available Spare Threshold: 0% 00:26:07.806 Life Percentage Used: 0% 00:26:07.806 Data Units Read: 0 00:26:07.806 Data Units Written: 0 00:26:07.806 Host Read Commands: 0 00:26:07.806 Host Write Commands: 0 00:26:07.806 Controller Busy Time: 0 minutes 00:26:07.806 Power Cycles: 0 00:26:07.806 Power On Hours: 0 hours 00:26:07.806 Unsafe Shutdowns: 0 00:26:07.806 Unrecoverable Media Errors: 0 00:26:07.806 Lifetime Error Log Entries: 0 00:26:07.806 Warning Temperature Time: 0 minutes 00:26:07.806 Critical Temperature Time: 0 minutes 00:26:07.806 00:26:07.806 Number of Queues 00:26:07.806 ================ 00:26:07.806 Number of I/O Submission Queues: 127 00:26:07.806 Number of I/O Completion Queues: 127 00:26:07.806 00:26:07.806 Active Namespaces 00:26:07.806 ================= 00:26:07.806 Namespace ID:1 00:26:07.806 Error Recovery Timeout: Unlimited 00:26:07.806 Command Set Identifier: NVM (00h) 00:26:07.806 Deallocate: Supported 00:26:07.806 Deallocated/Unwritten Error: Not Supported 00:26:07.806 Deallocated Read Value: Unknown 00:26:07.806 Deallocate in Write Zeroes: Not Supported 00:26:07.806 Deallocated Guard Field: 0xFFFF 00:26:07.806 Flush: Supported 00:26:07.806 Reservation: Supported 00:26:07.806 Namespace Sharing Capabilities: Multiple Controllers 00:26:07.806 Size (in LBAs): 131072 (0GiB) 00:26:07.806 Capacity (in LBAs): 131072 (0GiB) 00:26:07.806 Utilization (in LBAs): 131072 (0GiB) 00:26:07.806 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:07.806 EUI64: ABCDEF0123456789 00:26:07.806 UUID: 62ddac7d-11b5-43cf-87dd-958735492181 00:26:07.806 Thin Provisioning: Not Supported 00:26:07.806 Per-NS Atomic Units: Yes 00:26:07.806 Atomic Boundary Size (Normal): 0 00:26:07.806 Atomic Boundary Size (PFail): 0 00:26:07.806 Atomic Boundary Offset: 0 00:26:07.806 Maximum Single Source Range Length: 65535 00:26:07.806 Maximum Copy Length: 65535 00:26:07.806 Maximum Source Range Count: 1 00:26:07.806 NGUID/EUI64 Never Reused: No 00:26:07.806 Namespace Write Protected: No 00:26:07.806 Number of LBA Formats: 1 00:26:07.806 Current LBA Format: LBA Format #00 00:26:07.806 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:07.806 00:26:07.806 13:59:47 -- host/identify.sh@51 -- # sync 00:26:07.806 13:59:47 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:07.806 13:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.806 13:59:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.806 13:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.806 13:59:47 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:07.806 13:59:47 -- host/identify.sh@56 -- # nvmftestfini 00:26:07.806 13:59:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:07.806 13:59:47 -- nvmf/common.sh@116 -- # sync 00:26:07.806 13:59:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:07.806 13:59:47 -- nvmf/common.sh@119 -- # set +e 00:26:07.806 13:59:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:07.806 13:59:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:07.806 rmmod nvme_tcp 00:26:07.806 rmmod nvme_fabrics 00:26:07.806 rmmod nvme_keyring 00:26:07.806 13:59:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:07.806 13:59:47 -- nvmf/common.sh@123 -- # set -e 00:26:07.806 13:59:47 -- nvmf/common.sh@124 -- # return 0 00:26:07.806 13:59:47 -- nvmf/common.sh@477 -- # '[' -n 2386607 ']' 00:26:07.806 13:59:47 -- nvmf/common.sh@478 -- # killprocess 2386607 00:26:07.806 13:59:47 -- common/autotest_common.sh@936 -- # '[' -z 2386607 ']' 00:26:07.806 13:59:47 -- common/autotest_common.sh@940 -- # kill -0 2386607 00:26:07.806 13:59:47 -- common/autotest_common.sh@941 -- # uname 00:26:07.806 13:59:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:07.806 13:59:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2386607 00:26:07.806 13:59:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:07.806 13:59:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:07.806 13:59:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2386607' 00:26:07.806 killing process with pid 2386607 00:26:07.806 13:59:48 -- common/autotest_common.sh@955 -- # kill 2386607 00:26:07.806 [2024-11-29 13:59:48.037333] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:07.806 13:59:48 -- common/autotest_common.sh@960 -- # wait 2386607 00:26:08.065 13:59:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:08.065 13:59:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:08.065 13:59:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:08.065 13:59:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:08.065 13:59:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:08.065 13:59:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.065 13:59:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.065 13:59:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.603 13:59:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.603 00:26:10.603 real 0m6.231s 00:26:10.603 user 0m7.423s 00:26:10.603 sys 0m1.989s 00:26:10.603 13:59:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:10.603 13:59:50 -- common/autotest_common.sh@10 -- # set +x 00:26:10.603 ************************************ 00:26:10.603 END TEST nvmf_identify 00:26:10.603 ************************************ 00:26:10.603 13:59:50 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:10.603 13:59:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:10.603 13:59:50 -- common/autotest_common.sh@10 -- # set +x 00:26:10.603 ************************************ 00:26:10.603 START TEST nvmf_perf 00:26:10.603 ************************************ 00:26:10.603 13:59:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:10.603 * Looking for test storage... 00:26:10.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:10.603 13:59:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:10.603 13:59:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:10.603 13:59:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:10.603 13:59:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:10.603 13:59:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:10.603 13:59:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:10.603 13:59:50 -- scripts/common.sh@335 -- # IFS=.-: 00:26:10.603 13:59:50 -- scripts/common.sh@335 -- # read -ra ver1 00:26:10.603 13:59:50 -- scripts/common.sh@336 -- # IFS=.-: 00:26:10.603 13:59:50 -- scripts/common.sh@336 -- # read -ra ver2 00:26:10.603 13:59:50 -- scripts/common.sh@337 -- # local 'op=<' 00:26:10.603 13:59:50 -- scripts/common.sh@339 -- # ver1_l=2 00:26:10.603 13:59:50 -- scripts/common.sh@340 -- # ver2_l=1 00:26:10.603 13:59:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:10.603 13:59:50 -- scripts/common.sh@343 -- # case "$op" in 00:26:10.603 13:59:50 -- scripts/common.sh@344 -- # : 1 00:26:10.603 13:59:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:10.603 13:59:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:10.603 13:59:50 -- scripts/common.sh@364 -- # decimal 1 00:26:10.603 13:59:50 -- scripts/common.sh@352 -- # local d=1 00:26:10.603 13:59:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:10.603 13:59:50 -- scripts/common.sh@354 -- # echo 1 00:26:10.603 13:59:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:10.603 13:59:50 -- scripts/common.sh@365 -- # decimal 2 00:26:10.603 13:59:50 -- scripts/common.sh@352 -- # local d=2 00:26:10.603 13:59:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:10.603 13:59:50 -- scripts/common.sh@354 -- # echo 2 00:26:10.603 13:59:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:10.603 13:59:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:10.603 13:59:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:10.603 13:59:50 -- scripts/common.sh@367 -- # return 0 00:26:10.603 13:59:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:10.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.603 --rc genhtml_branch_coverage=1 00:26:10.603 --rc genhtml_function_coverage=1 00:26:10.603 --rc genhtml_legend=1 00:26:10.603 --rc geninfo_all_blocks=1 00:26:10.603 --rc geninfo_unexecuted_blocks=1 00:26:10.603 00:26:10.603 ' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:10.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.603 --rc genhtml_branch_coverage=1 00:26:10.603 --rc genhtml_function_coverage=1 00:26:10.603 --rc genhtml_legend=1 00:26:10.603 --rc geninfo_all_blocks=1 00:26:10.603 --rc geninfo_unexecuted_blocks=1 00:26:10.603 00:26:10.603 ' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:10.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.603 --rc genhtml_branch_coverage=1 00:26:10.603 --rc genhtml_function_coverage=1 00:26:10.603 --rc genhtml_legend=1 00:26:10.603 --rc geninfo_all_blocks=1 00:26:10.603 --rc geninfo_unexecuted_blocks=1 00:26:10.603 00:26:10.603 ' 00:26:10.603 13:59:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:10.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.603 --rc genhtml_branch_coverage=1 00:26:10.603 --rc genhtml_function_coverage=1 00:26:10.603 --rc genhtml_legend=1 00:26:10.603 --rc geninfo_all_blocks=1 00:26:10.603 --rc geninfo_unexecuted_blocks=1 00:26:10.603 00:26:10.603 ' 00:26:10.603 13:59:50 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:10.603 13:59:50 -- nvmf/common.sh@7 -- # uname -s 00:26:10.603 13:59:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:10.603 13:59:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:10.603 13:59:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:10.603 13:59:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:10.603 13:59:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:10.603 13:59:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:10.603 13:59:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:10.603 13:59:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:10.603 13:59:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:10.603 13:59:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:10.603 13:59:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.603 13:59:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.603 13:59:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:10.603 13:59:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:10.603 13:59:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:10.603 13:59:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:10.603 13:59:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:10.603 13:59:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:10.603 13:59:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:10.604 13:59:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.604 13:59:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.604 13:59:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.604 13:59:50 -- paths/export.sh@5 -- # export PATH 00:26:10.604 13:59:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.604 13:59:50 -- nvmf/common.sh@46 -- # : 0 00:26:10.604 13:59:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:10.604 13:59:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:10.604 13:59:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:10.604 13:59:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:10.604 13:59:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:10.604 13:59:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:10.604 13:59:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:10.604 13:59:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:10.604 13:59:50 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:10.604 13:59:50 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:10.604 13:59:50 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:10.604 13:59:50 -- host/perf.sh@17 -- # nvmftestinit 00:26:10.604 13:59:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:10.604 13:59:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:10.604 13:59:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:10.604 13:59:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:10.604 13:59:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:10.604 13:59:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:10.604 13:59:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:10.604 13:59:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.604 13:59:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:10.604 13:59:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:10.604 13:59:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:10.604 13:59:50 -- common/autotest_common.sh@10 -- # set +x 00:26:12.504 13:59:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:12.504 13:59:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:12.504 13:59:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:12.504 13:59:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:12.504 13:59:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:12.504 13:59:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:12.504 13:59:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:12.504 13:59:52 -- nvmf/common.sh@294 -- # net_devs=() 00:26:12.504 13:59:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:12.504 13:59:52 -- nvmf/common.sh@295 -- # e810=() 00:26:12.504 13:59:52 -- nvmf/common.sh@295 -- # local -ga e810 00:26:12.504 13:59:52 -- nvmf/common.sh@296 -- # x722=() 00:26:12.504 13:59:52 -- nvmf/common.sh@296 -- # local -ga x722 00:26:12.504 13:59:52 -- nvmf/common.sh@297 -- # mlx=() 00:26:12.504 13:59:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:12.504 13:59:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:12.504 13:59:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:12.504 13:59:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:12.504 13:59:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:12.504 13:59:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.504 13:59:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:12.504 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:12.504 13:59:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.504 13:59:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:12.504 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:12.504 13:59:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:12.504 13:59:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:12.504 13:59:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.504 13:59:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.504 13:59:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.504 13:59:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.504 13:59:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:12.505 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:12.505 13:59:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.505 13:59:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.505 13:59:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.505 13:59:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.505 13:59:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.505 13:59:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:12.505 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:12.505 13:59:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.505 13:59:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:12.505 13:59:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:12.505 13:59:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:12.505 13:59:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:12.505 13:59:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:12.505 13:59:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:12.505 13:59:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:12.505 13:59:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:12.505 13:59:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:12.505 13:59:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:12.505 13:59:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:12.505 13:59:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:12.505 13:59:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:12.505 13:59:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:12.505 13:59:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:12.505 13:59:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:12.505 13:59:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:12.505 13:59:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:12.505 13:59:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:12.505 13:59:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:12.505 13:59:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:12.505 13:59:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:12.815 13:59:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:12.815 13:59:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:12.815 13:59:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:12.815 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:12.815 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.112 ms 00:26:12.815 00:26:12.815 --- 10.0.0.2 ping statistics --- 00:26:12.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.815 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:26:12.815 13:59:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:12.815 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:12.815 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:26:12.815 00:26:12.815 --- 10.0.0.1 ping statistics --- 00:26:12.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.815 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:26:12.815 13:59:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:12.815 13:59:52 -- nvmf/common.sh@410 -- # return 0 00:26:12.815 13:59:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:12.815 13:59:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:12.815 13:59:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:12.815 13:59:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:12.815 13:59:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:12.815 13:59:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:12.815 13:59:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:12.815 13:59:52 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:12.816 13:59:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:12.816 13:59:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:12.816 13:59:52 -- common/autotest_common.sh@10 -- # set +x 00:26:12.816 13:59:52 -- nvmf/common.sh@469 -- # nvmfpid=2388815 00:26:12.816 13:59:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:12.816 13:59:52 -- nvmf/common.sh@470 -- # waitforlisten 2388815 00:26:12.816 13:59:52 -- common/autotest_common.sh@829 -- # '[' -z 2388815 ']' 00:26:12.816 13:59:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:12.816 13:59:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:12.816 13:59:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:12.816 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:12.816 13:59:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:12.816 13:59:52 -- common/autotest_common.sh@10 -- # set +x 00:26:12.816 [2024-11-29 13:59:52.880252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:12.816 [2024-11-29 13:59:52.880323] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:12.816 EAL: No free 2048 kB hugepages reported on node 1 00:26:12.816 [2024-11-29 13:59:52.948460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:12.816 [2024-11-29 13:59:53.037819] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:12.816 [2024-11-29 13:59:53.037982] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:12.816 [2024-11-29 13:59:53.038002] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:12.816 [2024-11-29 13:59:53.038016] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:12.816 [2024-11-29 13:59:53.038075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:12.816 [2024-11-29 13:59:53.038146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:12.816 [2024-11-29 13:59:53.038245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:12.816 [2024-11-29 13:59:53.038248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:13.747 13:59:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:13.747 13:59:53 -- common/autotest_common.sh@862 -- # return 0 00:26:13.747 13:59:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:13.747 13:59:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:13.747 13:59:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.747 13:59:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:13.747 13:59:53 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:13.747 13:59:53 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:17.023 13:59:57 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:17.023 13:59:57 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:17.023 13:59:57 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:17.023 13:59:57 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:17.589 13:59:57 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:17.589 13:59:57 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:17.589 13:59:57 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:17.589 13:59:57 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:17.589 13:59:57 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:17.589 [2024-11-29 13:59:57.815117] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:17.589 13:59:57 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:17.847 13:59:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:17.847 13:59:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:18.105 13:59:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:18.105 13:59:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:18.363 13:59:58 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:18.621 [2024-11-29 13:59:58.830921] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:18.621 13:59:58 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:18.879 13:59:59 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:18.879 13:59:59 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:18.879 13:59:59 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:18.879 13:59:59 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:20.252 Initializing NVMe Controllers 00:26:20.252 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:20.252 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:20.252 Initialization complete. Launching workers. 00:26:20.252 ======================================================== 00:26:20.252 Latency(us) 00:26:20.252 Device Information : IOPS MiB/s Average min max 00:26:20.252 PCIE (0000:88:00.0) NSID 1 from core 0: 85718.00 334.84 372.94 10.97 6747.33 00:26:20.252 ======================================================== 00:26:20.252 Total : 85718.00 334.84 372.94 10.97 6747.33 00:26:20.252 00:26:20.252 14:00:00 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:20.252 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.623 Initializing NVMe Controllers 00:26:21.623 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:21.623 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:21.623 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:21.623 Initialization complete. Launching workers. 00:26:21.623 ======================================================== 00:26:21.623 Latency(us) 00:26:21.623 Device Information : IOPS MiB/s Average min max 00:26:21.623 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 81.00 0.32 12648.67 142.82 44761.02 00:26:21.623 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 46.00 0.18 22596.03 5987.57 48896.19 00:26:21.623 ======================================================== 00:26:21.623 Total : 127.00 0.50 16251.65 142.82 48896.19 00:26:21.623 00:26:21.623 14:00:01 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:21.623 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.001 Initializing NVMe Controllers 00:26:23.001 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.001 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:23.001 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:23.001 Initialization complete. Launching workers. 00:26:23.001 ======================================================== 00:26:23.001 Latency(us) 00:26:23.001 Device Information : IOPS MiB/s Average min max 00:26:23.001 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8713.75 34.04 3684.71 594.50 8001.59 00:26:23.001 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3999.88 15.62 8047.88 5867.54 15273.14 00:26:23.001 ======================================================== 00:26:23.001 Total : 12713.63 49.66 5057.42 594.50 15273.14 00:26:23.001 00:26:23.001 14:00:02 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:23.001 14:00:02 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:23.001 14:00:02 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:23.001 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.547 Initializing NVMe Controllers 00:26:25.547 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:25.547 Controller IO queue size 128, less than required. 00:26:25.547 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.547 Controller IO queue size 128, less than required. 00:26:25.547 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:25.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:25.547 Initialization complete. Launching workers. 00:26:25.547 ======================================================== 00:26:25.547 Latency(us) 00:26:25.547 Device Information : IOPS MiB/s Average min max 00:26:25.547 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1612.49 403.12 81639.56 46330.63 136775.29 00:26:25.547 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 570.99 142.75 228259.84 85827.47 373632.63 00:26:25.547 ======================================================== 00:26:25.547 Total : 2183.48 545.87 119981.75 46330.63 373632.63 00:26:25.547 00:26:25.547 14:00:05 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:25.547 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.547 No valid NVMe controllers or AIO or URING devices found 00:26:25.547 Initializing NVMe Controllers 00:26:25.547 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:25.547 Controller IO queue size 128, less than required. 00:26:25.547 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.547 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:25.547 Controller IO queue size 128, less than required. 00:26:25.547 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.547 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:25.547 WARNING: Some requested NVMe devices were skipped 00:26:25.547 14:00:05 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:25.547 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.078 Initializing NVMe Controllers 00:26:28.078 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:28.078 Controller IO queue size 128, less than required. 00:26:28.078 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:28.078 Controller IO queue size 128, less than required. 00:26:28.078 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:28.078 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:28.078 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:28.078 Initialization complete. Launching workers. 00:26:28.078 00:26:28.078 ==================== 00:26:28.078 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:28.078 TCP transport: 00:26:28.078 polls: 10065 00:26:28.078 idle_polls: 6217 00:26:28.078 sock_completions: 3848 00:26:28.078 nvme_completions: 5392 00:26:28.078 submitted_requests: 8248 00:26:28.078 queued_requests: 1 00:26:28.078 00:26:28.078 ==================== 00:26:28.078 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:28.078 TCP transport: 00:26:28.078 polls: 13136 00:26:28.078 idle_polls: 9253 00:26:28.078 sock_completions: 3883 00:26:28.078 nvme_completions: 5955 00:26:28.078 submitted_requests: 9041 00:26:28.078 queued_requests: 1 00:26:28.078 ======================================================== 00:26:28.078 Latency(us) 00:26:28.078 Device Information : IOPS MiB/s Average min max 00:26:28.078 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1411.34 352.83 92758.57 57117.32 141332.21 00:26:28.078 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1551.82 387.95 83513.95 44107.44 126470.13 00:26:28.078 ======================================================== 00:26:28.078 Total : 2963.16 740.79 87917.12 44107.44 141332.21 00:26:28.078 00:26:28.078 14:00:08 -- host/perf.sh@66 -- # sync 00:26:28.078 14:00:08 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:28.337 14:00:08 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:28.337 14:00:08 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:28.337 14:00:08 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:32.519 14:00:11 -- host/perf.sh@72 -- # ls_guid=095230b7-49ba-4d34-9599-38300264d1fe 00:26:32.519 14:00:11 -- host/perf.sh@73 -- # get_lvs_free_mb 095230b7-49ba-4d34-9599-38300264d1fe 00:26:32.519 14:00:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=095230b7-49ba-4d34-9599-38300264d1fe 00:26:32.519 14:00:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:32.519 14:00:11 -- common/autotest_common.sh@1355 -- # local fc 00:26:32.519 14:00:11 -- common/autotest_common.sh@1356 -- # local cs 00:26:32.519 14:00:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:32.519 14:00:12 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:32.519 { 00:26:32.519 "uuid": "095230b7-49ba-4d34-9599-38300264d1fe", 00:26:32.519 "name": "lvs_0", 00:26:32.519 "base_bdev": "Nvme0n1", 00:26:32.519 "total_data_clusters": 238234, 00:26:32.519 "free_clusters": 238234, 00:26:32.519 "block_size": 512, 00:26:32.519 "cluster_size": 4194304 00:26:32.519 } 00:26:32.519 ]' 00:26:32.519 14:00:12 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="095230b7-49ba-4d34-9599-38300264d1fe") .free_clusters' 00:26:32.519 14:00:12 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:32.519 14:00:12 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="095230b7-49ba-4d34-9599-38300264d1fe") .cluster_size' 00:26:32.519 14:00:12 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:32.519 14:00:12 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:32.519 14:00:12 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:32.519 952936 00:26:32.519 14:00:12 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:32.519 14:00:12 -- host/perf.sh@78 -- # free_mb=20480 00:26:32.519 14:00:12 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 095230b7-49ba-4d34-9599-38300264d1fe lbd_0 20480 00:26:32.519 14:00:12 -- host/perf.sh@80 -- # lb_guid=ad5726fa-3819-4dbc-a82a-187323f2ebc7 00:26:32.519 14:00:12 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore ad5726fa-3819-4dbc-a82a-187323f2ebc7 lvs_n_0 00:26:33.166 14:00:13 -- host/perf.sh@83 -- # ls_nested_guid=31784eeb-0978-49b8-858d-9ccbd2aa54d9 00:26:33.166 14:00:13 -- host/perf.sh@84 -- # get_lvs_free_mb 31784eeb-0978-49b8-858d-9ccbd2aa54d9 00:26:33.166 14:00:13 -- common/autotest_common.sh@1353 -- # local lvs_uuid=31784eeb-0978-49b8-858d-9ccbd2aa54d9 00:26:33.166 14:00:13 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:33.166 14:00:13 -- common/autotest_common.sh@1355 -- # local fc 00:26:33.166 14:00:13 -- common/autotest_common.sh@1356 -- # local cs 00:26:33.166 14:00:13 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:33.423 14:00:13 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:33.423 { 00:26:33.423 "uuid": "095230b7-49ba-4d34-9599-38300264d1fe", 00:26:33.423 "name": "lvs_0", 00:26:33.423 "base_bdev": "Nvme0n1", 00:26:33.424 "total_data_clusters": 238234, 00:26:33.424 "free_clusters": 233114, 00:26:33.424 "block_size": 512, 00:26:33.424 "cluster_size": 4194304 00:26:33.424 }, 00:26:33.424 { 00:26:33.424 "uuid": "31784eeb-0978-49b8-858d-9ccbd2aa54d9", 00:26:33.424 "name": "lvs_n_0", 00:26:33.424 "base_bdev": "ad5726fa-3819-4dbc-a82a-187323f2ebc7", 00:26:33.424 "total_data_clusters": 5114, 00:26:33.424 "free_clusters": 5114, 00:26:33.424 "block_size": 512, 00:26:33.424 "cluster_size": 4194304 00:26:33.424 } 00:26:33.424 ]' 00:26:33.424 14:00:13 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="31784eeb-0978-49b8-858d-9ccbd2aa54d9") .free_clusters' 00:26:33.681 14:00:13 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:33.681 14:00:13 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="31784eeb-0978-49b8-858d-9ccbd2aa54d9") .cluster_size' 00:26:33.681 14:00:13 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:33.681 14:00:13 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:33.681 14:00:13 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:33.681 20456 00:26:33.681 14:00:13 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:33.681 14:00:13 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 31784eeb-0978-49b8-858d-9ccbd2aa54d9 lbd_nest_0 20456 00:26:33.959 14:00:14 -- host/perf.sh@88 -- # lb_nested_guid=adfb1187-ed1a-4cc0-bd60-b2478b293022 00:26:33.959 14:00:14 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:34.215 14:00:14 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:34.215 14:00:14 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 adfb1187-ed1a-4cc0-bd60-b2478b293022 00:26:34.472 14:00:14 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:34.729 14:00:14 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:34.729 14:00:14 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:34.729 14:00:14 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:34.729 14:00:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:34.729 14:00:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:34.729 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.960 Initializing NVMe Controllers 00:26:46.960 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:46.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:46.960 Initialization complete. Launching workers. 00:26:46.960 ======================================================== 00:26:46.960 Latency(us) 00:26:46.960 Device Information : IOPS MiB/s Average min max 00:26:46.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 51.00 0.02 19669.14 193.76 46263.21 00:26:46.960 ======================================================== 00:26:46.960 Total : 51.00 0.02 19669.14 193.76 46263.21 00:26:46.960 00:26:46.960 14:00:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:46.960 14:00:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:46.960 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.921 Initializing NVMe Controllers 00:26:56.921 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:56.921 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:56.921 Initialization complete. Launching workers. 00:26:56.921 ======================================================== 00:26:56.921 Latency(us) 00:26:56.921 Device Information : IOPS MiB/s Average min max 00:26:56.921 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.78 9.72 12866.45 5073.34 49839.04 00:26:56.921 ======================================================== 00:26:56.921 Total : 77.78 9.72 12866.45 5073.34 49839.04 00:26:56.921 00:26:56.921 14:00:35 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:56.921 14:00:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:56.921 14:00:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.921 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.891 Initializing NVMe Controllers 00:27:06.891 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.891 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.891 Initialization complete. Launching workers. 00:27:06.891 ======================================================== 00:27:06.891 Latency(us) 00:27:06.891 Device Information : IOPS MiB/s Average min max 00:27:06.891 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7740.76 3.78 4134.17 282.35 11703.64 00:27:06.891 ======================================================== 00:27:06.891 Total : 7740.76 3.78 4134.17 282.35 11703.64 00:27:06.891 00:27:06.891 14:00:45 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:06.891 14:00:45 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:06.891 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.968 Initializing NVMe Controllers 00:27:16.968 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:16.968 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:16.968 Initialization complete. Launching workers. 00:27:16.968 ======================================================== 00:27:16.968 Latency(us) 00:27:16.968 Device Information : IOPS MiB/s Average min max 00:27:16.968 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4066.08 508.26 7874.24 671.55 18191.37 00:27:16.968 ======================================================== 00:27:16.968 Total : 4066.08 508.26 7874.24 671.55 18191.37 00:27:16.968 00:27:16.968 14:00:56 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:16.968 14:00:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:16.968 14:00:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:16.968 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.944 Initializing NVMe Controllers 00:27:26.944 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.944 Controller IO queue size 128, less than required. 00:27:26.944 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:26.944 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.944 Initialization complete. Launching workers. 00:27:26.944 ======================================================== 00:27:26.944 Latency(us) 00:27:26.944 Device Information : IOPS MiB/s Average min max 00:27:26.944 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12018.37 5.87 10659.25 1779.01 47065.11 00:27:26.944 ======================================================== 00:27:26.944 Total : 12018.37 5.87 10659.25 1779.01 47065.11 00:27:26.944 00:27:26.944 14:01:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:26.944 14:01:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:26.944 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.909 Initializing NVMe Controllers 00:27:36.909 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:36.909 Controller IO queue size 128, less than required. 00:27:36.909 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:36.909 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:36.909 Initialization complete. Launching workers. 00:27:36.909 ======================================================== 00:27:36.909 Latency(us) 00:27:36.909 Device Information : IOPS MiB/s Average min max 00:27:36.909 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1196.98 149.62 107412.79 16303.07 235490.02 00:27:36.909 ======================================================== 00:27:36.909 Total : 1196.98 149.62 107412.79 16303.07 235490.02 00:27:36.909 00:27:36.909 14:01:16 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:36.909 14:01:17 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete adfb1187-ed1a-4cc0-bd60-b2478b293022 00:27:37.841 14:01:17 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:38.098 14:01:18 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ad5726fa-3819-4dbc-a82a-187323f2ebc7 00:27:38.356 14:01:18 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:38.613 14:01:18 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:38.613 14:01:18 -- host/perf.sh@114 -- # nvmftestfini 00:27:38.613 14:01:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:38.613 14:01:18 -- nvmf/common.sh@116 -- # sync 00:27:38.613 14:01:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:38.613 14:01:18 -- nvmf/common.sh@119 -- # set +e 00:27:38.613 14:01:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:38.613 14:01:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:38.613 rmmod nvme_tcp 00:27:38.613 rmmod nvme_fabrics 00:27:38.613 rmmod nvme_keyring 00:27:38.613 14:01:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:38.613 14:01:18 -- nvmf/common.sh@123 -- # set -e 00:27:38.613 14:01:18 -- nvmf/common.sh@124 -- # return 0 00:27:38.613 14:01:18 -- nvmf/common.sh@477 -- # '[' -n 2388815 ']' 00:27:38.613 14:01:18 -- nvmf/common.sh@478 -- # killprocess 2388815 00:27:38.613 14:01:18 -- common/autotest_common.sh@936 -- # '[' -z 2388815 ']' 00:27:38.613 14:01:18 -- common/autotest_common.sh@940 -- # kill -0 2388815 00:27:38.614 14:01:18 -- common/autotest_common.sh@941 -- # uname 00:27:38.614 14:01:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:38.614 14:01:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2388815 00:27:38.614 14:01:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:38.614 14:01:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:38.614 14:01:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2388815' 00:27:38.614 killing process with pid 2388815 00:27:38.614 14:01:18 -- common/autotest_common.sh@955 -- # kill 2388815 00:27:38.614 14:01:18 -- common/autotest_common.sh@960 -- # wait 2388815 00:27:40.512 14:01:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:40.512 14:01:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:40.512 14:01:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:40.512 14:01:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:40.512 14:01:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:40.512 14:01:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.512 14:01:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.512 14:01:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:42.417 14:01:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:42.417 00:27:42.417 real 1m32.080s 00:27:42.417 user 5m40.300s 00:27:42.417 sys 0m15.613s 00:27:42.417 14:01:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:42.417 14:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.417 ************************************ 00:27:42.417 END TEST nvmf_perf 00:27:42.417 ************************************ 00:27:42.417 14:01:22 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:42.417 14:01:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:42.417 14:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.417 ************************************ 00:27:42.417 START TEST nvmf_fio_host 00:27:42.417 ************************************ 00:27:42.417 14:01:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:42.417 * Looking for test storage... 00:27:42.417 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:42.417 14:01:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:42.417 14:01:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:42.417 14:01:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:42.417 14:01:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:42.417 14:01:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:42.417 14:01:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:42.417 14:01:22 -- scripts/common.sh@335 -- # IFS=.-: 00:27:42.417 14:01:22 -- scripts/common.sh@335 -- # read -ra ver1 00:27:42.417 14:01:22 -- scripts/common.sh@336 -- # IFS=.-: 00:27:42.417 14:01:22 -- scripts/common.sh@336 -- # read -ra ver2 00:27:42.417 14:01:22 -- scripts/common.sh@337 -- # local 'op=<' 00:27:42.417 14:01:22 -- scripts/common.sh@339 -- # ver1_l=2 00:27:42.417 14:01:22 -- scripts/common.sh@340 -- # ver2_l=1 00:27:42.417 14:01:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:42.417 14:01:22 -- scripts/common.sh@343 -- # case "$op" in 00:27:42.417 14:01:22 -- scripts/common.sh@344 -- # : 1 00:27:42.417 14:01:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:42.417 14:01:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:42.417 14:01:22 -- scripts/common.sh@364 -- # decimal 1 00:27:42.417 14:01:22 -- scripts/common.sh@352 -- # local d=1 00:27:42.417 14:01:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:42.417 14:01:22 -- scripts/common.sh@354 -- # echo 1 00:27:42.417 14:01:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:42.417 14:01:22 -- scripts/common.sh@365 -- # decimal 2 00:27:42.417 14:01:22 -- scripts/common.sh@352 -- # local d=2 00:27:42.417 14:01:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:42.417 14:01:22 -- scripts/common.sh@354 -- # echo 2 00:27:42.417 14:01:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:42.417 14:01:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:42.417 14:01:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:42.417 14:01:22 -- scripts/common.sh@367 -- # return 0 00:27:42.417 14:01:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:42.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.417 --rc genhtml_branch_coverage=1 00:27:42.417 --rc genhtml_function_coverage=1 00:27:42.417 --rc genhtml_legend=1 00:27:42.417 --rc geninfo_all_blocks=1 00:27:42.417 --rc geninfo_unexecuted_blocks=1 00:27:42.417 00:27:42.417 ' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:42.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.417 --rc genhtml_branch_coverage=1 00:27:42.417 --rc genhtml_function_coverage=1 00:27:42.417 --rc genhtml_legend=1 00:27:42.417 --rc geninfo_all_blocks=1 00:27:42.417 --rc geninfo_unexecuted_blocks=1 00:27:42.417 00:27:42.417 ' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:42.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.417 --rc genhtml_branch_coverage=1 00:27:42.417 --rc genhtml_function_coverage=1 00:27:42.417 --rc genhtml_legend=1 00:27:42.417 --rc geninfo_all_blocks=1 00:27:42.417 --rc geninfo_unexecuted_blocks=1 00:27:42.417 00:27:42.417 ' 00:27:42.417 14:01:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:42.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.417 --rc genhtml_branch_coverage=1 00:27:42.417 --rc genhtml_function_coverage=1 00:27:42.417 --rc genhtml_legend=1 00:27:42.417 --rc geninfo_all_blocks=1 00:27:42.417 --rc geninfo_unexecuted_blocks=1 00:27:42.417 00:27:42.417 ' 00:27:42.417 14:01:22 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:42.417 14:01:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:42.417 14:01:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:42.417 14:01:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:42.417 14:01:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.417 14:01:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.417 14:01:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.417 14:01:22 -- paths/export.sh@5 -- # export PATH 00:27:42.417 14:01:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.417 14:01:22 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:42.417 14:01:22 -- nvmf/common.sh@7 -- # uname -s 00:27:42.417 14:01:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:42.417 14:01:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:42.417 14:01:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:42.417 14:01:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:42.417 14:01:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:42.417 14:01:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:42.417 14:01:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:42.417 14:01:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:42.417 14:01:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:42.417 14:01:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:42.417 14:01:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:42.417 14:01:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:42.417 14:01:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:42.417 14:01:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:42.417 14:01:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:42.417 14:01:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:42.417 14:01:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:42.417 14:01:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:42.417 14:01:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:42.417 14:01:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.418 14:01:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.418 14:01:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.418 14:01:22 -- paths/export.sh@5 -- # export PATH 00:27:42.418 14:01:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.418 14:01:22 -- nvmf/common.sh@46 -- # : 0 00:27:42.418 14:01:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:42.418 14:01:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:42.418 14:01:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:42.418 14:01:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:42.418 14:01:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:42.418 14:01:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:42.418 14:01:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:42.418 14:01:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:42.418 14:01:22 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:42.418 14:01:22 -- host/fio.sh@14 -- # nvmftestinit 00:27:42.418 14:01:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:42.418 14:01:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:42.418 14:01:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:42.418 14:01:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:42.418 14:01:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:42.418 14:01:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:42.418 14:01:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:42.418 14:01:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:42.418 14:01:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:42.418 14:01:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:42.418 14:01:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:42.418 14:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:44.978 14:01:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:44.978 14:01:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:44.978 14:01:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:44.978 14:01:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:44.978 14:01:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:44.978 14:01:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:44.978 14:01:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:44.978 14:01:24 -- nvmf/common.sh@294 -- # net_devs=() 00:27:44.978 14:01:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:44.978 14:01:24 -- nvmf/common.sh@295 -- # e810=() 00:27:44.978 14:01:24 -- nvmf/common.sh@295 -- # local -ga e810 00:27:44.978 14:01:24 -- nvmf/common.sh@296 -- # x722=() 00:27:44.978 14:01:24 -- nvmf/common.sh@296 -- # local -ga x722 00:27:44.978 14:01:24 -- nvmf/common.sh@297 -- # mlx=() 00:27:44.978 14:01:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:44.978 14:01:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:44.978 14:01:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:44.978 14:01:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:44.978 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:44.978 14:01:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:44.978 14:01:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:44.978 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:44.978 14:01:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:44.978 14:01:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:44.978 14:01:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:44.978 14:01:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:44.978 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:44.978 14:01:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:44.978 14:01:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:44.978 14:01:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:44.978 14:01:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:44.978 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:44.978 14:01:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:44.978 14:01:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:44.978 14:01:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:44.978 14:01:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:44.978 14:01:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:44.978 14:01:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:44.978 14:01:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:44.978 14:01:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:44.978 14:01:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:44.978 14:01:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:44.978 14:01:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:44.978 14:01:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:44.978 14:01:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:44.978 14:01:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:44.978 14:01:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:44.978 14:01:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:44.978 14:01:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:44.978 14:01:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:44.978 14:01:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:44.978 14:01:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:44.978 14:01:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:44.978 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:44.978 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:27:44.978 00:27:44.978 --- 10.0.0.2 ping statistics --- 00:27:44.978 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:44.978 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:27:44.978 14:01:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:44.978 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:44.978 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:27:44.978 00:27:44.978 --- 10.0.0.1 ping statistics --- 00:27:44.978 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:44.978 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:27:44.978 14:01:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:44.978 14:01:24 -- nvmf/common.sh@410 -- # return 0 00:27:44.978 14:01:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:44.978 14:01:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:44.978 14:01:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:44.978 14:01:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:44.978 14:01:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:44.979 14:01:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:44.979 14:01:24 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:44.979 14:01:24 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:44.979 14:01:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:44.979 14:01:24 -- common/autotest_common.sh@10 -- # set +x 00:27:44.979 14:01:24 -- host/fio.sh@24 -- # nvmfpid=2401923 00:27:44.979 14:01:24 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:44.979 14:01:24 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:44.979 14:01:24 -- host/fio.sh@28 -- # waitforlisten 2401923 00:27:44.979 14:01:24 -- common/autotest_common.sh@829 -- # '[' -z 2401923 ']' 00:27:44.979 14:01:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:44.979 14:01:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:44.979 14:01:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:44.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:44.979 14:01:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:44.979 14:01:24 -- common/autotest_common.sh@10 -- # set +x 00:27:44.979 [2024-11-29 14:01:24.914955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:44.979 [2024-11-29 14:01:24.915019] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:44.979 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.979 [2024-11-29 14:01:24.985198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:44.979 [2024-11-29 14:01:25.080477] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:44.979 [2024-11-29 14:01:25.080634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:44.979 [2024-11-29 14:01:25.080667] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:44.979 [2024-11-29 14:01:25.080681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:44.979 [2024-11-29 14:01:25.082419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:44.979 [2024-11-29 14:01:25.082467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:44.979 [2024-11-29 14:01:25.082534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:44.979 [2024-11-29 14:01:25.082537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:45.908 14:01:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:45.908 14:01:25 -- common/autotest_common.sh@862 -- # return 0 00:27:45.908 14:01:25 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:45.908 [2024-11-29 14:01:26.161956] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:45.908 14:01:26 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:45.908 14:01:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:45.908 14:01:26 -- common/autotest_common.sh@10 -- # set +x 00:27:46.165 14:01:26 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:46.422 Malloc1 00:27:46.422 14:01:26 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:46.680 14:01:26 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:46.938 14:01:27 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:47.195 [2024-11-29 14:01:27.229849] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:47.195 14:01:27 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:47.453 14:01:27 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:47.453 14:01:27 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:47.453 14:01:27 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:47.453 14:01:27 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:47.453 14:01:27 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:47.453 14:01:27 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:47.453 14:01:27 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.453 14:01:27 -- common/autotest_common.sh@1330 -- # shift 00:27:47.453 14:01:27 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:47.453 14:01:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:47.453 14:01:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:47.453 14:01:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:47.453 14:01:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:47.453 14:01:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:47.453 14:01:27 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:47.453 14:01:27 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:47.453 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:47.453 fio-3.35 00:27:47.453 Starting 1 thread 00:27:47.716 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.243 00:27:50.243 test: (groupid=0, jobs=1): err= 0: pid=2402305: Fri Nov 29 14:01:30 2024 00:27:50.243 read: IOPS=8822, BW=34.5MiB/s (36.1MB/s)(69.2MiB/2007msec) 00:27:50.243 slat (nsec): min=1815, max=146349, avg=2460.84, stdev=1743.04 00:27:50.243 clat (usec): min=2236, max=13190, avg=7989.43, stdev=633.65 00:27:50.243 lat (usec): min=2257, max=13193, avg=7991.89, stdev=633.56 00:27:50.243 clat percentiles (usec): 00:27:50.243 | 1.00th=[ 6521], 5.00th=[ 6980], 10.00th=[ 7242], 20.00th=[ 7504], 00:27:50.243 | 30.00th=[ 7701], 40.00th=[ 7832], 50.00th=[ 7963], 60.00th=[ 8160], 00:27:50.243 | 70.00th=[ 8291], 80.00th=[ 8455], 90.00th=[ 8717], 95.00th=[ 8979], 00:27:50.243 | 99.00th=[ 9372], 99.50th=[ 9503], 99.90th=[11076], 99.95th=[12125], 00:27:50.243 | 99.99th=[13042] 00:27:50.243 bw ( KiB/s): min=33808, max=35920, per=99.99%, avg=35286.00, stdev=997.73, samples=4 00:27:50.243 iops : min= 8452, max= 8980, avg=8821.50, stdev=249.43, samples=4 00:27:50.243 write: IOPS=8835, BW=34.5MiB/s (36.2MB/s)(69.3MiB/2007msec); 0 zone resets 00:27:50.243 slat (nsec): min=1972, max=114598, avg=2553.86, stdev=1258.61 00:27:50.243 clat (usec): min=1618, max=12126, avg=6463.63, stdev=554.39 00:27:50.243 lat (usec): min=1624, max=12128, avg=6466.18, stdev=554.37 00:27:50.243 clat percentiles (usec): 00:27:50.243 | 1.00th=[ 5211], 5.00th=[ 5669], 10.00th=[ 5800], 20.00th=[ 6063], 00:27:50.243 | 30.00th=[ 6194], 40.00th=[ 6325], 50.00th=[ 6456], 60.00th=[ 6587], 00:27:50.243 | 70.00th=[ 6718], 80.00th=[ 6849], 90.00th=[ 7111], 95.00th=[ 7308], 00:27:50.243 | 99.00th=[ 7701], 99.50th=[ 7832], 99.90th=[10421], 99.95th=[11338], 00:27:50.243 | 99.99th=[12125] 00:27:50.243 bw ( KiB/s): min=34600, max=36120, per=99.99%, avg=35338.00, stdev=743.22, samples=4 00:27:50.243 iops : min= 8650, max= 9030, avg=8834.50, stdev=185.81, samples=4 00:27:50.243 lat (msec) : 2=0.02%, 4=0.10%, 10=99.70%, 20=0.17% 00:27:50.243 cpu : usr=61.42%, sys=35.94%, ctx=52, majf=0, minf=41 00:27:50.243 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:50.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:50.243 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:50.243 issued rwts: total=17706,17733,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:50.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:50.243 00:27:50.243 Run status group 0 (all jobs): 00:27:50.243 READ: bw=34.5MiB/s (36.1MB/s), 34.5MiB/s-34.5MiB/s (36.1MB/s-36.1MB/s), io=69.2MiB (72.5MB), run=2007-2007msec 00:27:50.243 WRITE: bw=34.5MiB/s (36.2MB/s), 34.5MiB/s-34.5MiB/s (36.2MB/s-36.2MB/s), io=69.3MiB (72.6MB), run=2007-2007msec 00:27:50.243 14:01:30 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:50.243 14:01:30 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:50.243 14:01:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:50.243 14:01:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:50.243 14:01:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:50.243 14:01:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.243 14:01:30 -- common/autotest_common.sh@1330 -- # shift 00:27:50.243 14:01:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:50.243 14:01:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:50.243 14:01:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:50.243 14:01:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:50.243 14:01:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:50.243 14:01:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:50.243 14:01:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:50.243 14:01:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:50.243 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:50.243 fio-3.35 00:27:50.243 Starting 1 thread 00:27:50.243 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.771 00:27:52.771 test: (groupid=0, jobs=1): err= 0: pid=2402761: Fri Nov 29 14:01:32 2024 00:27:52.771 read: IOPS=8934, BW=140MiB/s (146MB/s)(280MiB/2006msec) 00:27:52.771 slat (nsec): min=2681, max=92048, avg=3627.19, stdev=1913.22 00:27:52.771 clat (usec): min=1356, max=17853, avg=8419.69, stdev=2129.85 00:27:52.771 lat (usec): min=1359, max=17856, avg=8423.32, stdev=2129.90 00:27:52.771 clat percentiles (usec): 00:27:52.771 | 1.00th=[ 4228], 5.00th=[ 5211], 10.00th=[ 5735], 20.00th=[ 6587], 00:27:52.771 | 30.00th=[ 7242], 40.00th=[ 7832], 50.00th=[ 8356], 60.00th=[ 8979], 00:27:52.771 | 70.00th=[ 9372], 80.00th=[10028], 90.00th=[11076], 95.00th=[12256], 00:27:52.771 | 99.00th=[14222], 99.50th=[14746], 99.90th=[15664], 99.95th=[15795], 00:27:52.771 | 99.99th=[16319] 00:27:52.771 bw ( KiB/s): min=67488, max=76608, per=49.13%, avg=70232.00, stdev=4281.10, samples=4 00:27:52.771 iops : min= 4218, max= 4788, avg=4389.50, stdev=267.57, samples=4 00:27:52.771 write: IOPS=5084, BW=79.4MiB/s (83.3MB/s)(144MiB/1809msec); 0 zone resets 00:27:52.771 slat (usec): min=30, max=198, avg=33.78, stdev= 6.10 00:27:52.771 clat (usec): min=5244, max=18939, avg=10519.93, stdev=1912.41 00:27:52.771 lat (usec): min=5277, max=18971, avg=10553.71, stdev=1913.00 00:27:52.771 clat percentiles (usec): 00:27:52.771 | 1.00th=[ 6915], 5.00th=[ 7832], 10.00th=[ 8291], 20.00th=[ 8848], 00:27:52.771 | 30.00th=[ 9372], 40.00th=[ 9765], 50.00th=[10290], 60.00th=[10814], 00:27:52.771 | 70.00th=[11338], 80.00th=[12125], 90.00th=[13173], 95.00th=[13829], 00:27:52.771 | 99.00th=[15795], 99.50th=[16188], 99.90th=[17171], 99.95th=[18744], 00:27:52.771 | 99.99th=[19006] 00:27:52.771 bw ( KiB/s): min=69952, max=79840, per=89.88%, avg=73112.00, stdev=4599.28, samples=4 00:27:52.771 iops : min= 4372, max= 4990, avg=4569.50, stdev=287.45, samples=4 00:27:52.771 lat (msec) : 2=0.05%, 4=0.45%, 10=67.40%, 20=32.10% 00:27:52.771 cpu : usr=76.31%, sys=22.00%, ctx=38, majf=0, minf=63 00:27:52.771 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:27:52.771 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:52.771 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:52.771 issued rwts: total=17922,9197,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:52.771 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:52.771 00:27:52.771 Run status group 0 (all jobs): 00:27:52.771 READ: bw=140MiB/s (146MB/s), 140MiB/s-140MiB/s (146MB/s-146MB/s), io=280MiB (294MB), run=2006-2006msec 00:27:52.771 WRITE: bw=79.4MiB/s (83.3MB/s), 79.4MiB/s-79.4MiB/s (83.3MB/s-83.3MB/s), io=144MiB (151MB), run=1809-1809msec 00:27:52.771 14:01:32 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:52.771 14:01:32 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:52.771 14:01:32 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:52.771 14:01:32 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:52.771 14:01:32 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:52.771 14:01:32 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:52.771 14:01:32 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:52.771 14:01:32 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:52.771 14:01:32 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:52.771 14:01:32 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:52.771 14:01:32 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:52.771 14:01:32 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:56.046 Nvme0n1 00:27:56.047 14:01:36 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:59.322 14:01:38 -- host/fio.sh@53 -- # ls_guid=9308345c-aa48-44c0-a1e4-f85501357743 00:27:59.322 14:01:38 -- host/fio.sh@54 -- # get_lvs_free_mb 9308345c-aa48-44c0-a1e4-f85501357743 00:27:59.322 14:01:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=9308345c-aa48-44c0-a1e4-f85501357743 00:27:59.322 14:01:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:59.322 14:01:38 -- common/autotest_common.sh@1355 -- # local fc 00:27:59.322 14:01:38 -- common/autotest_common.sh@1356 -- # local cs 00:27:59.322 14:01:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:59.322 14:01:39 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:59.322 { 00:27:59.322 "uuid": "9308345c-aa48-44c0-a1e4-f85501357743", 00:27:59.322 "name": "lvs_0", 00:27:59.322 "base_bdev": "Nvme0n1", 00:27:59.322 "total_data_clusters": 930, 00:27:59.322 "free_clusters": 930, 00:27:59.322 "block_size": 512, 00:27:59.322 "cluster_size": 1073741824 00:27:59.322 } 00:27:59.322 ]' 00:27:59.322 14:01:39 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="9308345c-aa48-44c0-a1e4-f85501357743") .free_clusters' 00:27:59.322 14:01:39 -- common/autotest_common.sh@1358 -- # fc=930 00:27:59.322 14:01:39 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="9308345c-aa48-44c0-a1e4-f85501357743") .cluster_size' 00:27:59.322 14:01:39 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:59.322 14:01:39 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:59.322 14:01:39 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:59.322 952320 00:27:59.322 14:01:39 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:59.579 85c91782-dc17-440b-bcdd-d864e475849c 00:27:59.579 14:01:39 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:59.837 14:01:39 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:00.094 14:01:40 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:00.351 14:01:40 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.351 14:01:40 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.351 14:01:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:00.351 14:01:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:00.351 14:01:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:00.351 14:01:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.351 14:01:40 -- common/autotest_common.sh@1330 -- # shift 00:28:00.351 14:01:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:00.351 14:01:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:00.351 14:01:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:00.351 14:01:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:00.351 14:01:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:00.351 14:01:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:00.351 14:01:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:00.351 14:01:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.608 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:00.608 fio-3.35 00:28:00.608 Starting 1 thread 00:28:00.608 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.131 00:28:03.131 test: (groupid=0, jobs=1): err= 0: pid=2404084: Fri Nov 29 14:01:43 2024 00:28:03.131 read: IOPS=5575, BW=21.8MiB/s (22.8MB/s)(43.8MiB/2009msec) 00:28:03.131 slat (nsec): min=1791, max=167216, avg=2591.21, stdev=2599.63 00:28:03.131 clat (usec): min=932, max=171610, avg=12590.34, stdev=11981.99 00:28:03.131 lat (usec): min=936, max=171640, avg=12592.93, stdev=11982.34 00:28:03.131 clat percentiles (msec): 00:28:03.131 | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 11], 00:28:03.131 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 12], 00:28:03.131 | 70.00th=[ 13], 80.00th=[ 13], 90.00th=[ 13], 95.00th=[ 14], 00:28:03.131 | 99.00th=[ 15], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:03.131 | 99.99th=[ 171] 00:28:03.131 bw ( KiB/s): min=15840, max=24912, per=99.85%, avg=22268.00, stdev=4303.32, samples=4 00:28:03.131 iops : min= 3960, max= 6228, avg=5567.00, stdev=1075.83, samples=4 00:28:03.131 write: IOPS=5543, BW=21.7MiB/s (22.7MB/s)(43.5MiB/2009msec); 0 zone resets 00:28:03.131 slat (nsec): min=1982, max=114595, avg=2722.49, stdev=1834.92 00:28:03.131 clat (usec): min=343, max=169480, avg=10296.36, stdev=11277.04 00:28:03.131 lat (usec): min=346, max=169488, avg=10299.08, stdev=11277.38 00:28:03.132 clat percentiles (msec): 00:28:03.132 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], 00:28:03.132 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 10], 00:28:03.132 | 70.00th=[ 10], 80.00th=[ 11], 90.00th=[ 11], 95.00th=[ 11], 00:28:03.132 | 99.00th=[ 12], 99.50th=[ 155], 99.90th=[ 169], 99.95th=[ 169], 00:28:03.132 | 99.99th=[ 169] 00:28:03.132 bw ( KiB/s): min=16744, max=24128, per=99.91%, avg=22154.00, stdev=3612.09, samples=4 00:28:03.132 iops : min= 4186, max= 6032, avg=5538.50, stdev=903.02, samples=4 00:28:03.132 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:28:03.132 lat (msec) : 2=0.03%, 4=0.09%, 10=38.96%, 20=60.33%, 250=0.57% 00:28:03.132 cpu : usr=55.23%, sys=42.73%, ctx=90, majf=0, minf=41 00:28:03.132 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:03.132 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:03.132 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:03.132 issued rwts: total=11201,11137,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:03.132 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:03.132 00:28:03.132 Run status group 0 (all jobs): 00:28:03.132 READ: bw=21.8MiB/s (22.8MB/s), 21.8MiB/s-21.8MiB/s (22.8MB/s-22.8MB/s), io=43.8MiB (45.9MB), run=2009-2009msec 00:28:03.132 WRITE: bw=21.7MiB/s (22.7MB/s), 21.7MiB/s-21.7MiB/s (22.7MB/s-22.7MB/s), io=43.5MiB (45.6MB), run=2009-2009msec 00:28:03.132 14:01:43 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:03.389 14:01:43 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:04.320 14:01:44 -- host/fio.sh@64 -- # ls_nested_guid=99f56b5c-0d80-4129-8792-b09db07d1c05 00:28:04.320 14:01:44 -- host/fio.sh@65 -- # get_lvs_free_mb 99f56b5c-0d80-4129-8792-b09db07d1c05 00:28:04.320 14:01:44 -- common/autotest_common.sh@1353 -- # local lvs_uuid=99f56b5c-0d80-4129-8792-b09db07d1c05 00:28:04.320 14:01:44 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:04.320 14:01:44 -- common/autotest_common.sh@1355 -- # local fc 00:28:04.320 14:01:44 -- common/autotest_common.sh@1356 -- # local cs 00:28:04.320 14:01:44 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:04.577 14:01:44 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:04.577 { 00:28:04.577 "uuid": "9308345c-aa48-44c0-a1e4-f85501357743", 00:28:04.577 "name": "lvs_0", 00:28:04.577 "base_bdev": "Nvme0n1", 00:28:04.577 "total_data_clusters": 930, 00:28:04.577 "free_clusters": 0, 00:28:04.577 "block_size": 512, 00:28:04.577 "cluster_size": 1073741824 00:28:04.577 }, 00:28:04.577 { 00:28:04.577 "uuid": "99f56b5c-0d80-4129-8792-b09db07d1c05", 00:28:04.577 "name": "lvs_n_0", 00:28:04.577 "base_bdev": "85c91782-dc17-440b-bcdd-d864e475849c", 00:28:04.577 "total_data_clusters": 237847, 00:28:04.577 "free_clusters": 237847, 00:28:04.577 "block_size": 512, 00:28:04.577 "cluster_size": 4194304 00:28:04.577 } 00:28:04.577 ]' 00:28:04.577 14:01:44 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="99f56b5c-0d80-4129-8792-b09db07d1c05") .free_clusters' 00:28:04.577 14:01:44 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:04.577 14:01:44 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="99f56b5c-0d80-4129-8792-b09db07d1c05") .cluster_size' 00:28:04.834 14:01:44 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:04.834 14:01:44 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:04.834 14:01:44 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:04.834 951388 00:28:04.834 14:01:44 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:05.398 ea7ad5a8-7e66-42ac-8ec6-64849ed8c91d 00:28:05.398 14:01:45 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:05.655 14:01:45 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:05.911 14:01:46 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:06.168 14:01:46 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:06.168 14:01:46 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:06.168 14:01:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:06.168 14:01:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:06.168 14:01:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:06.168 14:01:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:06.168 14:01:46 -- common/autotest_common.sh@1330 -- # shift 00:28:06.168 14:01:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:06.168 14:01:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:06.168 14:01:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:06.168 14:01:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:06.168 14:01:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:06.168 14:01:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:06.168 14:01:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:06.168 14:01:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:06.425 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:06.425 fio-3.35 00:28:06.425 Starting 1 thread 00:28:06.425 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.944 00:28:08.944 test: (groupid=0, jobs=1): err= 0: pid=2404836: Fri Nov 29 14:01:48 2024 00:28:08.944 read: IOPS=6111, BW=23.9MiB/s (25.0MB/s)(47.9MiB/2008msec) 00:28:08.944 slat (usec): min=2, max=174, avg= 2.65, stdev= 2.26 00:28:08.944 clat (usec): min=4063, max=18743, avg=11521.87, stdev=1005.29 00:28:08.944 lat (usec): min=4100, max=18745, avg=11524.52, stdev=1005.17 00:28:08.944 clat percentiles (usec): 00:28:08.944 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10814], 00:28:08.944 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:28:08.944 | 70.00th=[11994], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:28:08.944 | 99.00th=[13698], 99.50th=[13829], 99.90th=[17171], 99.95th=[18482], 00:28:08.944 | 99.99th=[18744] 00:28:08.944 bw ( KiB/s): min=23024, max=24944, per=99.83%, avg=24402.00, stdev=921.50, samples=4 00:28:08.944 iops : min= 5756, max= 6236, avg=6100.50, stdev=230.38, samples=4 00:28:08.944 write: IOPS=6092, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2008msec); 0 zone resets 00:28:08.944 slat (usec): min=2, max=137, avg= 2.74, stdev= 1.59 00:28:08.944 clat (usec): min=2876, max=15908, avg=9253.71, stdev=845.96 00:28:08.944 lat (usec): min=2884, max=15910, avg=9256.44, stdev=845.93 00:28:08.944 clat percentiles (usec): 00:28:08.944 | 1.00th=[ 7308], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:28:08.944 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:28:08.944 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:28:08.944 | 99.00th=[11076], 99.50th=[11338], 99.90th=[14746], 99.95th=[14877], 00:28:08.944 | 99.99th=[15795] 00:28:08.945 bw ( KiB/s): min=23936, max=24512, per=99.93%, avg=24352.00, stdev=278.97, samples=4 00:28:08.945 iops : min= 5984, max= 6128, avg=6088.00, stdev=69.74, samples=4 00:28:08.945 lat (msec) : 4=0.03%, 10=44.05%, 20=55.92% 00:28:08.945 cpu : usr=61.78%, sys=36.17%, ctx=111, majf=0, minf=41 00:28:08.945 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:08.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:08.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:08.945 issued rwts: total=12271,12233,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:08.945 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:08.945 00:28:08.945 Run status group 0 (all jobs): 00:28:08.945 READ: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=47.9MiB (50.3MB), run=2008-2008msec 00:28:08.945 WRITE: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.1MB), run=2008-2008msec 00:28:08.945 14:01:48 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:08.945 14:01:49 -- host/fio.sh@74 -- # sync 00:28:08.945 14:01:49 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:13.117 14:01:53 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:13.117 14:01:53 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:16.392 14:01:56 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:16.392 14:01:56 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:18.290 14:01:58 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:18.290 14:01:58 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:18.290 14:01:58 -- host/fio.sh@86 -- # nvmftestfini 00:28:18.290 14:01:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:18.290 14:01:58 -- nvmf/common.sh@116 -- # sync 00:28:18.290 14:01:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:18.290 14:01:58 -- nvmf/common.sh@119 -- # set +e 00:28:18.290 14:01:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:18.290 14:01:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:18.290 rmmod nvme_tcp 00:28:18.290 rmmod nvme_fabrics 00:28:18.290 rmmod nvme_keyring 00:28:18.290 14:01:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:18.290 14:01:58 -- nvmf/common.sh@123 -- # set -e 00:28:18.290 14:01:58 -- nvmf/common.sh@124 -- # return 0 00:28:18.290 14:01:58 -- nvmf/common.sh@477 -- # '[' -n 2401923 ']' 00:28:18.290 14:01:58 -- nvmf/common.sh@478 -- # killprocess 2401923 00:28:18.290 14:01:58 -- common/autotest_common.sh@936 -- # '[' -z 2401923 ']' 00:28:18.290 14:01:58 -- common/autotest_common.sh@940 -- # kill -0 2401923 00:28:18.290 14:01:58 -- common/autotest_common.sh@941 -- # uname 00:28:18.290 14:01:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:18.290 14:01:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2401923 00:28:18.290 14:01:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:18.290 14:01:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:18.290 14:01:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2401923' 00:28:18.290 killing process with pid 2401923 00:28:18.290 14:01:58 -- common/autotest_common.sh@955 -- # kill 2401923 00:28:18.290 14:01:58 -- common/autotest_common.sh@960 -- # wait 2401923 00:28:18.548 14:01:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:18.548 14:01:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:18.548 14:01:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:18.548 14:01:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:18.548 14:01:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:18.548 14:01:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:18.548 14:01:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:18.548 14:01:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:20.447 14:02:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:20.447 00:28:20.447 real 0m38.221s 00:28:20.447 user 2m26.140s 00:28:20.447 sys 0m7.226s 00:28:20.447 14:02:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:20.447 14:02:00 -- common/autotest_common.sh@10 -- # set +x 00:28:20.447 ************************************ 00:28:20.447 END TEST nvmf_fio_host 00:28:20.447 ************************************ 00:28:20.447 14:02:00 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:20.447 14:02:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:20.447 14:02:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:20.447 14:02:00 -- common/autotest_common.sh@10 -- # set +x 00:28:20.447 ************************************ 00:28:20.447 START TEST nvmf_failover 00:28:20.447 ************************************ 00:28:20.447 14:02:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:20.706 * Looking for test storage... 00:28:20.706 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:20.706 14:02:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:20.706 14:02:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:20.706 14:02:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:20.706 14:02:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:20.706 14:02:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:20.706 14:02:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:20.706 14:02:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:20.706 14:02:00 -- scripts/common.sh@335 -- # IFS=.-: 00:28:20.706 14:02:00 -- scripts/common.sh@335 -- # read -ra ver1 00:28:20.706 14:02:00 -- scripts/common.sh@336 -- # IFS=.-: 00:28:20.706 14:02:00 -- scripts/common.sh@336 -- # read -ra ver2 00:28:20.706 14:02:00 -- scripts/common.sh@337 -- # local 'op=<' 00:28:20.706 14:02:00 -- scripts/common.sh@339 -- # ver1_l=2 00:28:20.706 14:02:00 -- scripts/common.sh@340 -- # ver2_l=1 00:28:20.706 14:02:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:20.706 14:02:00 -- scripts/common.sh@343 -- # case "$op" in 00:28:20.706 14:02:00 -- scripts/common.sh@344 -- # : 1 00:28:20.706 14:02:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:20.706 14:02:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:20.706 14:02:00 -- scripts/common.sh@364 -- # decimal 1 00:28:20.706 14:02:00 -- scripts/common.sh@352 -- # local d=1 00:28:20.706 14:02:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:20.706 14:02:00 -- scripts/common.sh@354 -- # echo 1 00:28:20.706 14:02:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:20.706 14:02:00 -- scripts/common.sh@365 -- # decimal 2 00:28:20.706 14:02:00 -- scripts/common.sh@352 -- # local d=2 00:28:20.706 14:02:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:20.706 14:02:00 -- scripts/common.sh@354 -- # echo 2 00:28:20.706 14:02:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:20.706 14:02:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:20.706 14:02:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:20.706 14:02:00 -- scripts/common.sh@367 -- # return 0 00:28:20.706 14:02:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:20.706 14:02:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:20.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.706 --rc genhtml_branch_coverage=1 00:28:20.706 --rc genhtml_function_coverage=1 00:28:20.706 --rc genhtml_legend=1 00:28:20.706 --rc geninfo_all_blocks=1 00:28:20.706 --rc geninfo_unexecuted_blocks=1 00:28:20.706 00:28:20.706 ' 00:28:20.706 14:02:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:20.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.706 --rc genhtml_branch_coverage=1 00:28:20.706 --rc genhtml_function_coverage=1 00:28:20.706 --rc genhtml_legend=1 00:28:20.706 --rc geninfo_all_blocks=1 00:28:20.706 --rc geninfo_unexecuted_blocks=1 00:28:20.706 00:28:20.706 ' 00:28:20.706 14:02:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:20.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.706 --rc genhtml_branch_coverage=1 00:28:20.706 --rc genhtml_function_coverage=1 00:28:20.706 --rc genhtml_legend=1 00:28:20.706 --rc geninfo_all_blocks=1 00:28:20.706 --rc geninfo_unexecuted_blocks=1 00:28:20.706 00:28:20.706 ' 00:28:20.706 14:02:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:20.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.706 --rc genhtml_branch_coverage=1 00:28:20.706 --rc genhtml_function_coverage=1 00:28:20.706 --rc genhtml_legend=1 00:28:20.706 --rc geninfo_all_blocks=1 00:28:20.706 --rc geninfo_unexecuted_blocks=1 00:28:20.706 00:28:20.706 ' 00:28:20.706 14:02:00 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:20.706 14:02:00 -- nvmf/common.sh@7 -- # uname -s 00:28:20.706 14:02:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:20.706 14:02:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:20.706 14:02:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:20.706 14:02:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:20.706 14:02:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:20.706 14:02:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:20.706 14:02:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:20.706 14:02:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:20.706 14:02:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:20.706 14:02:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:20.706 14:02:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:20.706 14:02:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:20.706 14:02:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:20.706 14:02:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:20.706 14:02:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:20.706 14:02:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:20.706 14:02:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:20.706 14:02:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:20.706 14:02:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:20.706 14:02:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.706 14:02:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.706 14:02:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.706 14:02:00 -- paths/export.sh@5 -- # export PATH 00:28:20.706 14:02:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.706 14:02:00 -- nvmf/common.sh@46 -- # : 0 00:28:20.706 14:02:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:20.706 14:02:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:20.706 14:02:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:20.706 14:02:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:20.706 14:02:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:20.706 14:02:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:20.706 14:02:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:20.706 14:02:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:20.706 14:02:00 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:20.707 14:02:00 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:20.707 14:02:00 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:20.707 14:02:00 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:20.707 14:02:00 -- host/failover.sh@18 -- # nvmftestinit 00:28:20.707 14:02:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:20.707 14:02:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:20.707 14:02:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:20.707 14:02:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:20.707 14:02:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:20.707 14:02:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:20.707 14:02:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:20.707 14:02:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:20.707 14:02:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:20.707 14:02:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:20.707 14:02:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:20.707 14:02:00 -- common/autotest_common.sh@10 -- # set +x 00:28:23.235 14:02:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:23.235 14:02:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:23.235 14:02:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:23.235 14:02:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:23.235 14:02:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:23.235 14:02:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:23.235 14:02:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:23.235 14:02:02 -- nvmf/common.sh@294 -- # net_devs=() 00:28:23.235 14:02:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:23.235 14:02:02 -- nvmf/common.sh@295 -- # e810=() 00:28:23.235 14:02:02 -- nvmf/common.sh@295 -- # local -ga e810 00:28:23.235 14:02:02 -- nvmf/common.sh@296 -- # x722=() 00:28:23.235 14:02:02 -- nvmf/common.sh@296 -- # local -ga x722 00:28:23.235 14:02:02 -- nvmf/common.sh@297 -- # mlx=() 00:28:23.235 14:02:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:23.235 14:02:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:23.235 14:02:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:23.235 14:02:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:23.235 14:02:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:23.235 14:02:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:23.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:23.235 14:02:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:23.235 14:02:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:23.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:23.235 14:02:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:23.235 14:02:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.235 14:02:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.235 14:02:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:23.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:23.235 14:02:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.235 14:02:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:23.235 14:02:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.235 14:02:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.235 14:02:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:23.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:23.235 14:02:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.235 14:02:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:23.235 14:02:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:23.235 14:02:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:23.235 14:02:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:23.235 14:02:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:23.235 14:02:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:23.235 14:02:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:23.235 14:02:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:23.235 14:02:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:23.235 14:02:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:23.235 14:02:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:23.235 14:02:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:23.235 14:02:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:23.235 14:02:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:23.235 14:02:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:23.235 14:02:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:23.235 14:02:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:23.235 14:02:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:23.235 14:02:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:23.235 14:02:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:23.235 14:02:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:23.235 14:02:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:23.235 14:02:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:23.235 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:23.235 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:28:23.235 00:28:23.235 --- 10.0.0.2 ping statistics --- 00:28:23.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.236 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:28:23.236 14:02:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:23.236 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:23.236 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:28:23.236 00:28:23.236 --- 10.0.0.1 ping statistics --- 00:28:23.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.236 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:28:23.236 14:02:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:23.236 14:02:03 -- nvmf/common.sh@410 -- # return 0 00:28:23.236 14:02:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:23.236 14:02:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:23.236 14:02:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:23.236 14:02:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:23.236 14:02:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:23.236 14:02:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:23.236 14:02:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:23.236 14:02:03 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:23.236 14:02:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:23.236 14:02:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.236 14:02:03 -- common/autotest_common.sh@10 -- # set +x 00:28:23.236 14:02:03 -- nvmf/common.sh@469 -- # nvmfpid=2408260 00:28:23.236 14:02:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:23.236 14:02:03 -- nvmf/common.sh@470 -- # waitforlisten 2408260 00:28:23.236 14:02:03 -- common/autotest_common.sh@829 -- # '[' -z 2408260 ']' 00:28:23.236 14:02:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:23.236 14:02:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.236 14:02:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:23.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:23.236 14:02:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.236 14:02:03 -- common/autotest_common.sh@10 -- # set +x 00:28:23.236 [2024-11-29 14:02:03.135592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:23.236 [2024-11-29 14:02:03.135655] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:23.236 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.236 [2024-11-29 14:02:03.202003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:23.236 [2024-11-29 14:02:03.288976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:23.236 [2024-11-29 14:02:03.289152] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:23.236 [2024-11-29 14:02:03.289184] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:23.236 [2024-11-29 14:02:03.289198] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:23.236 [2024-11-29 14:02:03.289341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:23.236 [2024-11-29 14:02:03.289272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:23.236 [2024-11-29 14:02:03.289337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.168 14:02:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:24.168 14:02:04 -- common/autotest_common.sh@862 -- # return 0 00:28:24.168 14:02:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:24.168 14:02:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:24.168 14:02:04 -- common/autotest_common.sh@10 -- # set +x 00:28:24.168 14:02:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:24.168 14:02:04 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:24.168 [2024-11-29 14:02:04.361916] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.168 14:02:04 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:24.426 Malloc0 00:28:24.426 14:02:04 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:24.683 14:02:04 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:24.980 14:02:05 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:25.277 [2024-11-29 14:02:05.386235] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:25.277 14:02:05 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:25.566 [2024-11-29 14:02:05.634989] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:25.566 14:02:05 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:25.824 [2024-11-29 14:02:05.883848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:25.824 14:02:05 -- host/failover.sh@31 -- # bdevperf_pid=2408573 00:28:25.824 14:02:05 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:25.824 14:02:05 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:25.824 14:02:05 -- host/failover.sh@34 -- # waitforlisten 2408573 /var/tmp/bdevperf.sock 00:28:25.824 14:02:05 -- common/autotest_common.sh@829 -- # '[' -z 2408573 ']' 00:28:25.824 14:02:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:25.824 14:02:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:25.824 14:02:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:25.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:25.824 14:02:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:25.824 14:02:05 -- common/autotest_common.sh@10 -- # set +x 00:28:26.759 14:02:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:26.759 14:02:06 -- common/autotest_common.sh@862 -- # return 0 00:28:26.759 14:02:06 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:27.016 NVMe0n1 00:28:27.016 14:02:07 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:27.583 00:28:27.583 14:02:07 -- host/failover.sh@39 -- # run_test_pid=2408847 00:28:27.583 14:02:07 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:27.583 14:02:07 -- host/failover.sh@41 -- # sleep 1 00:28:28.519 14:02:08 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.777 [2024-11-29 14:02:08.896425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 [2024-11-29 14:02:08.896982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce5930 is same with the state(5) to be set 00:28:28.777 14:02:08 -- host/failover.sh@45 -- # sleep 3 00:28:32.064 14:02:11 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:32.322 00:28:32.322 14:02:12 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:32.322 [2024-11-29 14:02:12.594342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.322 [2024-11-29 14:02:12.594941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.323 [2024-11-29 14:02:12.594952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.323 [2024-11-29 14:02:12.594963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.323 [2024-11-29 14:02:12.594974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.323 [2024-11-29 14:02:12.594985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce67c0 is same with the state(5) to be set 00:28:32.580 14:02:12 -- host/failover.sh@50 -- # sleep 3 00:28:35.864 14:02:15 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:35.864 [2024-11-29 14:02:15.901479] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:35.864 14:02:15 -- host/failover.sh@55 -- # sleep 1 00:28:36.796 14:02:16 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:37.056 [2024-11-29 14:02:17.209479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.209992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.056 [2024-11-29 14:02:17.210127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce7310 is same with the state(5) to be set 00:28:37.057 14:02:17 -- host/failover.sh@59 -- # wait 2408847 00:28:43.626 0 00:28:43.626 14:02:22 -- host/failover.sh@61 -- # killprocess 2408573 00:28:43.626 14:02:22 -- common/autotest_common.sh@936 -- # '[' -z 2408573 ']' 00:28:43.626 14:02:22 -- common/autotest_common.sh@940 -- # kill -0 2408573 00:28:43.626 14:02:22 -- common/autotest_common.sh@941 -- # uname 00:28:43.626 14:02:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:43.626 14:02:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2408573 00:28:43.626 14:02:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:43.626 14:02:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:43.626 14:02:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2408573' 00:28:43.626 killing process with pid 2408573 00:28:43.626 14:02:22 -- common/autotest_common.sh@955 -- # kill 2408573 00:28:43.626 14:02:22 -- common/autotest_common.sh@960 -- # wait 2408573 00:28:43.626 14:02:23 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:43.626 [2024-11-29 14:02:05.939723] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:43.626 [2024-11-29 14:02:05.939808] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2408573 ] 00:28:43.626 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.626 [2024-11-29 14:02:06.000802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:43.626 [2024-11-29 14:02:06.084024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:43.626 Running I/O for 15 seconds... 00:28:43.626 [2024-11-29 14:02:08.897263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.897982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.897995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.626 [2024-11-29 14:02:08.898186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.626 [2024-11-29 14:02:08.898201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:117000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.898360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:117008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:117016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.898434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:117024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.898463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:117040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.898521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:116464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:116544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:116552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.898973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.898989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:117072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:117080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:117096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:117112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:117128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.627 [2024-11-29 14:02:08.899351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.627 [2024-11-29 14:02:08.899366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:117144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.627 [2024-11-29 14:02:08.899380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:117176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.899504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:117216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.899651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:117224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.899680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:116648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:116656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:116680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:117232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.899946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.899975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.899990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:117264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:117272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:117280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:117320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:117336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:117352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:117360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:117368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:117376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:117384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:117392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.628 [2024-11-29 14:02:08.900547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.628 [2024-11-29 14:02:08.900562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.628 [2024-11-29 14:02:08.900576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:116728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.900974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.900989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.901002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.901035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.901063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:08.901091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x212fc60 is same with the state(5) to be set 00:28:43.629 [2024-11-29 14:02:08.901123] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.629 [2024-11-29 14:02:08.901134] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.629 [2024-11-29 14:02:08.901146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116992 len:8 PRP1 0x0 PRP2 0x0 00:28:43.629 [2024-11-29 14:02:08.901159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901219] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x212fc60 was disconnected and freed. reset controller. 00:28:43.629 [2024-11-29 14:02:08.901244] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:43.629 [2024-11-29 14:02:08.901281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.629 [2024-11-29 14:02:08.901300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.629 [2024-11-29 14:02:08.901328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.629 [2024-11-29 14:02:08.901356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.629 [2024-11-29 14:02:08.901383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:08.901404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.629 [2024-11-29 14:02:08.903753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.629 [2024-11-29 14:02:08.903790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2111000 (9): Bad file descriptor 00:28:43.629 [2024-11-29 14:02:08.978814] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.629 [2024-11-29 14:02:12.595112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:126056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:126064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:126072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:126096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:126104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:126112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:126128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:126144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:126152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:126176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:126200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:126208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:126216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.629 [2024-11-29 14:02:12.595566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.629 [2024-11-29 14:02:12.595581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:126232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:125568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:125584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:125600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:125608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:125632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:125648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:125664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:125672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:126264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.595872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:126272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.595900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:126280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:126288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.595956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.595974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:126296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.595988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:126304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:126312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:126320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:126328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:125696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:125712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:125720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:125736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:125744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:125760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:125784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:125808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:126336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:126344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:126352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:126360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:126368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.630 [2024-11-29 14:02:12.596476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:126376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:126384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:126392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.630 [2024-11-29 14:02:12.596575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:126400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.630 [2024-11-29 14:02:12.596589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:126408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.596617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:126416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.596646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:126424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:126432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.596707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:126440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:126448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.596765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:126456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:125816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:125864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:125880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:125896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:125912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:125952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.596972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:125992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.596991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:126008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:126464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:126472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:126480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:126488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:126496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:126504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:126512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:126520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:126528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:126536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:126544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:126552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:126560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:126568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:126576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:126584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:126592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:126600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:126608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:126616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:126624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:126632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.631 [2024-11-29 14:02:12.597670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:126640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:126648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.631 [2024-11-29 14:02:12.597740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:126656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.631 [2024-11-29 14:02:12.597753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:126664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:126672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:126680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.597841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:126688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.597869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:126024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:126032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:126040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.597972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:126048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.597985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:126080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:126088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:126120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:126136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:126696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:126704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:126712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:126720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:126728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:126736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:126744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:126752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:126760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:126768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:126776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:126784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:126792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:126800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:126808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:126816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:126824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:126832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:126840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:126848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.632 [2024-11-29 14:02:12.598676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:126160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:126168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:126184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:126192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:126224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:126240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:126248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.632 [2024-11-29 14:02:12.598876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.632 [2024-11-29 14:02:12.598891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x213d710 is same with the state(5) to be set 00:28:43.633 [2024-11-29 14:02:12.598908] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.633 [2024-11-29 14:02:12.598920] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.633 [2024-11-29 14:02:12.598931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:126256 len:8 PRP1 0x0 PRP2 0x0 00:28:43.633 [2024-11-29 14:02:12.598958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:12.599030] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x213d710 was disconnected and freed. reset controller. 00:28:43.633 [2024-11-29 14:02:12.599048] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:43.633 [2024-11-29 14:02:12.599083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.633 [2024-11-29 14:02:12.599101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:12.599124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.633 [2024-11-29 14:02:12.599137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:12.599151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.633 [2024-11-29 14:02:12.599164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:12.599178] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.633 [2024-11-29 14:02:12.599191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:12.599205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.633 [2024-11-29 14:02:12.601311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.633 [2024-11-29 14:02:12.601351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2111000 (9): Bad file descriptor 00:28:43.633 [2024-11-29 14:02:12.669607] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.633 [2024-11-29 14:02:17.210299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:96496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:96504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:96512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:96520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:96552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:96576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:96592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:96616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:96648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:96656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:96672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:96680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:96688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:96704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:95944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:95984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:95992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:96000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:96016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:96024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:96032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.210986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:96040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.210999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:96720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.211027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:96736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.211055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:96744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.633 [2024-11-29 14:02:17.211084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:96752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.633 [2024-11-29 14:02:17.211112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:96760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.633 [2024-11-29 14:02:17.211139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:96768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.633 [2024-11-29 14:02:17.211167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:96776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.633 [2024-11-29 14:02:17.211195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.633 [2024-11-29 14:02:17.211213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:96784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:96792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:96800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.211283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:96808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.211311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:96816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.211338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:96056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:96072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:96080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:96096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:96120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:96136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:96152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:96160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:96168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:96200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:96224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:96280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:96288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:96296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:96304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:96320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:96824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:96832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:96840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:96848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:96856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:96864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.211968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.211983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:96872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.211996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:96880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.212023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:96888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:96896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.212078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:96904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.212106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:96912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:96920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.634 [2024-11-29 14:02:17.212162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:96928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:96352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:96360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:96400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:96416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.634 [2024-11-29 14:02:17.212305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.634 [2024-11-29 14:02:17.212320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:96448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:96464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:96472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:96480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:96936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:96944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:96952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:96960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:96968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:96976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:96984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:96992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:97000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:97008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:97016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:97024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:97032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:97040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.212860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:97048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:97056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:97064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:97072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.212972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.212987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:97080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:97088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:97096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.213060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:97104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.213087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:97112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:96488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:96528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:96536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:96544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:96560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:96568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:96584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:96600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.635 [2024-11-29 14:02:17.213336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:97120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.213364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.635 [2024-11-29 14:02:17.213378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:97128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.635 [2024-11-29 14:02:17.213402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:97136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:97144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:97152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:97160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:97168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:97176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:97184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:97192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:97200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:97208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:97216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:97224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:97232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:97240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.636 [2024-11-29 14:02:17.213798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:97248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:96608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:96624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:96632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:96640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:96664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.213983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:96696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.213997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:96712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.636 [2024-11-29 14:02:17.214024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23047d0 is same with the state(5) to be set 00:28:43.636 [2024-11-29 14:02:17.214055] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.636 [2024-11-29 14:02:17.214073] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.636 [2024-11-29 14:02:17.214085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:96728 len:8 PRP1 0x0 PRP2 0x0 00:28:43.636 [2024-11-29 14:02:17.214097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214163] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x23047d0 was disconnected and freed. reset controller. 00:28:43.636 [2024-11-29 14:02:17.214181] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:43.636 [2024-11-29 14:02:17.214236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.636 [2024-11-29 14:02:17.214256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.636 [2024-11-29 14:02:17.214286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.636 [2024-11-29 14:02:17.214313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.636 [2024-11-29 14:02:17.214340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.636 [2024-11-29 14:02:17.214354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.636 [2024-11-29 14:02:17.216629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.636 [2024-11-29 14:02:17.216672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2111000 (9): Bad file descriptor 00:28:43.636 [2024-11-29 14:02:17.250412] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.636 00:28:43.636 Latency(us) 00:28:43.636 [2024-11-29T13:02:23.918Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:43.636 [2024-11-29T13:02:23.918Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:43.636 Verification LBA range: start 0x0 length 0x4000 00:28:43.636 NVMe0n1 : 15.01 12618.26 49.29 678.45 0.00 9609.03 649.29 16408.27 00:28:43.636 [2024-11-29T13:02:23.918Z] =================================================================================================================== 00:28:43.636 [2024-11-29T13:02:23.918Z] Total : 12618.26 49.29 678.45 0.00 9609.03 649.29 16408.27 00:28:43.636 Received shutdown signal, test time was about 15.000000 seconds 00:28:43.636 00:28:43.636 Latency(us) 00:28:43.636 [2024-11-29T13:02:23.918Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:43.636 [2024-11-29T13:02:23.918Z] =================================================================================================================== 00:28:43.636 [2024-11-29T13:02:23.918Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:43.636 14:02:23 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:43.636 14:02:23 -- host/failover.sh@65 -- # count=3 00:28:43.636 14:02:23 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:43.636 14:02:23 -- host/failover.sh@73 -- # bdevperf_pid=2410619 00:28:43.636 14:02:23 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:43.636 14:02:23 -- host/failover.sh@75 -- # waitforlisten 2410619 /var/tmp/bdevperf.sock 00:28:43.636 14:02:23 -- common/autotest_common.sh@829 -- # '[' -z 2410619 ']' 00:28:43.636 14:02:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:43.636 14:02:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:43.636 14:02:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:43.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:43.636 14:02:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:43.636 14:02:23 -- common/autotest_common.sh@10 -- # set +x 00:28:43.894 14:02:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:43.894 14:02:24 -- common/autotest_common.sh@862 -- # return 0 00:28:43.894 14:02:24 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:44.152 [2024-11-29 14:02:24.325967] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:44.152 14:02:24 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:44.410 [2024-11-29 14:02:24.582643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:44.410 14:02:24 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.669 NVMe0n1 00:28:44.935 14:02:24 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:45.194 00:28:45.194 14:02:25 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:45.759 00:28:45.759 14:02:25 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:45.759 14:02:25 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:46.016 14:02:26 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:46.273 14:02:26 -- host/failover.sh@87 -- # sleep 3 00:28:49.559 14:02:29 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:49.559 14:02:29 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:49.559 14:02:29 -- host/failover.sh@90 -- # run_test_pid=2411446 00:28:49.559 14:02:29 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:49.559 14:02:29 -- host/failover.sh@92 -- # wait 2411446 00:28:50.497 0 00:28:50.497 14:02:30 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:50.497 [2024-11-29 14:02:23.129355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.497 [2024-11-29 14:02:23.129501] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2410619 ] 00:28:50.497 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.497 [2024-11-29 14:02:23.193609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.497 [2024-11-29 14:02:23.277181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:50.497 [2024-11-29 14:02:26.338223] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:50.497 [2024-11-29 14:02:26.338308] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.497 [2024-11-29 14:02:26.338331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.497 [2024-11-29 14:02:26.338362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.497 [2024-11-29 14:02:26.338376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.497 [2024-11-29 14:02:26.338390] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.497 [2024-11-29 14:02:26.338413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.497 [2024-11-29 14:02:26.338427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.497 [2024-11-29 14:02:26.338441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.497 [2024-11-29 14:02:26.338454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:50.497 [2024-11-29 14:02:26.338488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:50.497 [2024-11-29 14:02:26.338519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x238e000 (9): Bad file descriptor 00:28:50.497 [2024-11-29 14:02:26.342253] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:50.497 Running I/O for 1 seconds... 00:28:50.497 00:28:50.497 Latency(us) 00:28:50.497 [2024-11-29T13:02:30.779Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:50.497 [2024-11-29T13:02:30.779Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:50.497 Verification LBA range: start 0x0 length 0x4000 00:28:50.497 NVMe0n1 : 1.01 12926.03 50.49 0.00 0.00 9861.09 1140.81 10728.49 00:28:50.497 [2024-11-29T13:02:30.779Z] =================================================================================================================== 00:28:50.497 [2024-11-29T13:02:30.779Z] Total : 12926.03 50.49 0.00 0.00 9861.09 1140.81 10728.49 00:28:50.497 14:02:30 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:50.497 14:02:30 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:50.756 14:02:30 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:51.014 14:02:31 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:51.014 14:02:31 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:51.271 14:02:31 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:51.530 14:02:31 -- host/failover.sh@101 -- # sleep 3 00:28:54.815 14:02:34 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:54.815 14:02:34 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:54.815 14:02:35 -- host/failover.sh@108 -- # killprocess 2410619 00:28:54.815 14:02:35 -- common/autotest_common.sh@936 -- # '[' -z 2410619 ']' 00:28:54.815 14:02:35 -- common/autotest_common.sh@940 -- # kill -0 2410619 00:28:54.815 14:02:35 -- common/autotest_common.sh@941 -- # uname 00:28:54.815 14:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:54.815 14:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2410619 00:28:54.815 14:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:54.815 14:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:54.815 14:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2410619' 00:28:54.815 killing process with pid 2410619 00:28:54.815 14:02:35 -- common/autotest_common.sh@955 -- # kill 2410619 00:28:54.815 14:02:35 -- common/autotest_common.sh@960 -- # wait 2410619 00:28:55.073 14:02:35 -- host/failover.sh@110 -- # sync 00:28:55.073 14:02:35 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:55.330 14:02:35 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:55.330 14:02:35 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:55.330 14:02:35 -- host/failover.sh@116 -- # nvmftestfini 00:28:55.330 14:02:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:55.330 14:02:35 -- nvmf/common.sh@116 -- # sync 00:28:55.330 14:02:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:55.330 14:02:35 -- nvmf/common.sh@119 -- # set +e 00:28:55.330 14:02:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:55.330 14:02:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:55.330 rmmod nvme_tcp 00:28:55.330 rmmod nvme_fabrics 00:28:55.330 rmmod nvme_keyring 00:28:55.330 14:02:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:55.330 14:02:35 -- nvmf/common.sh@123 -- # set -e 00:28:55.330 14:02:35 -- nvmf/common.sh@124 -- # return 0 00:28:55.330 14:02:35 -- nvmf/common.sh@477 -- # '[' -n 2408260 ']' 00:28:55.330 14:02:35 -- nvmf/common.sh@478 -- # killprocess 2408260 00:28:55.330 14:02:35 -- common/autotest_common.sh@936 -- # '[' -z 2408260 ']' 00:28:55.330 14:02:35 -- common/autotest_common.sh@940 -- # kill -0 2408260 00:28:55.330 14:02:35 -- common/autotest_common.sh@941 -- # uname 00:28:55.330 14:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:55.330 14:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2408260 00:28:55.591 14:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:55.591 14:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:55.591 14:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2408260' 00:28:55.591 killing process with pid 2408260 00:28:55.591 14:02:35 -- common/autotest_common.sh@955 -- # kill 2408260 00:28:55.591 14:02:35 -- common/autotest_common.sh@960 -- # wait 2408260 00:28:55.850 14:02:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:55.850 14:02:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:55.850 14:02:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:55.850 14:02:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:55.850 14:02:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:55.850 14:02:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:55.850 14:02:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:55.850 14:02:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:57.799 14:02:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:57.799 00:28:57.799 real 0m37.203s 00:28:57.799 user 2m11.028s 00:28:57.799 sys 0m6.293s 00:28:57.799 14:02:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:57.799 14:02:37 -- common/autotest_common.sh@10 -- # set +x 00:28:57.799 ************************************ 00:28:57.799 END TEST nvmf_failover 00:28:57.799 ************************************ 00:28:57.799 14:02:37 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:57.799 14:02:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:57.799 14:02:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:57.799 14:02:37 -- common/autotest_common.sh@10 -- # set +x 00:28:57.799 ************************************ 00:28:57.799 START TEST nvmf_discovery 00:28:57.799 ************************************ 00:28:57.799 14:02:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:57.799 * Looking for test storage... 00:28:57.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:57.799 14:02:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:57.799 14:02:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:57.799 14:02:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:58.090 14:02:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:58.090 14:02:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:58.090 14:02:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:58.090 14:02:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:58.090 14:02:38 -- scripts/common.sh@335 -- # IFS=.-: 00:28:58.090 14:02:38 -- scripts/common.sh@335 -- # read -ra ver1 00:28:58.090 14:02:38 -- scripts/common.sh@336 -- # IFS=.-: 00:28:58.090 14:02:38 -- scripts/common.sh@336 -- # read -ra ver2 00:28:58.090 14:02:38 -- scripts/common.sh@337 -- # local 'op=<' 00:28:58.090 14:02:38 -- scripts/common.sh@339 -- # ver1_l=2 00:28:58.090 14:02:38 -- scripts/common.sh@340 -- # ver2_l=1 00:28:58.090 14:02:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:58.090 14:02:38 -- scripts/common.sh@343 -- # case "$op" in 00:28:58.090 14:02:38 -- scripts/common.sh@344 -- # : 1 00:28:58.090 14:02:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:58.090 14:02:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:58.090 14:02:38 -- scripts/common.sh@364 -- # decimal 1 00:28:58.090 14:02:38 -- scripts/common.sh@352 -- # local d=1 00:28:58.090 14:02:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:58.090 14:02:38 -- scripts/common.sh@354 -- # echo 1 00:28:58.090 14:02:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:58.090 14:02:38 -- scripts/common.sh@365 -- # decimal 2 00:28:58.090 14:02:38 -- scripts/common.sh@352 -- # local d=2 00:28:58.090 14:02:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:58.090 14:02:38 -- scripts/common.sh@354 -- # echo 2 00:28:58.090 14:02:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:58.090 14:02:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:58.090 14:02:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:58.090 14:02:38 -- scripts/common.sh@367 -- # return 0 00:28:58.090 14:02:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:58.090 14:02:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:58.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:58.090 --rc genhtml_branch_coverage=1 00:28:58.090 --rc genhtml_function_coverage=1 00:28:58.090 --rc genhtml_legend=1 00:28:58.090 --rc geninfo_all_blocks=1 00:28:58.090 --rc geninfo_unexecuted_blocks=1 00:28:58.090 00:28:58.090 ' 00:28:58.090 14:02:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:58.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:58.090 --rc genhtml_branch_coverage=1 00:28:58.090 --rc genhtml_function_coverage=1 00:28:58.090 --rc genhtml_legend=1 00:28:58.090 --rc geninfo_all_blocks=1 00:28:58.090 --rc geninfo_unexecuted_blocks=1 00:28:58.090 00:28:58.090 ' 00:28:58.090 14:02:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:58.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:58.090 --rc genhtml_branch_coverage=1 00:28:58.090 --rc genhtml_function_coverage=1 00:28:58.090 --rc genhtml_legend=1 00:28:58.090 --rc geninfo_all_blocks=1 00:28:58.090 --rc geninfo_unexecuted_blocks=1 00:28:58.090 00:28:58.090 ' 00:28:58.090 14:02:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:58.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:58.090 --rc genhtml_branch_coverage=1 00:28:58.090 --rc genhtml_function_coverage=1 00:28:58.090 --rc genhtml_legend=1 00:28:58.090 --rc geninfo_all_blocks=1 00:28:58.090 --rc geninfo_unexecuted_blocks=1 00:28:58.090 00:28:58.090 ' 00:28:58.090 14:02:38 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:58.090 14:02:38 -- nvmf/common.sh@7 -- # uname -s 00:28:58.090 14:02:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:58.090 14:02:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:58.090 14:02:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:58.090 14:02:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:58.090 14:02:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:58.090 14:02:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:58.090 14:02:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:58.090 14:02:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:58.090 14:02:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:58.090 14:02:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:58.090 14:02:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:58.090 14:02:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:58.090 14:02:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:58.090 14:02:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:58.090 14:02:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:58.090 14:02:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:58.090 14:02:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:58.090 14:02:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:58.090 14:02:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:58.090 14:02:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:58.090 14:02:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:58.090 14:02:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:58.090 14:02:38 -- paths/export.sh@5 -- # export PATH 00:28:58.090 14:02:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:58.090 14:02:38 -- nvmf/common.sh@46 -- # : 0 00:28:58.090 14:02:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:58.090 14:02:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:58.090 14:02:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:58.090 14:02:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:58.090 14:02:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:58.090 14:02:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:58.090 14:02:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:58.090 14:02:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:58.090 14:02:38 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:58.090 14:02:38 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:58.090 14:02:38 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:58.090 14:02:38 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:58.090 14:02:38 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:58.090 14:02:38 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:58.090 14:02:38 -- host/discovery.sh@25 -- # nvmftestinit 00:28:58.090 14:02:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:58.090 14:02:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:58.090 14:02:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:58.090 14:02:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:58.090 14:02:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:58.090 14:02:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:58.091 14:02:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:58.091 14:02:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:58.091 14:02:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:58.091 14:02:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:58.091 14:02:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:58.091 14:02:38 -- common/autotest_common.sh@10 -- # set +x 00:28:59.987 14:02:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:59.987 14:02:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:59.987 14:02:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:59.987 14:02:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:59.987 14:02:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:59.987 14:02:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:59.987 14:02:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:59.987 14:02:40 -- nvmf/common.sh@294 -- # net_devs=() 00:28:59.987 14:02:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:59.987 14:02:40 -- nvmf/common.sh@295 -- # e810=() 00:28:59.987 14:02:40 -- nvmf/common.sh@295 -- # local -ga e810 00:28:59.987 14:02:40 -- nvmf/common.sh@296 -- # x722=() 00:28:59.987 14:02:40 -- nvmf/common.sh@296 -- # local -ga x722 00:28:59.987 14:02:40 -- nvmf/common.sh@297 -- # mlx=() 00:28:59.987 14:02:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:59.987 14:02:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:59.987 14:02:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:59.987 14:02:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:59.987 14:02:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:59.987 14:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:59.987 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:59.987 14:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:59.987 14:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:59.987 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:59.987 14:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:59.987 14:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:59.987 14:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:59.987 14:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:59.987 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:59.987 14:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:59.987 14:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:59.987 14:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:59.987 14:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:59.987 14:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:59.987 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:59.987 14:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:59.987 14:02:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:59.987 14:02:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:59.987 14:02:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:59.987 14:02:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:59.987 14:02:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:59.987 14:02:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:59.987 14:02:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:59.987 14:02:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:59.987 14:02:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:59.987 14:02:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:59.987 14:02:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:59.987 14:02:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:59.987 14:02:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:59.987 14:02:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:59.987 14:02:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:59.987 14:02:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:59.987 14:02:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:59.987 14:02:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:00.244 14:02:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:00.244 14:02:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:00.244 14:02:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:00.244 14:02:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:00.244 14:02:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:00.244 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:00.244 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:29:00.244 00:29:00.244 --- 10.0.0.2 ping statistics --- 00:29:00.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:00.244 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:29:00.244 14:02:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:00.244 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:00.244 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:29:00.244 00:29:00.244 --- 10.0.0.1 ping statistics --- 00:29:00.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:00.244 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:29:00.244 14:02:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:00.244 14:02:40 -- nvmf/common.sh@410 -- # return 0 00:29:00.244 14:02:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:00.244 14:02:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:00.244 14:02:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:00.244 14:02:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:00.244 14:02:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:00.244 14:02:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:00.244 14:02:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:00.244 14:02:40 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:00.244 14:02:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:00.244 14:02:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:00.244 14:02:40 -- common/autotest_common.sh@10 -- # set +x 00:29:00.244 14:02:40 -- nvmf/common.sh@469 -- # nvmfpid=2414202 00:29:00.244 14:02:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:00.244 14:02:40 -- nvmf/common.sh@470 -- # waitforlisten 2414202 00:29:00.244 14:02:40 -- common/autotest_common.sh@829 -- # '[' -z 2414202 ']' 00:29:00.244 14:02:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:00.244 14:02:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:00.244 14:02:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:00.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:00.244 14:02:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:00.244 14:02:40 -- common/autotest_common.sh@10 -- # set +x 00:29:00.244 [2024-11-29 14:02:40.400470] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:00.244 [2024-11-29 14:02:40.400540] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:00.244 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.244 [2024-11-29 14:02:40.463714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:00.503 [2024-11-29 14:02:40.547702] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:00.503 [2024-11-29 14:02:40.547861] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:00.503 [2024-11-29 14:02:40.547878] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:00.503 [2024-11-29 14:02:40.547898] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:00.503 [2024-11-29 14:02:40.547929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:01.438 14:02:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:01.438 14:02:41 -- common/autotest_common.sh@862 -- # return 0 00:29:01.438 14:02:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:01.438 14:02:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 14:02:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:01.438 14:02:41 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:01.438 14:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 [2024-11-29 14:02:41.390460] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:01.438 14:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.438 14:02:41 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:01.438 14:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 [2024-11-29 14:02:41.398649] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:01.438 14:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.438 14:02:41 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:01.438 14:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 null0 00:29:01.438 14:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.438 14:02:41 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:01.438 14:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 null1 00:29:01.438 14:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.438 14:02:41 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:01.438 14:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 14:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.438 14:02:41 -- host/discovery.sh@45 -- # hostpid=2414354 00:29:01.438 14:02:41 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:01.438 14:02:41 -- host/discovery.sh@46 -- # waitforlisten 2414354 /tmp/host.sock 00:29:01.438 14:02:41 -- common/autotest_common.sh@829 -- # '[' -z 2414354 ']' 00:29:01.438 14:02:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:01.438 14:02:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:01.438 14:02:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:01.438 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:01.438 14:02:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:01.438 14:02:41 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 [2024-11-29 14:02:41.468449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:01.438 [2024-11-29 14:02:41.468530] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2414354 ] 00:29:01.438 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.438 [2024-11-29 14:02:41.530159] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:01.438 [2024-11-29 14:02:41.618858] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:01.438 [2024-11-29 14:02:41.619033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:02.375 14:02:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:02.375 14:02:42 -- common/autotest_common.sh@862 -- # return 0 00:29:02.375 14:02:42 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:02.375 14:02:42 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:02.375 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.375 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.375 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.375 14:02:42 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:02.375 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.375 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.375 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.375 14:02:42 -- host/discovery.sh@72 -- # notify_id=0 00:29:02.375 14:02:42 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:02.375 14:02:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.375 14:02:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.375 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.375 14:02:42 -- host/discovery.sh@59 -- # sort 00:29:02.375 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.376 14:02:42 -- host/discovery.sh@59 -- # xargs 00:29:02.376 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.376 14:02:42 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:02.376 14:02:42 -- host/discovery.sh@79 -- # get_bdev_list 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.376 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.376 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # sort 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # xargs 00:29:02.376 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.376 14:02:42 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:02.376 14:02:42 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:02.376 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.376 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.376 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.376 14:02:42 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:02.376 14:02:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.376 14:02:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.376 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.376 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.376 14:02:42 -- host/discovery.sh@59 -- # sort 00:29:02.376 14:02:42 -- host/discovery.sh@59 -- # xargs 00:29:02.376 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.376 14:02:42 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:02.376 14:02:42 -- host/discovery.sh@83 -- # get_bdev_list 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.376 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.376 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # sort 00:29:02.376 14:02:42 -- host/discovery.sh@55 -- # xargs 00:29:02.376 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.376 14:02:42 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:02.376 14:02:42 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:02.376 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.376 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # sort 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # xargs 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:02.634 14:02:42 -- host/discovery.sh@87 -- # get_bdev_list 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # sort 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # xargs 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:02.634 14:02:42 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 [2024-11-29 14:02:42.742309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # sort 00:29:02.634 14:02:42 -- host/discovery.sh@59 -- # xargs 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:02.634 14:02:42 -- host/discovery.sh@93 -- # get_bdev_list 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # sort 00:29:02.634 14:02:42 -- host/discovery.sh@55 -- # xargs 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:02.634 14:02:42 -- host/discovery.sh@94 -- # get_notification_count 00:29:02.634 14:02:42 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- host/discovery.sh@74 -- # jq '. | length' 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@74 -- # notification_count=0 00:29:02.634 14:02:42 -- host/discovery.sh@75 -- # notify_id=0 00:29:02.634 14:02:42 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:02.634 14:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.634 14:02:42 -- common/autotest_common.sh@10 -- # set +x 00:29:02.634 14:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.634 14:02:42 -- host/discovery.sh@100 -- # sleep 1 00:29:03.578 [2024-11-29 14:02:43.540561] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:03.578 [2024-11-29 14:02:43.540592] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:03.578 [2024-11-29 14:02:43.540617] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:03.578 [2024-11-29 14:02:43.626886] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:03.578 [2024-11-29 14:02:43.690620] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:03.578 [2024-11-29 14:02:43.690643] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:03.838 14:02:43 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:03.838 14:02:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:03.838 14:02:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:03.838 14:02:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.838 14:02:43 -- host/discovery.sh@59 -- # sort 00:29:03.838 14:02:43 -- common/autotest_common.sh@10 -- # set +x 00:29:03.838 14:02:43 -- host/discovery.sh@59 -- # xargs 00:29:03.838 14:02:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@102 -- # get_bdev_list 00:29:03.838 14:02:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.838 14:02:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:03.838 14:02:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.838 14:02:43 -- common/autotest_common.sh@10 -- # set +x 00:29:03.838 14:02:43 -- host/discovery.sh@55 -- # sort 00:29:03.838 14:02:43 -- host/discovery.sh@55 -- # xargs 00:29:03.838 14:02:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:03.838 14:02:43 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:03.838 14:02:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.838 14:02:43 -- common/autotest_common.sh@10 -- # set +x 00:29:03.838 14:02:43 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:03.838 14:02:43 -- host/discovery.sh@63 -- # sort -n 00:29:03.838 14:02:43 -- host/discovery.sh@63 -- # xargs 00:29:03.838 14:02:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:03.838 14:02:43 -- host/discovery.sh@104 -- # get_notification_count 00:29:03.838 14:02:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:03.838 14:02:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.838 14:02:43 -- host/discovery.sh@74 -- # jq '. | length' 00:29:03.838 14:02:44 -- common/autotest_common.sh@10 -- # set +x 00:29:03.838 14:02:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.838 14:02:44 -- host/discovery.sh@74 -- # notification_count=1 00:29:03.838 14:02:44 -- host/discovery.sh@75 -- # notify_id=1 00:29:03.838 14:02:44 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:03.838 14:02:44 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:03.838 14:02:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.838 14:02:44 -- common/autotest_common.sh@10 -- # set +x 00:29:03.838 14:02:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.838 14:02:44 -- host/discovery.sh@109 -- # sleep 1 00:29:04.771 14:02:45 -- host/discovery.sh@110 -- # get_bdev_list 00:29:04.771 14:02:45 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.771 14:02:45 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.771 14:02:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.771 14:02:45 -- host/discovery.sh@55 -- # sort 00:29:04.771 14:02:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.771 14:02:45 -- host/discovery.sh@55 -- # xargs 00:29:05.031 14:02:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.031 14:02:45 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:05.031 14:02:45 -- host/discovery.sh@111 -- # get_notification_count 00:29:05.031 14:02:45 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:05.031 14:02:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.031 14:02:45 -- host/discovery.sh@74 -- # jq '. | length' 00:29:05.031 14:02:45 -- common/autotest_common.sh@10 -- # set +x 00:29:05.031 14:02:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.031 14:02:45 -- host/discovery.sh@74 -- # notification_count=1 00:29:05.031 14:02:45 -- host/discovery.sh@75 -- # notify_id=2 00:29:05.031 14:02:45 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:05.031 14:02:45 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:05.031 14:02:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.031 14:02:45 -- common/autotest_common.sh@10 -- # set +x 00:29:05.031 [2024-11-29 14:02:45.133548] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:05.031 [2024-11-29 14:02:45.134667] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:05.031 [2024-11-29 14:02:45.134714] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:05.031 14:02:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.031 14:02:45 -- host/discovery.sh@117 -- # sleep 1 00:29:05.031 [2024-11-29 14:02:45.223011] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:05.031 [2024-11-29 14:02:45.285539] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:05.031 [2024-11-29 14:02:45.285570] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:05.031 [2024-11-29 14:02:45.285580] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:05.968 14:02:46 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:05.968 14:02:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:05.968 14:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.968 14:02:46 -- common/autotest_common.sh@10 -- # set +x 00:29:05.968 14:02:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:05.968 14:02:46 -- host/discovery.sh@59 -- # sort 00:29:05.968 14:02:46 -- host/discovery.sh@59 -- # xargs 00:29:05.968 14:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.968 14:02:46 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.968 14:02:46 -- host/discovery.sh@119 -- # get_bdev_list 00:29:05.968 14:02:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.968 14:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.968 14:02:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:05.968 14:02:46 -- common/autotest_common.sh@10 -- # set +x 00:29:05.968 14:02:46 -- host/discovery.sh@55 -- # sort 00:29:05.968 14:02:46 -- host/discovery.sh@55 -- # xargs 00:29:05.968 14:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.968 14:02:46 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:05.968 14:02:46 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:05.968 14:02:46 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:05.968 14:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.968 14:02:46 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:05.968 14:02:46 -- common/autotest_common.sh@10 -- # set +x 00:29:05.968 14:02:46 -- host/discovery.sh@63 -- # sort -n 00:29:05.968 14:02:46 -- host/discovery.sh@63 -- # xargs 00:29:05.968 14:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.227 14:02:46 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:06.227 14:02:46 -- host/discovery.sh@121 -- # get_notification_count 00:29:06.227 14:02:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:06.227 14:02:46 -- host/discovery.sh@74 -- # jq '. | length' 00:29:06.227 14:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.227 14:02:46 -- common/autotest_common.sh@10 -- # set +x 00:29:06.227 14:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.227 14:02:46 -- host/discovery.sh@74 -- # notification_count=0 00:29:06.227 14:02:46 -- host/discovery.sh@75 -- # notify_id=2 00:29:06.227 14:02:46 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:06.227 14:02:46 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:06.227 14:02:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.227 14:02:46 -- common/autotest_common.sh@10 -- # set +x 00:29:06.227 [2024-11-29 14:02:46.297457] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:06.227 [2024-11-29 14:02:46.297488] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:06.227 14:02:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.227 14:02:46 -- host/discovery.sh@127 -- # sleep 1 00:29:06.227 [2024-11-29 14:02:46.301927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.227 [2024-11-29 14:02:46.301961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.227 [2024-11-29 14:02:46.301980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.227 [2024-11-29 14:02:46.301995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.227 [2024-11-29 14:02:46.302010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.227 [2024-11-29 14:02:46.302025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.227 [2024-11-29 14:02:46.302047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:06.227 [2024-11-29 14:02:46.302062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:06.227 [2024-11-29 14:02:46.302076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.227 [2024-11-29 14:02:46.311931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.227 [2024-11-29 14:02:46.321978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.227 [2024-11-29 14:02:46.322241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.227 [2024-11-29 14:02:46.322373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.227 [2024-11-29 14:02:46.322408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.227 [2024-11-29 14:02:46.322427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.227 [2024-11-29 14:02:46.322449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.322470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.322485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.322500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.322520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.332059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.332269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.332388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.332420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.332437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.332458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.332479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.332492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.332505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.332524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.342136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.342306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.342416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.342442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.342457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.342479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.342504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.342518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.342530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.342548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.352216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.352352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.352541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.352567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.352583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.352605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.352624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.352637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.352649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.352680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.362293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.362469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.362626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.362652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.362668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.362696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.362730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.362748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.362761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.362780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.372369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.372581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.372711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.372737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.372753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.372774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.372807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.372823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.372842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.372861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.382455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.382649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.382777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.382805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.382821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.382843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.382902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.382921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.382935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.228 [2024-11-29 14:02:46.382954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.228 [2024-11-29 14:02:46.392523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.228 [2024-11-29 14:02:46.392673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.392802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.228 [2024-11-29 14:02:46.392827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.228 [2024-11-29 14:02:46.392843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.228 [2024-11-29 14:02:46.392864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.228 [2024-11-29 14:02:46.392883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.228 [2024-11-29 14:02:46.392897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.228 [2024-11-29 14:02:46.392910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.229 [2024-11-29 14:02:46.392941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.229 [2024-11-29 14:02:46.402593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.229 [2024-11-29 14:02:46.402847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.402950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.402975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.229 [2024-11-29 14:02:46.402991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.229 [2024-11-29 14:02:46.403012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.229 [2024-11-29 14:02:46.403055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.229 [2024-11-29 14:02:46.403075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.229 [2024-11-29 14:02:46.403088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.229 [2024-11-29 14:02:46.403111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.229 [2024-11-29 14:02:46.412660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.229 [2024-11-29 14:02:46.412906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.413011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.413038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.229 [2024-11-29 14:02:46.413054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.229 [2024-11-29 14:02:46.413075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.229 [2024-11-29 14:02:46.413107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.229 [2024-11-29 14:02:46.413124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.229 [2024-11-29 14:02:46.413137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.229 [2024-11-29 14:02:46.413156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.229 [2024-11-29 14:02:46.422751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:06.229 [2024-11-29 14:02:46.422927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.423061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.229 [2024-11-29 14:02:46.423087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c4410 with addr=10.0.0.2, port=4420 00:29:06.229 [2024-11-29 14:02:46.423103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9c4410 is same with the state(5) to be set 00:29:06.229 [2024-11-29 14:02:46.423124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4410 (9): Bad file descriptor 00:29:06.229 [2024-11-29 14:02:46.423167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:06.229 [2024-11-29 14:02:46.423186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:06.229 [2024-11-29 14:02:46.423199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:06.229 [2024-11-29 14:02:46.423218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:06.229 [2024-11-29 14:02:46.424161] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:06.229 [2024-11-29 14:02:46.424190] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:07.166 14:02:47 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:07.166 14:02:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:07.166 14:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.166 14:02:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:07.166 14:02:47 -- host/discovery.sh@59 -- # sort 00:29:07.166 14:02:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.166 14:02:47 -- host/discovery.sh@59 -- # xargs 00:29:07.166 14:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@129 -- # get_bdev_list 00:29:07.166 14:02:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.166 14:02:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:07.166 14:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.166 14:02:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.166 14:02:47 -- host/discovery.sh@55 -- # sort 00:29:07.166 14:02:47 -- host/discovery.sh@55 -- # xargs 00:29:07.166 14:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:07.166 14:02:47 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:07.166 14:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.166 14:02:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.166 14:02:47 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:07.166 14:02:47 -- host/discovery.sh@63 -- # sort -n 00:29:07.166 14:02:47 -- host/discovery.sh@63 -- # xargs 00:29:07.166 14:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:07.166 14:02:47 -- host/discovery.sh@131 -- # get_notification_count 00:29:07.166 14:02:47 -- host/discovery.sh@74 -- # jq '. | length' 00:29:07.166 14:02:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:07.166 14:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.166 14:02:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.166 14:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.425 14:02:47 -- host/discovery.sh@74 -- # notification_count=0 00:29:07.425 14:02:47 -- host/discovery.sh@75 -- # notify_id=2 00:29:07.425 14:02:47 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:07.425 14:02:47 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:07.425 14:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.425 14:02:47 -- common/autotest_common.sh@10 -- # set +x 00:29:07.425 14:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.425 14:02:47 -- host/discovery.sh@135 -- # sleep 1 00:29:08.362 14:02:48 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:08.362 14:02:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:08.362 14:02:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:08.362 14:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.362 14:02:48 -- host/discovery.sh@59 -- # sort 00:29:08.362 14:02:48 -- common/autotest_common.sh@10 -- # set +x 00:29:08.362 14:02:48 -- host/discovery.sh@59 -- # xargs 00:29:08.362 14:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.362 14:02:48 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:08.362 14:02:48 -- host/discovery.sh@137 -- # get_bdev_list 00:29:08.362 14:02:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:08.362 14:02:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:08.362 14:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.362 14:02:48 -- common/autotest_common.sh@10 -- # set +x 00:29:08.362 14:02:48 -- host/discovery.sh@55 -- # sort 00:29:08.362 14:02:48 -- host/discovery.sh@55 -- # xargs 00:29:08.362 14:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.362 14:02:48 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:08.362 14:02:48 -- host/discovery.sh@138 -- # get_notification_count 00:29:08.362 14:02:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:08.362 14:02:48 -- host/discovery.sh@74 -- # jq '. | length' 00:29:08.362 14:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.362 14:02:48 -- common/autotest_common.sh@10 -- # set +x 00:29:08.362 14:02:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.362 14:02:48 -- host/discovery.sh@74 -- # notification_count=2 00:29:08.362 14:02:48 -- host/discovery.sh@75 -- # notify_id=4 00:29:08.362 14:02:48 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:08.362 14:02:48 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.362 14:02:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.362 14:02:48 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 [2024-11-29 14:02:49.666073] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:09.741 [2024-11-29 14:02:49.666098] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:09.741 [2024-11-29 14:02:49.666120] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:09.741 [2024-11-29 14:02:49.795720] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:09.741 [2024-11-29 14:02:49.860793] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:09.741 [2024-11-29 14:02:49.860831] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.741 14:02:49 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@650 -- # local es=0 00:29:09.741 14:02:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.741 14:02:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:49 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 request: 00:29:09.741 { 00:29:09.741 "name": "nvme", 00:29:09.741 "trtype": "tcp", 00:29:09.741 "traddr": "10.0.0.2", 00:29:09.741 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:09.741 "adrfam": "ipv4", 00:29:09.741 "trsvcid": "8009", 00:29:09.741 "wait_for_attach": true, 00:29:09.741 "method": "bdev_nvme_start_discovery", 00:29:09.741 "req_id": 1 00:29:09.741 } 00:29:09.741 Got JSON-RPC error response 00:29:09.741 response: 00:29:09.741 { 00:29:09.741 "code": -17, 00:29:09.741 "message": "File exists" 00:29:09.741 } 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:09.741 14:02:49 -- common/autotest_common.sh@653 -- # es=1 00:29:09.741 14:02:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:09.741 14:02:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:09.741 14:02:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:09.741 14:02:49 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:09.741 14:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:49 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # sort 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # xargs 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.741 14:02:49 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:09.741 14:02:49 -- host/discovery.sh@147 -- # get_bdev_list 00:29:09.741 14:02:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.741 14:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.741 14:02:49 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 14:02:49 -- host/discovery.sh@55 -- # sort 00:29:09.741 14:02:49 -- host/discovery.sh@55 -- # xargs 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.741 14:02:49 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:09.741 14:02:49 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@650 -- # local es=0 00:29:09.741 14:02:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:09.741 14:02:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.741 14:02:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.741 14:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:49 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 request: 00:29:09.741 { 00:29:09.741 "name": "nvme_second", 00:29:09.741 "trtype": "tcp", 00:29:09.741 "traddr": "10.0.0.2", 00:29:09.741 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:09.741 "adrfam": "ipv4", 00:29:09.741 "trsvcid": "8009", 00:29:09.741 "wait_for_attach": true, 00:29:09.741 "method": "bdev_nvme_start_discovery", 00:29:09.741 "req_id": 1 00:29:09.741 } 00:29:09.741 Got JSON-RPC error response 00:29:09.741 response: 00:29:09.741 { 00:29:09.741 "code": -17, 00:29:09.741 "message": "File exists" 00:29:09.741 } 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:09.741 14:02:49 -- common/autotest_common.sh@653 -- # es=1 00:29:09.741 14:02:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:09.741 14:02:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:09.741 14:02:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:09.741 14:02:49 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:09.741 14:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:09.741 14:02:49 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # sort 00:29:09.741 14:02:49 -- host/discovery.sh@67 -- # xargs 00:29:09.741 14:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.741 14:02:50 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:09.741 14:02:50 -- host/discovery.sh@153 -- # get_bdev_list 00:29:09.741 14:02:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.741 14:02:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.741 14:02:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.741 14:02:50 -- common/autotest_common.sh@10 -- # set +x 00:29:09.741 14:02:50 -- host/discovery.sh@55 -- # sort 00:29:09.741 14:02:50 -- host/discovery.sh@55 -- # xargs 00:29:10.000 14:02:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.000 14:02:50 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:10.000 14:02:50 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:10.000 14:02:50 -- common/autotest_common.sh@650 -- # local es=0 00:29:10.000 14:02:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:10.000 14:02:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:10.000 14:02:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:10.000 14:02:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:10.000 14:02:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:10.000 14:02:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:10.000 14:02:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.000 14:02:50 -- common/autotest_common.sh@10 -- # set +x 00:29:10.941 [2024-11-29 14:02:51.057050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.941 [2024-11-29 14:02:51.057189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.941 [2024-11-29 14:02:51.057219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b2e0 with addr=10.0.0.2, port=8010 00:29:10.941 [2024-11-29 14:02:51.057249] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:10.941 [2024-11-29 14:02:51.057265] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:10.941 [2024-11-29 14:02:51.057279] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:11.875 [2024-11-29 14:02:52.059448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.875 [2024-11-29 14:02:52.059590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.875 [2024-11-29 14:02:52.059616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x93b2e0 with addr=10.0.0.2, port=8010 00:29:11.875 [2024-11-29 14:02:52.059635] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:11.875 [2024-11-29 14:02:52.059647] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:11.875 [2024-11-29 14:02:52.059659] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:12.810 [2024-11-29 14:02:53.061709] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:12.810 request: 00:29:12.810 { 00:29:12.811 "name": "nvme_second", 00:29:12.811 "trtype": "tcp", 00:29:12.811 "traddr": "10.0.0.2", 00:29:12.811 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:12.811 "adrfam": "ipv4", 00:29:12.811 "trsvcid": "8010", 00:29:12.811 "attach_timeout_ms": 3000, 00:29:12.811 "method": "bdev_nvme_start_discovery", 00:29:12.811 "req_id": 1 00:29:12.811 } 00:29:12.811 Got JSON-RPC error response 00:29:12.811 response: 00:29:12.811 { 00:29:12.811 "code": -110, 00:29:12.811 "message": "Connection timed out" 00:29:12.811 } 00:29:12.811 14:02:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:12.811 14:02:53 -- common/autotest_common.sh@653 -- # es=1 00:29:12.811 14:02:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:12.811 14:02:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:12.811 14:02:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:12.811 14:02:53 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:12.811 14:02:53 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:12.811 14:02:53 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:12.811 14:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.811 14:02:53 -- host/discovery.sh@67 -- # sort 00:29:12.811 14:02:53 -- common/autotest_common.sh@10 -- # set +x 00:29:12.811 14:02:53 -- host/discovery.sh@67 -- # xargs 00:29:12.811 14:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.069 14:02:53 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:13.069 14:02:53 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:13.069 14:02:53 -- host/discovery.sh@162 -- # kill 2414354 00:29:13.069 14:02:53 -- host/discovery.sh@163 -- # nvmftestfini 00:29:13.069 14:02:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:13.069 14:02:53 -- nvmf/common.sh@116 -- # sync 00:29:13.069 14:02:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:13.069 14:02:53 -- nvmf/common.sh@119 -- # set +e 00:29:13.069 14:02:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:13.069 14:02:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:13.069 rmmod nvme_tcp 00:29:13.069 rmmod nvme_fabrics 00:29:13.069 rmmod nvme_keyring 00:29:13.069 14:02:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:13.069 14:02:53 -- nvmf/common.sh@123 -- # set -e 00:29:13.069 14:02:53 -- nvmf/common.sh@124 -- # return 0 00:29:13.069 14:02:53 -- nvmf/common.sh@477 -- # '[' -n 2414202 ']' 00:29:13.069 14:02:53 -- nvmf/common.sh@478 -- # killprocess 2414202 00:29:13.069 14:02:53 -- common/autotest_common.sh@936 -- # '[' -z 2414202 ']' 00:29:13.069 14:02:53 -- common/autotest_common.sh@940 -- # kill -0 2414202 00:29:13.069 14:02:53 -- common/autotest_common.sh@941 -- # uname 00:29:13.069 14:02:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:13.069 14:02:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2414202 00:29:13.069 14:02:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:13.069 14:02:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:13.069 14:02:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2414202' 00:29:13.069 killing process with pid 2414202 00:29:13.069 14:02:53 -- common/autotest_common.sh@955 -- # kill 2414202 00:29:13.069 14:02:53 -- common/autotest_common.sh@960 -- # wait 2414202 00:29:13.327 14:02:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:13.327 14:02:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:13.327 14:02:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:13.327 14:02:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:13.327 14:02:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:13.327 14:02:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:13.327 14:02:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:13.327 14:02:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.232 14:02:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:15.232 00:29:15.232 real 0m17.519s 00:29:15.232 user 0m26.997s 00:29:15.232 sys 0m2.970s 00:29:15.232 14:02:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:15.232 14:02:55 -- common/autotest_common.sh@10 -- # set +x 00:29:15.232 ************************************ 00:29:15.232 END TEST nvmf_discovery 00:29:15.232 ************************************ 00:29:15.232 14:02:55 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:15.232 14:02:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:15.232 14:02:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:15.232 14:02:55 -- common/autotest_common.sh@10 -- # set +x 00:29:15.232 ************************************ 00:29:15.232 START TEST nvmf_discovery_remove_ifc 00:29:15.232 ************************************ 00:29:15.232 14:02:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:15.490 * Looking for test storage... 00:29:15.490 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:15.490 14:02:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:15.490 14:02:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:15.490 14:02:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:15.490 14:02:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:15.490 14:02:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:15.490 14:02:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:15.490 14:02:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:15.490 14:02:55 -- scripts/common.sh@335 -- # IFS=.-: 00:29:15.490 14:02:55 -- scripts/common.sh@335 -- # read -ra ver1 00:29:15.490 14:02:55 -- scripts/common.sh@336 -- # IFS=.-: 00:29:15.490 14:02:55 -- scripts/common.sh@336 -- # read -ra ver2 00:29:15.490 14:02:55 -- scripts/common.sh@337 -- # local 'op=<' 00:29:15.490 14:02:55 -- scripts/common.sh@339 -- # ver1_l=2 00:29:15.490 14:02:55 -- scripts/common.sh@340 -- # ver2_l=1 00:29:15.490 14:02:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:15.490 14:02:55 -- scripts/common.sh@343 -- # case "$op" in 00:29:15.490 14:02:55 -- scripts/common.sh@344 -- # : 1 00:29:15.490 14:02:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:15.490 14:02:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:15.490 14:02:55 -- scripts/common.sh@364 -- # decimal 1 00:29:15.490 14:02:55 -- scripts/common.sh@352 -- # local d=1 00:29:15.490 14:02:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:15.490 14:02:55 -- scripts/common.sh@354 -- # echo 1 00:29:15.490 14:02:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:15.490 14:02:55 -- scripts/common.sh@365 -- # decimal 2 00:29:15.490 14:02:55 -- scripts/common.sh@352 -- # local d=2 00:29:15.490 14:02:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:15.490 14:02:55 -- scripts/common.sh@354 -- # echo 2 00:29:15.490 14:02:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:15.490 14:02:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:15.491 14:02:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:15.491 14:02:55 -- scripts/common.sh@367 -- # return 0 00:29:15.491 14:02:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:15.491 14:02:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:15.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.491 --rc genhtml_branch_coverage=1 00:29:15.491 --rc genhtml_function_coverage=1 00:29:15.491 --rc genhtml_legend=1 00:29:15.491 --rc geninfo_all_blocks=1 00:29:15.491 --rc geninfo_unexecuted_blocks=1 00:29:15.491 00:29:15.491 ' 00:29:15.491 14:02:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:15.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.491 --rc genhtml_branch_coverage=1 00:29:15.491 --rc genhtml_function_coverage=1 00:29:15.491 --rc genhtml_legend=1 00:29:15.491 --rc geninfo_all_blocks=1 00:29:15.491 --rc geninfo_unexecuted_blocks=1 00:29:15.491 00:29:15.491 ' 00:29:15.491 14:02:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:15.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.491 --rc genhtml_branch_coverage=1 00:29:15.491 --rc genhtml_function_coverage=1 00:29:15.491 --rc genhtml_legend=1 00:29:15.491 --rc geninfo_all_blocks=1 00:29:15.491 --rc geninfo_unexecuted_blocks=1 00:29:15.491 00:29:15.491 ' 00:29:15.491 14:02:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:15.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.491 --rc genhtml_branch_coverage=1 00:29:15.491 --rc genhtml_function_coverage=1 00:29:15.491 --rc genhtml_legend=1 00:29:15.491 --rc geninfo_all_blocks=1 00:29:15.491 --rc geninfo_unexecuted_blocks=1 00:29:15.491 00:29:15.491 ' 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:15.491 14:02:55 -- nvmf/common.sh@7 -- # uname -s 00:29:15.491 14:02:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:15.491 14:02:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:15.491 14:02:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:15.491 14:02:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:15.491 14:02:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:15.491 14:02:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:15.491 14:02:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:15.491 14:02:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:15.491 14:02:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:15.491 14:02:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:15.491 14:02:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.491 14:02:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.491 14:02:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:15.491 14:02:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:15.491 14:02:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:15.491 14:02:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:15.491 14:02:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:15.491 14:02:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:15.491 14:02:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:15.491 14:02:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.491 14:02:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.491 14:02:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.491 14:02:55 -- paths/export.sh@5 -- # export PATH 00:29:15.491 14:02:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.491 14:02:55 -- nvmf/common.sh@46 -- # : 0 00:29:15.491 14:02:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:15.491 14:02:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:15.491 14:02:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:15.491 14:02:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:15.491 14:02:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:15.491 14:02:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:15.491 14:02:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:15.491 14:02:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:15.491 14:02:55 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:15.491 14:02:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:15.491 14:02:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:15.491 14:02:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:15.491 14:02:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:15.491 14:02:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:15.491 14:02:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:15.491 14:02:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:15.491 14:02:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.491 14:02:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:15.491 14:02:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:15.491 14:02:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:15.491 14:02:55 -- common/autotest_common.sh@10 -- # set +x 00:29:18.022 14:02:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:18.022 14:02:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:18.022 14:02:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:18.022 14:02:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:18.022 14:02:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:18.022 14:02:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:18.022 14:02:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:18.022 14:02:57 -- nvmf/common.sh@294 -- # net_devs=() 00:29:18.022 14:02:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:18.022 14:02:57 -- nvmf/common.sh@295 -- # e810=() 00:29:18.022 14:02:57 -- nvmf/common.sh@295 -- # local -ga e810 00:29:18.022 14:02:57 -- nvmf/common.sh@296 -- # x722=() 00:29:18.022 14:02:57 -- nvmf/common.sh@296 -- # local -ga x722 00:29:18.022 14:02:57 -- nvmf/common.sh@297 -- # mlx=() 00:29:18.022 14:02:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:18.022 14:02:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:18.022 14:02:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:18.023 14:02:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:18.023 14:02:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:18.023 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:18.023 14:02:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:18.023 14:02:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:18.023 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:18.023 14:02:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:18.023 14:02:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:18.023 14:02:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:18.023 14:02:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:18.023 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:18.023 14:02:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:18.023 14:02:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:18.023 14:02:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:18.023 14:02:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:18.023 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:18.023 14:02:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:18.023 14:02:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:18.023 14:02:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:18.023 14:02:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:18.023 14:02:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:18.023 14:02:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:18.023 14:02:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:18.023 14:02:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:18.023 14:02:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:18.023 14:02:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:18.023 14:02:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:18.023 14:02:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:18.023 14:02:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:18.023 14:02:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:18.023 14:02:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:18.023 14:02:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:18.023 14:02:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:18.023 14:02:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:18.023 14:02:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:18.023 14:02:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:18.023 14:02:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:18.023 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:18.023 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:29:18.023 00:29:18.023 --- 10.0.0.2 ping statistics --- 00:29:18.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:18.023 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:29:18.023 14:02:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:18.023 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:18.023 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:29:18.023 00:29:18.023 --- 10.0.0.1 ping statistics --- 00:29:18.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:18.023 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:29:18.023 14:02:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:18.023 14:02:57 -- nvmf/common.sh@410 -- # return 0 00:29:18.023 14:02:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:18.023 14:02:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:18.023 14:02:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:18.023 14:02:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:18.023 14:02:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:18.023 14:02:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:18.023 14:02:57 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:18.023 14:02:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:18.023 14:02:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:18.023 14:02:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.023 14:02:57 -- nvmf/common.sh@469 -- # nvmfpid=2417837 00:29:18.023 14:02:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:18.023 14:02:57 -- nvmf/common.sh@470 -- # waitforlisten 2417837 00:29:18.023 14:02:57 -- common/autotest_common.sh@829 -- # '[' -z 2417837 ']' 00:29:18.023 14:02:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:18.023 14:02:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:18.023 14:02:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:18.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:18.023 14:02:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:18.023 14:02:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.023 [2024-11-29 14:02:57.924721] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:18.023 [2024-11-29 14:02:57.924813] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:18.023 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.023 [2024-11-29 14:02:57.996157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.023 [2024-11-29 14:02:58.082279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:18.023 [2024-11-29 14:02:58.082486] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:18.023 [2024-11-29 14:02:58.082506] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:18.023 [2024-11-29 14:02:58.082519] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:18.023 [2024-11-29 14:02:58.082547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:18.962 14:02:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:18.962 14:02:58 -- common/autotest_common.sh@862 -- # return 0 00:29:18.962 14:02:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:18.962 14:02:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:18.962 14:02:58 -- common/autotest_common.sh@10 -- # set +x 00:29:18.962 14:02:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:18.962 14:02:58 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:18.962 14:02:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.962 14:02:58 -- common/autotest_common.sh@10 -- # set +x 00:29:18.962 [2024-11-29 14:02:58.958295] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:18.962 [2024-11-29 14:02:58.966496] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:18.962 null0 00:29:18.962 [2024-11-29 14:02:58.998461] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.962 14:02:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.962 14:02:59 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2417998 00:29:18.962 14:02:59 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:18.962 14:02:59 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2417998 /tmp/host.sock 00:29:18.962 14:02:59 -- common/autotest_common.sh@829 -- # '[' -z 2417998 ']' 00:29:18.962 14:02:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:18.962 14:02:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:18.962 14:02:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:18.962 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:18.962 14:02:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:18.962 14:02:59 -- common/autotest_common.sh@10 -- # set +x 00:29:18.962 [2024-11-29 14:02:59.064742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:18.962 [2024-11-29 14:02:59.064818] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2417998 ] 00:29:18.962 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.962 [2024-11-29 14:02:59.127553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.963 [2024-11-29 14:02:59.218323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:18.963 [2024-11-29 14:02:59.218506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:19.221 14:02:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:19.221 14:02:59 -- common/autotest_common.sh@862 -- # return 0 00:29:19.221 14:02:59 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:19.221 14:02:59 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:19.221 14:02:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.221 14:02:59 -- common/autotest_common.sh@10 -- # set +x 00:29:19.221 14:02:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.221 14:02:59 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:19.221 14:02:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.221 14:02:59 -- common/autotest_common.sh@10 -- # set +x 00:29:19.221 14:02:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.221 14:02:59 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:19.221 14:02:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.221 14:02:59 -- common/autotest_common.sh@10 -- # set +x 00:29:20.161 [2024-11-29 14:03:00.436120] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:20.161 [2024-11-29 14:03:00.436169] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:20.161 [2024-11-29 14:03:00.436196] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:20.420 [2024-11-29 14:03:00.563600] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:20.420 [2024-11-29 14:03:00.626929] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:20.420 [2024-11-29 14:03:00.626978] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:20.420 [2024-11-29 14:03:00.627014] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:20.420 [2024-11-29 14:03:00.627034] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:20.420 [2024-11-29 14:03:00.627068] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:20.420 14:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.420 14:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.420 14:03:00 -- common/autotest_common.sh@10 -- # set +x 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.420 14:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:20.420 14:03:00 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:20.678 14:03:00 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:20.678 14:03:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.679 14:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.679 14:03:00 -- common/autotest_common.sh@10 -- # set +x 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.679 14:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.679 14:03:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.617 14:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.617 14:03:01 -- common/autotest_common.sh@10 -- # set +x 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.617 14:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:21.617 14:03:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:22.995 14:03:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:22.995 14:03:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.996 14:03:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.996 14:03:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:22.996 14:03:02 -- common/autotest_common.sh@10 -- # set +x 00:29:22.996 14:03:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:22.996 14:03:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:22.996 14:03:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.996 14:03:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:22.996 14:03:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.934 14:03:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.934 14:03:03 -- common/autotest_common.sh@10 -- # set +x 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.934 14:03:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:23.934 14:03:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.867 14:03:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.867 14:03:04 -- common/autotest_common.sh@10 -- # set +x 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.867 14:03:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:24.867 14:03:04 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:25.805 14:03:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:25.805 14:03:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:25.805 14:03:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:25.805 14:03:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.805 14:03:05 -- common/autotest_common.sh@10 -- # set +x 00:29:25.805 14:03:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:25.805 14:03:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:25.805 14:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.805 14:03:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:25.805 14:03:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:25.805 [2024-11-29 14:03:06.068792] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:25.805 [2024-11-29 14:03:06.068857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.805 [2024-11-29 14:03:06.068882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.805 [2024-11-29 14:03:06.068901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.805 [2024-11-29 14:03:06.068927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.805 [2024-11-29 14:03:06.068944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.805 [2024-11-29 14:03:06.068959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.805 [2024-11-29 14:03:06.068974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.806 [2024-11-29 14:03:06.068989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.806 [2024-11-29 14:03:06.069004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.806 [2024-11-29 14:03:06.069018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.806 [2024-11-29 14:03:06.069033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d60b0 is same with the state(5) to be set 00:29:25.806 [2024-11-29 14:03:06.078813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d60b0 (9): Bad file descriptor 00:29:26.064 [2024-11-29 14:03:06.088903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.064 [2024-11-29 14:03:06.088933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.064 [2024-11-29 14:03:06.088981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:64 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.064 [2024-11-29 14:03:06.088998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.064 [2024-11-29 14:03:06.089015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.064 [2024-11-29 14:03:06.089029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.064 [2024-11-29 14:03:06.089134] bdev_nvme.c:1582:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x60fc50 was disconnected and freed in a reset ctrlr sequence. 00:29:26.064 [2024-11-29 14:03:06.089155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.999 14:03:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.999 14:03:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.999 14:03:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.999 14:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.999 14:03:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.999 14:03:07 -- common/autotest_common.sh@10 -- # set +x 00:29:26.999 14:03:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.999 [2024-11-29 14:03:07.114432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:27.960 [2024-11-29 14:03:08.138442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:27.960 [2024-11-29 14:03:08.138501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d60b0 with addr=10.0.0.2, port=4420 00:29:27.960 [2024-11-29 14:03:08.138531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d60b0 is same with the state(5) to be set 00:29:27.960 [2024-11-29 14:03:08.138578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:27.960 [2024-11-29 14:03:08.138599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:27.960 [2024-11-29 14:03:08.138613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:27.960 [2024-11-29 14:03:08.138637] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:27.960 [2024-11-29 14:03:08.139075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d60b0 (9): Bad file descriptor 00:29:27.960 [2024-11-29 14:03:08.139152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:27.960 [2024-11-29 14:03:08.139195] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:27.960 [2024-11-29 14:03:08.139238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.960 [2024-11-29 14:03:08.139264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.960 [2024-11-29 14:03:08.139285] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.961 [2024-11-29 14:03:08.139300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.961 [2024-11-29 14:03:08.139315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.961 [2024-11-29 14:03:08.139331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.961 [2024-11-29 14:03:08.139346] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.961 [2024-11-29 14:03:08.139360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.961 [2024-11-29 14:03:08.139375] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.961 [2024-11-29 14:03:08.139390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.961 [2024-11-29 14:03:08.139425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:27.961 [2024-11-29 14:03:08.139481] bdev.c:4968:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 0 00:29:27.961 [2024-11-29 14:03:08.139580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d64c0 (9): Bad file descriptor 00:29:27.961 [2024-11-29 14:03:08.140610] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:27.961 [2024-11-29 14:03:08.140630] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:27.961 14:03:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.961 14:03:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:27.961 14:03:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:28.895 [2024-11-29 14:03:09.141628] bdev_raid.c:3350:raid_bdev_examine_load_sb_cb: *ERROR*: Failed to examine bdev nvme0n1: Input/output error 00:29:28.895 [2024-11-29 14:03:09.141674] vbdev_gpt.c: 468:gpt_bdev_complete: *ERROR*: Gpt: bdev=nvme0n1 io error status=0 00:29:28.895 14:03:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:28.895 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:28.895 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:28.895 14:03:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.895 14:03:09 -- common/autotest_common.sh@10 -- # set +x 00:29:28.895 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:28.895 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:28.895 14:03:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.154 14:03:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.154 14:03:09 -- common/autotest_common.sh@10 -- # set +x 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.154 14:03:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:29.154 14:03:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.094 [2024-11-29 14:03:10.193088] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:30.094 [2024-11-29 14:03:10.193116] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:30.094 [2024-11-29 14:03:10.193141] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:30.094 14:03:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:30.094 14:03:10 -- common/autotest_common.sh@10 -- # set +x 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:30.094 14:03:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.094 [2024-11-29 14:03:10.320578] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:30.094 14:03:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.354 [2024-11-29 14:03:10.382428] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:30.354 [2024-11-29 14:03:10.382491] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:30.354 [2024-11-29 14:03:10.382524] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:30.354 [2024-11-29 14:03:10.382545] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:30.354 [2024-11-29 14:03:10.382557] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:30.354 [2024-11-29 14:03:10.431107] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x5f3860 was disconnected and freed. delete nvme_qpair. 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:31.294 14:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.294 14:03:11 -- common/autotest_common.sh@10 -- # set +x 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:31.294 14:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:31.294 14:03:11 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2417998 00:29:31.294 14:03:11 -- common/autotest_common.sh@936 -- # '[' -z 2417998 ']' 00:29:31.294 14:03:11 -- common/autotest_common.sh@940 -- # kill -0 2417998 00:29:31.294 14:03:11 -- common/autotest_common.sh@941 -- # uname 00:29:31.294 14:03:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.294 14:03:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417998 00:29:31.294 14:03:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:31.294 14:03:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:31.294 14:03:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417998' 00:29:31.294 killing process with pid 2417998 00:29:31.294 14:03:11 -- common/autotest_common.sh@955 -- # kill 2417998 00:29:31.294 14:03:11 -- common/autotest_common.sh@960 -- # wait 2417998 00:29:31.553 14:03:11 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:31.553 14:03:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:31.553 14:03:11 -- nvmf/common.sh@116 -- # sync 00:29:31.553 14:03:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:31.553 14:03:11 -- nvmf/common.sh@119 -- # set +e 00:29:31.553 14:03:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:31.553 14:03:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:31.553 rmmod nvme_tcp 00:29:31.553 rmmod nvme_fabrics 00:29:31.553 rmmod nvme_keyring 00:29:31.553 14:03:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:31.553 14:03:11 -- nvmf/common.sh@123 -- # set -e 00:29:31.553 14:03:11 -- nvmf/common.sh@124 -- # return 0 00:29:31.553 14:03:11 -- nvmf/common.sh@477 -- # '[' -n 2417837 ']' 00:29:31.553 14:03:11 -- nvmf/common.sh@478 -- # killprocess 2417837 00:29:31.553 14:03:11 -- common/autotest_common.sh@936 -- # '[' -z 2417837 ']' 00:29:31.553 14:03:11 -- common/autotest_common.sh@940 -- # kill -0 2417837 00:29:31.553 14:03:11 -- common/autotest_common.sh@941 -- # uname 00:29:31.553 14:03:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.553 14:03:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417837 00:29:31.553 14:03:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:31.553 14:03:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:31.553 14:03:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417837' 00:29:31.553 killing process with pid 2417837 00:29:31.553 14:03:11 -- common/autotest_common.sh@955 -- # kill 2417837 00:29:31.553 14:03:11 -- common/autotest_common.sh@960 -- # wait 2417837 00:29:31.553 [2024-11-29 14:03:11.743928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb89490 is same with the state(5) to be set 00:29:31.553 [2024-11-29 14:03:11.743985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb89490 is same with the state(5) to be set 00:29:31.811 14:03:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:31.811 14:03:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:31.811 14:03:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:31.811 14:03:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:31.811 14:03:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:31.811 14:03:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:31.811 14:03:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:31.811 14:03:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:34.353 14:03:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:34.353 00:29:34.353 real 0m18.514s 00:29:34.353 user 0m25.300s 00:29:34.353 sys 0m3.292s 00:29:34.353 14:03:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:34.353 14:03:14 -- common/autotest_common.sh@10 -- # set +x 00:29:34.353 ************************************ 00:29:34.353 END TEST nvmf_discovery_remove_ifc 00:29:34.353 ************************************ 00:29:34.353 14:03:14 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:34.353 14:03:14 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:34.353 14:03:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:34.353 14:03:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:34.353 14:03:14 -- common/autotest_common.sh@10 -- # set +x 00:29:34.353 ************************************ 00:29:34.353 START TEST nvmf_digest 00:29:34.353 ************************************ 00:29:34.353 14:03:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:34.353 * Looking for test storage... 00:29:34.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:34.353 14:03:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:34.353 14:03:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:34.353 14:03:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:34.353 14:03:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:34.353 14:03:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:34.353 14:03:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:34.353 14:03:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:34.353 14:03:14 -- scripts/common.sh@335 -- # IFS=.-: 00:29:34.353 14:03:14 -- scripts/common.sh@335 -- # read -ra ver1 00:29:34.353 14:03:14 -- scripts/common.sh@336 -- # IFS=.-: 00:29:34.353 14:03:14 -- scripts/common.sh@336 -- # read -ra ver2 00:29:34.353 14:03:14 -- scripts/common.sh@337 -- # local 'op=<' 00:29:34.353 14:03:14 -- scripts/common.sh@339 -- # ver1_l=2 00:29:34.353 14:03:14 -- scripts/common.sh@340 -- # ver2_l=1 00:29:34.353 14:03:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:34.353 14:03:14 -- scripts/common.sh@343 -- # case "$op" in 00:29:34.353 14:03:14 -- scripts/common.sh@344 -- # : 1 00:29:34.353 14:03:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:34.353 14:03:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:34.353 14:03:14 -- scripts/common.sh@364 -- # decimal 1 00:29:34.353 14:03:14 -- scripts/common.sh@352 -- # local d=1 00:29:34.353 14:03:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:34.353 14:03:14 -- scripts/common.sh@354 -- # echo 1 00:29:34.353 14:03:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:34.353 14:03:14 -- scripts/common.sh@365 -- # decimal 2 00:29:34.353 14:03:14 -- scripts/common.sh@352 -- # local d=2 00:29:34.353 14:03:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:34.354 14:03:14 -- scripts/common.sh@354 -- # echo 2 00:29:34.354 14:03:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:34.354 14:03:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:34.354 14:03:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:34.354 14:03:14 -- scripts/common.sh@367 -- # return 0 00:29:34.354 14:03:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:34.354 14:03:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:34.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.354 --rc genhtml_branch_coverage=1 00:29:34.354 --rc genhtml_function_coverage=1 00:29:34.354 --rc genhtml_legend=1 00:29:34.354 --rc geninfo_all_blocks=1 00:29:34.354 --rc geninfo_unexecuted_blocks=1 00:29:34.354 00:29:34.354 ' 00:29:34.354 14:03:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:34.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.354 --rc genhtml_branch_coverage=1 00:29:34.354 --rc genhtml_function_coverage=1 00:29:34.354 --rc genhtml_legend=1 00:29:34.354 --rc geninfo_all_blocks=1 00:29:34.354 --rc geninfo_unexecuted_blocks=1 00:29:34.354 00:29:34.354 ' 00:29:34.354 14:03:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:34.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.354 --rc genhtml_branch_coverage=1 00:29:34.354 --rc genhtml_function_coverage=1 00:29:34.354 --rc genhtml_legend=1 00:29:34.354 --rc geninfo_all_blocks=1 00:29:34.354 --rc geninfo_unexecuted_blocks=1 00:29:34.354 00:29:34.354 ' 00:29:34.354 14:03:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:34.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.354 --rc genhtml_branch_coverage=1 00:29:34.354 --rc genhtml_function_coverage=1 00:29:34.354 --rc genhtml_legend=1 00:29:34.354 --rc geninfo_all_blocks=1 00:29:34.354 --rc geninfo_unexecuted_blocks=1 00:29:34.354 00:29:34.354 ' 00:29:34.354 14:03:14 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:34.354 14:03:14 -- nvmf/common.sh@7 -- # uname -s 00:29:34.354 14:03:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:34.354 14:03:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:34.354 14:03:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:34.354 14:03:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:34.354 14:03:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:34.354 14:03:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:34.354 14:03:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:34.354 14:03:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:34.354 14:03:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:34.354 14:03:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:34.354 14:03:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:34.354 14:03:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:34.354 14:03:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:34.354 14:03:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:34.354 14:03:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:34.354 14:03:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:34.354 14:03:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:34.354 14:03:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:34.354 14:03:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:34.354 14:03:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.354 14:03:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.354 14:03:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.354 14:03:14 -- paths/export.sh@5 -- # export PATH 00:29:34.354 14:03:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.354 14:03:14 -- nvmf/common.sh@46 -- # : 0 00:29:34.354 14:03:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:34.354 14:03:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:34.354 14:03:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:34.354 14:03:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:34.354 14:03:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:34.354 14:03:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:34.354 14:03:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:34.354 14:03:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:34.354 14:03:14 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:34.354 14:03:14 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:34.354 14:03:14 -- host/digest.sh@16 -- # runtime=2 00:29:34.354 14:03:14 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:34.354 14:03:14 -- host/digest.sh@132 -- # nvmftestinit 00:29:34.354 14:03:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:34.354 14:03:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:34.354 14:03:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:34.354 14:03:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:34.354 14:03:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:34.354 14:03:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:34.354 14:03:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:34.354 14:03:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:34.354 14:03:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:34.354 14:03:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:34.354 14:03:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:34.354 14:03:14 -- common/autotest_common.sh@10 -- # set +x 00:29:35.838 14:03:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:35.838 14:03:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:35.838 14:03:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:35.838 14:03:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:35.838 14:03:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:35.838 14:03:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:35.838 14:03:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:35.838 14:03:16 -- nvmf/common.sh@294 -- # net_devs=() 00:29:35.838 14:03:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:35.838 14:03:16 -- nvmf/common.sh@295 -- # e810=() 00:29:35.838 14:03:16 -- nvmf/common.sh@295 -- # local -ga e810 00:29:35.838 14:03:16 -- nvmf/common.sh@296 -- # x722=() 00:29:35.838 14:03:16 -- nvmf/common.sh@296 -- # local -ga x722 00:29:35.838 14:03:16 -- nvmf/common.sh@297 -- # mlx=() 00:29:35.838 14:03:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:35.838 14:03:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:35.838 14:03:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:35.838 14:03:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:35.838 14:03:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:35.839 14:03:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:35.839 14:03:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:35.839 14:03:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:35.839 14:03:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:35.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:35.839 14:03:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:35.839 14:03:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:35.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:35.839 14:03:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:35.839 14:03:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:35.839 14:03:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:35.839 14:03:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:35.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:35.839 14:03:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:35.839 14:03:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:35.839 14:03:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:35.839 14:03:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:35.839 14:03:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:35.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:35.839 14:03:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:35.839 14:03:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:35.839 14:03:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:35.839 14:03:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:35.839 14:03:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:35.839 14:03:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:35.839 14:03:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:35.839 14:03:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:35.839 14:03:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:35.839 14:03:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:35.839 14:03:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:35.839 14:03:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:35.839 14:03:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:35.839 14:03:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:35.839 14:03:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:35.839 14:03:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:35.839 14:03:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:36.097 14:03:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:36.097 14:03:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:36.097 14:03:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:36.097 14:03:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:36.097 14:03:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:36.097 14:03:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:36.097 14:03:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:36.097 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:36.097 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:29:36.097 00:29:36.097 --- 10.0.0.2 ping statistics --- 00:29:36.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:36.097 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:29:36.097 14:03:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:36.097 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:36.097 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:29:36.097 00:29:36.097 --- 10.0.0.1 ping statistics --- 00:29:36.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:36.097 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:29:36.097 14:03:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:36.097 14:03:16 -- nvmf/common.sh@410 -- # return 0 00:29:36.097 14:03:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:36.097 14:03:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:36.097 14:03:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:36.097 14:03:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:36.097 14:03:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:36.097 14:03:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:36.097 14:03:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:36.097 14:03:16 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:36.097 14:03:16 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:36.097 14:03:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:36.097 14:03:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:36.097 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.097 ************************************ 00:29:36.097 START TEST nvmf_digest_clean 00:29:36.097 ************************************ 00:29:36.097 14:03:16 -- common/autotest_common.sh@1114 -- # run_digest 00:29:36.097 14:03:16 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:36.097 14:03:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:36.097 14:03:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:36.097 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.097 14:03:16 -- nvmf/common.sh@469 -- # nvmfpid=2422153 00:29:36.097 14:03:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:36.097 14:03:16 -- nvmf/common.sh@470 -- # waitforlisten 2422153 00:29:36.097 14:03:16 -- common/autotest_common.sh@829 -- # '[' -z 2422153 ']' 00:29:36.097 14:03:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:36.097 14:03:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:36.097 14:03:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:36.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:36.097 14:03:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:36.097 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.097 [2024-11-29 14:03:16.288370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:36.097 [2024-11-29 14:03:16.288451] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:36.097 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.098 [2024-11-29 14:03:16.354614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.356 [2024-11-29 14:03:16.445884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:36.356 [2024-11-29 14:03:16.446060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:36.356 [2024-11-29 14:03:16.446078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:36.356 [2024-11-29 14:03:16.446092] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:36.356 [2024-11-29 14:03:16.446121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:36.356 14:03:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:36.356 14:03:16 -- common/autotest_common.sh@862 -- # return 0 00:29:36.356 14:03:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:36.356 14:03:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:36.356 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.356 14:03:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:36.356 14:03:16 -- host/digest.sh@120 -- # common_target_config 00:29:36.356 14:03:16 -- host/digest.sh@43 -- # rpc_cmd 00:29:36.356 14:03:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.356 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.614 null0 00:29:36.614 [2024-11-29 14:03:16.681980] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:36.614 [2024-11-29 14:03:16.706191] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:36.614 14:03:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.614 14:03:16 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:36.614 14:03:16 -- host/digest.sh@77 -- # local rw bs qd 00:29:36.614 14:03:16 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:36.614 14:03:16 -- host/digest.sh@80 -- # rw=randread 00:29:36.614 14:03:16 -- host/digest.sh@80 -- # bs=4096 00:29:36.614 14:03:16 -- host/digest.sh@80 -- # qd=128 00:29:36.614 14:03:16 -- host/digest.sh@82 -- # bperfpid=2422296 00:29:36.614 14:03:16 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:36.614 14:03:16 -- host/digest.sh@83 -- # waitforlisten 2422296 /var/tmp/bperf.sock 00:29:36.614 14:03:16 -- common/autotest_common.sh@829 -- # '[' -z 2422296 ']' 00:29:36.614 14:03:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:36.614 14:03:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:36.614 14:03:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:36.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:36.614 14:03:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:36.614 14:03:16 -- common/autotest_common.sh@10 -- # set +x 00:29:36.614 [2024-11-29 14:03:16.750742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:36.614 [2024-11-29 14:03:16.750813] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2422296 ] 00:29:36.614 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.614 [2024-11-29 14:03:16.812580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.872 [2024-11-29 14:03:16.901520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:36.872 14:03:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:36.872 14:03:16 -- common/autotest_common.sh@862 -- # return 0 00:29:36.872 14:03:16 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:36.872 14:03:16 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:36.872 14:03:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:37.129 14:03:17 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.129 14:03:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.387 nvme0n1 00:29:37.387 14:03:17 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:37.387 14:03:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:37.644 Running I/O for 2 seconds... 00:29:39.544 00:29:39.544 Latency(us) 00:29:39.544 [2024-11-29T13:03:19.826Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.544 [2024-11-29T13:03:19.826Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:39.544 nvme0n1 : 2.05 16481.49 64.38 0.00 0.00 7612.82 3422.44 46603.38 00:29:39.544 [2024-11-29T13:03:19.826Z] =================================================================================================================== 00:29:39.544 [2024-11-29T13:03:19.826Z] Total : 16481.49 64.38 0.00 0.00 7612.82 3422.44 46603.38 00:29:39.544 0 00:29:39.544 14:03:19 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:39.544 14:03:19 -- host/digest.sh@92 -- # get_accel_stats 00:29:39.544 14:03:19 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:39.544 14:03:19 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:39.544 | select(.opcode=="crc32c") 00:29:39.544 | "\(.module_name) \(.executed)"' 00:29:39.544 14:03:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:39.802 14:03:20 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:39.802 14:03:20 -- host/digest.sh@93 -- # exp_module=software 00:29:39.802 14:03:20 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:39.802 14:03:20 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:39.802 14:03:20 -- host/digest.sh@97 -- # killprocess 2422296 00:29:39.802 14:03:20 -- common/autotest_common.sh@936 -- # '[' -z 2422296 ']' 00:29:39.802 14:03:20 -- common/autotest_common.sh@940 -- # kill -0 2422296 00:29:39.802 14:03:20 -- common/autotest_common.sh@941 -- # uname 00:29:39.802 14:03:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:39.802 14:03:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2422296 00:29:40.061 14:03:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:40.061 14:03:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:40.061 14:03:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2422296' 00:29:40.061 killing process with pid 2422296 00:29:40.061 14:03:20 -- common/autotest_common.sh@955 -- # kill 2422296 00:29:40.061 Received shutdown signal, test time was about 2.000000 seconds 00:29:40.061 00:29:40.061 Latency(us) 00:29:40.061 [2024-11-29T13:03:20.343Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.061 [2024-11-29T13:03:20.343Z] =================================================================================================================== 00:29:40.061 [2024-11-29T13:03:20.343Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:40.061 14:03:20 -- common/autotest_common.sh@960 -- # wait 2422296 00:29:40.061 14:03:20 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:40.061 14:03:20 -- host/digest.sh@77 -- # local rw bs qd 00:29:40.061 14:03:20 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:40.061 14:03:20 -- host/digest.sh@80 -- # rw=randread 00:29:40.061 14:03:20 -- host/digest.sh@80 -- # bs=131072 00:29:40.061 14:03:20 -- host/digest.sh@80 -- # qd=16 00:29:40.061 14:03:20 -- host/digest.sh@82 -- # bperfpid=2422718 00:29:40.061 14:03:20 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:40.061 14:03:20 -- host/digest.sh@83 -- # waitforlisten 2422718 /var/tmp/bperf.sock 00:29:40.061 14:03:20 -- common/autotest_common.sh@829 -- # '[' -z 2422718 ']' 00:29:40.061 14:03:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:40.061 14:03:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:40.061 14:03:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:40.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:40.061 14:03:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:40.061 14:03:20 -- common/autotest_common.sh@10 -- # set +x 00:29:40.319 [2024-11-29 14:03:20.355207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:40.319 [2024-11-29 14:03:20.355281] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2422718 ] 00:29:40.319 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:40.319 Zero copy mechanism will not be used. 00:29:40.319 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.319 [2024-11-29 14:03:20.414605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.319 [2024-11-29 14:03:20.502681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:40.319 14:03:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:40.319 14:03:20 -- common/autotest_common.sh@862 -- # return 0 00:29:40.319 14:03:20 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:40.319 14:03:20 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:40.319 14:03:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:40.886 14:03:20 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:40.886 14:03:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:41.143 nvme0n1 00:29:41.143 14:03:21 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:41.143 14:03:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:41.403 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:41.403 Zero copy mechanism will not be used. 00:29:41.403 Running I/O for 2 seconds... 00:29:43.311 00:29:43.311 Latency(us) 00:29:43.311 [2024-11-29T13:03:23.593Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.311 [2024-11-29T13:03:23.593Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:43.311 nvme0n1 : 2.00 5539.20 692.40 0.00 0.00 2884.05 837.40 5315.70 00:29:43.311 [2024-11-29T13:03:23.593Z] =================================================================================================================== 00:29:43.311 [2024-11-29T13:03:23.593Z] Total : 5539.20 692.40 0.00 0.00 2884.05 837.40 5315.70 00:29:43.311 0 00:29:43.311 14:03:23 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:43.311 14:03:23 -- host/digest.sh@92 -- # get_accel_stats 00:29:43.311 14:03:23 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:43.311 14:03:23 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:43.311 | select(.opcode=="crc32c") 00:29:43.311 | "\(.module_name) \(.executed)"' 00:29:43.311 14:03:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:43.570 14:03:23 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:43.570 14:03:23 -- host/digest.sh@93 -- # exp_module=software 00:29:43.570 14:03:23 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:43.570 14:03:23 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:43.570 14:03:23 -- host/digest.sh@97 -- # killprocess 2422718 00:29:43.570 14:03:23 -- common/autotest_common.sh@936 -- # '[' -z 2422718 ']' 00:29:43.570 14:03:23 -- common/autotest_common.sh@940 -- # kill -0 2422718 00:29:43.570 14:03:23 -- common/autotest_common.sh@941 -- # uname 00:29:43.570 14:03:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:43.570 14:03:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2422718 00:29:43.570 14:03:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:43.570 14:03:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:43.570 14:03:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2422718' 00:29:43.570 killing process with pid 2422718 00:29:43.570 14:03:23 -- common/autotest_common.sh@955 -- # kill 2422718 00:29:43.570 Received shutdown signal, test time was about 2.000000 seconds 00:29:43.570 00:29:43.570 Latency(us) 00:29:43.570 [2024-11-29T13:03:23.852Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.570 [2024-11-29T13:03:23.852Z] =================================================================================================================== 00:29:43.570 [2024-11-29T13:03:23.852Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:43.570 14:03:23 -- common/autotest_common.sh@960 -- # wait 2422718 00:29:43.828 14:03:24 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:43.828 14:03:24 -- host/digest.sh@77 -- # local rw bs qd 00:29:43.828 14:03:24 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:43.828 14:03:24 -- host/digest.sh@80 -- # rw=randwrite 00:29:43.828 14:03:24 -- host/digest.sh@80 -- # bs=4096 00:29:43.828 14:03:24 -- host/digest.sh@80 -- # qd=128 00:29:43.828 14:03:24 -- host/digest.sh@82 -- # bperfpid=2423138 00:29:43.828 14:03:24 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:43.828 14:03:24 -- host/digest.sh@83 -- # waitforlisten 2423138 /var/tmp/bperf.sock 00:29:43.828 14:03:24 -- common/autotest_common.sh@829 -- # '[' -z 2423138 ']' 00:29:43.828 14:03:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:43.828 14:03:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.828 14:03:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:43.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:43.828 14:03:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.828 14:03:24 -- common/autotest_common.sh@10 -- # set +x 00:29:43.828 [2024-11-29 14:03:24.097852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.828 [2024-11-29 14:03:24.097930] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2423138 ] 00:29:44.085 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.085 [2024-11-29 14:03:24.157901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:44.085 [2024-11-29 14:03:24.241145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:44.085 14:03:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:44.085 14:03:24 -- common/autotest_common.sh@862 -- # return 0 00:29:44.085 14:03:24 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:44.086 14:03:24 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:44.086 14:03:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:44.652 14:03:24 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.652 14:03:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.909 nvme0n1 00:29:44.909 14:03:25 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:44.909 14:03:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:45.167 Running I/O for 2 seconds... 00:29:47.072 00:29:47.072 Latency(us) 00:29:47.072 [2024-11-29T13:03:27.354Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.072 [2024-11-29T13:03:27.354Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:47.072 nvme0n1 : 2.00 21127.28 82.53 0.00 0.00 6051.02 2791.35 10145.94 00:29:47.072 [2024-11-29T13:03:27.354Z] =================================================================================================================== 00:29:47.072 [2024-11-29T13:03:27.354Z] Total : 21127.28 82.53 0.00 0.00 6051.02 2791.35 10145.94 00:29:47.072 0 00:29:47.072 14:03:27 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:47.072 14:03:27 -- host/digest.sh@92 -- # get_accel_stats 00:29:47.072 14:03:27 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:47.072 14:03:27 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:47.072 | select(.opcode=="crc32c") 00:29:47.072 | "\(.module_name) \(.executed)"' 00:29:47.072 14:03:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:47.330 14:03:27 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:47.330 14:03:27 -- host/digest.sh@93 -- # exp_module=software 00:29:47.330 14:03:27 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:47.330 14:03:27 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:47.330 14:03:27 -- host/digest.sh@97 -- # killprocess 2423138 00:29:47.330 14:03:27 -- common/autotest_common.sh@936 -- # '[' -z 2423138 ']' 00:29:47.330 14:03:27 -- common/autotest_common.sh@940 -- # kill -0 2423138 00:29:47.330 14:03:27 -- common/autotest_common.sh@941 -- # uname 00:29:47.330 14:03:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:47.330 14:03:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2423138 00:29:47.330 14:03:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:47.330 14:03:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:47.330 14:03:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2423138' 00:29:47.330 killing process with pid 2423138 00:29:47.330 14:03:27 -- common/autotest_common.sh@955 -- # kill 2423138 00:29:47.588 Received shutdown signal, test time was about 2.000000 seconds 00:29:47.588 00:29:47.588 Latency(us) 00:29:47.588 [2024-11-29T13:03:27.870Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.588 [2024-11-29T13:03:27.871Z] =================================================================================================================== 00:29:47.589 [2024-11-29T13:03:27.871Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:47.589 14:03:27 -- common/autotest_common.sh@960 -- # wait 2423138 00:29:47.589 14:03:27 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:47.589 14:03:27 -- host/digest.sh@77 -- # local rw bs qd 00:29:47.589 14:03:27 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:47.589 14:03:27 -- host/digest.sh@80 -- # rw=randwrite 00:29:47.589 14:03:27 -- host/digest.sh@80 -- # bs=131072 00:29:47.589 14:03:27 -- host/digest.sh@80 -- # qd=16 00:29:47.589 14:03:27 -- host/digest.sh@82 -- # bperfpid=2423605 00:29:47.589 14:03:27 -- host/digest.sh@83 -- # waitforlisten 2423605 /var/tmp/bperf.sock 00:29:47.589 14:03:27 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:47.589 14:03:27 -- common/autotest_common.sh@829 -- # '[' -z 2423605 ']' 00:29:47.589 14:03:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:47.589 14:03:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:47.589 14:03:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:47.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:47.589 14:03:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:47.589 14:03:27 -- common/autotest_common.sh@10 -- # set +x 00:29:47.846 [2024-11-29 14:03:27.878475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:47.846 [2024-11-29 14:03:27.878555] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2423605 ] 00:29:47.846 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:47.846 Zero copy mechanism will not be used. 00:29:47.846 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.846 [2024-11-29 14:03:27.944356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:47.846 [2024-11-29 14:03:28.034883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:47.846 14:03:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:47.846 14:03:28 -- common/autotest_common.sh@862 -- # return 0 00:29:47.846 14:03:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:47.846 14:03:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:47.846 14:03:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:48.414 14:03:28 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.414 14:03:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.685 nvme0n1 00:29:48.685 14:03:28 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:48.685 14:03:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:48.685 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:48.685 Zero copy mechanism will not be used. 00:29:48.685 Running I/O for 2 seconds... 00:29:51.220 00:29:51.220 Latency(us) 00:29:51.220 [2024-11-29T13:03:31.502Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:51.220 [2024-11-29T13:03:31.502Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:51.220 nvme0n1 : 2.00 6812.19 851.52 0.00 0.00 2341.88 1868.99 6699.24 00:29:51.220 [2024-11-29T13:03:31.502Z] =================================================================================================================== 00:29:51.220 [2024-11-29T13:03:31.502Z] Total : 6812.19 851.52 0.00 0.00 2341.88 1868.99 6699.24 00:29:51.220 0 00:29:51.220 14:03:30 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:51.220 14:03:30 -- host/digest.sh@92 -- # get_accel_stats 00:29:51.220 14:03:30 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:51.220 14:03:30 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:51.220 | select(.opcode=="crc32c") 00:29:51.220 | "\(.module_name) \(.executed)"' 00:29:51.220 14:03:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:51.220 14:03:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:51.220 14:03:31 -- host/digest.sh@93 -- # exp_module=software 00:29:51.220 14:03:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:51.220 14:03:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:51.220 14:03:31 -- host/digest.sh@97 -- # killprocess 2423605 00:29:51.220 14:03:31 -- common/autotest_common.sh@936 -- # '[' -z 2423605 ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@940 -- # kill -0 2423605 00:29:51.220 14:03:31 -- common/autotest_common.sh@941 -- # uname 00:29:51.220 14:03:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2423605 00:29:51.220 14:03:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:51.220 14:03:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2423605' 00:29:51.220 killing process with pid 2423605 00:29:51.220 14:03:31 -- common/autotest_common.sh@955 -- # kill 2423605 00:29:51.220 Received shutdown signal, test time was about 2.000000 seconds 00:29:51.220 00:29:51.220 Latency(us) 00:29:51.220 [2024-11-29T13:03:31.502Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:51.220 [2024-11-29T13:03:31.502Z] =================================================================================================================== 00:29:51.220 [2024-11-29T13:03:31.502Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:51.220 14:03:31 -- common/autotest_common.sh@960 -- # wait 2423605 00:29:51.220 14:03:31 -- host/digest.sh@126 -- # killprocess 2422153 00:29:51.220 14:03:31 -- common/autotest_common.sh@936 -- # '[' -z 2422153 ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@940 -- # kill -0 2422153 00:29:51.220 14:03:31 -- common/autotest_common.sh@941 -- # uname 00:29:51.220 14:03:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2422153 00:29:51.220 14:03:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:51.220 14:03:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:51.220 14:03:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2422153' 00:29:51.220 killing process with pid 2422153 00:29:51.220 14:03:31 -- common/autotest_common.sh@955 -- # kill 2422153 00:29:51.220 14:03:31 -- common/autotest_common.sh@960 -- # wait 2422153 00:29:51.478 00:29:51.478 real 0m15.484s 00:29:51.478 user 0m30.814s 00:29:51.478 sys 0m4.319s 00:29:51.479 14:03:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:51.479 14:03:31 -- common/autotest_common.sh@10 -- # set +x 00:29:51.479 ************************************ 00:29:51.479 END TEST nvmf_digest_clean 00:29:51.479 ************************************ 00:29:51.479 14:03:31 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:51.479 14:03:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:51.479 14:03:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:51.479 14:03:31 -- common/autotest_common.sh@10 -- # set +x 00:29:51.479 ************************************ 00:29:51.479 START TEST nvmf_digest_error 00:29:51.479 ************************************ 00:29:51.479 14:03:31 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:51.479 14:03:31 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:51.479 14:03:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:51.479 14:03:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:51.736 14:03:31 -- common/autotest_common.sh@10 -- # set +x 00:29:51.736 14:03:31 -- nvmf/common.sh@469 -- # nvmfpid=2424131 00:29:51.736 14:03:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:51.736 14:03:31 -- nvmf/common.sh@470 -- # waitforlisten 2424131 00:29:51.736 14:03:31 -- common/autotest_common.sh@829 -- # '[' -z 2424131 ']' 00:29:51.736 14:03:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:51.736 14:03:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.736 14:03:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:51.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:51.736 14:03:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.736 14:03:31 -- common/autotest_common.sh@10 -- # set +x 00:29:51.736 [2024-11-29 14:03:31.807991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.736 [2024-11-29 14:03:31.808068] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:51.736 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.736 [2024-11-29 14:03:31.878882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:51.736 [2024-11-29 14:03:31.967778] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:51.736 [2024-11-29 14:03:31.967938] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:51.736 [2024-11-29 14:03:31.967958] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:51.737 [2024-11-29 14:03:31.967971] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:51.737 [2024-11-29 14:03:31.968001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:51.994 14:03:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.994 14:03:32 -- common/autotest_common.sh@862 -- # return 0 00:29:51.994 14:03:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.994 14:03:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:51.994 14:03:32 -- common/autotest_common.sh@10 -- # set +x 00:29:51.994 14:03:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.994 14:03:32 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:51.994 14:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.994 14:03:32 -- common/autotest_common.sh@10 -- # set +x 00:29:51.994 [2024-11-29 14:03:32.080697] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:51.994 14:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.994 14:03:32 -- host/digest.sh@104 -- # common_target_config 00:29:51.994 14:03:32 -- host/digest.sh@43 -- # rpc_cmd 00:29:51.994 14:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.994 14:03:32 -- common/autotest_common.sh@10 -- # set +x 00:29:51.994 null0 00:29:51.994 [2024-11-29 14:03:32.191801] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.994 [2024-11-29 14:03:32.216029] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:51.994 14:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.994 14:03:32 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:51.994 14:03:32 -- host/digest.sh@54 -- # local rw bs qd 00:29:51.994 14:03:32 -- host/digest.sh@56 -- # rw=randread 00:29:51.994 14:03:32 -- host/digest.sh@56 -- # bs=4096 00:29:51.995 14:03:32 -- host/digest.sh@56 -- # qd=128 00:29:51.995 14:03:32 -- host/digest.sh@58 -- # bperfpid=2424150 00:29:51.995 14:03:32 -- host/digest.sh@60 -- # waitforlisten 2424150 /var/tmp/bperf.sock 00:29:51.995 14:03:32 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:51.995 14:03:32 -- common/autotest_common.sh@829 -- # '[' -z 2424150 ']' 00:29:51.995 14:03:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:51.995 14:03:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.995 14:03:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:51.995 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:51.995 14:03:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.995 14:03:32 -- common/autotest_common.sh@10 -- # set +x 00:29:51.995 [2024-11-29 14:03:32.261092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.995 [2024-11-29 14:03:32.261164] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2424150 ] 00:29:52.252 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.253 [2024-11-29 14:03:32.324218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.253 [2024-11-29 14:03:32.422805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.188 14:03:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:53.188 14:03:33 -- common/autotest_common.sh@862 -- # return 0 00:29:53.188 14:03:33 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:53.188 14:03:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:53.445 14:03:33 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:53.445 14:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:53.445 14:03:33 -- common/autotest_common.sh@10 -- # set +x 00:29:53.445 14:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:53.445 14:03:33 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.446 14:03:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.703 nvme0n1 00:29:53.703 14:03:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:53.703 14:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:53.703 14:03:33 -- common/autotest_common.sh@10 -- # set +x 00:29:53.703 14:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:53.703 14:03:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:53.703 14:03:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:53.963 Running I/O for 2 seconds... 00:29:53.963 [2024-11-29 14:03:34.058384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.058452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19690 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.058483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.069037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.069066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.069098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.084794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.084824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.084856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.100662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.100692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.100708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.116026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.116054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.116085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.131254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.131283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.131313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.146659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.146703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.146719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.162478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.162508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.162539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.178810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.178855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:15676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.178872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.194872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.194900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:17422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.194931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.210176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.210204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:16791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.210234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.225915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.225946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.225963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.963 [2024-11-29 14:03:34.241730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:53.963 [2024-11-29 14:03:34.241773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9301 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.963 [2024-11-29 14:03:34.241789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.223 [2024-11-29 14:03:34.255758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.223 [2024-11-29 14:03:34.255789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:2383 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.223 [2024-11-29 14:03:34.255806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.223 [2024-11-29 14:03:34.266568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.223 [2024-11-29 14:03:34.266596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.223 [2024-11-29 14:03:34.266627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.281946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.281974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:2495 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.282004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.297317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.297345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:23697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.297375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.312944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.312972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.313011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.329015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.329044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:19079 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.329074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.344579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.344608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:11259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.344639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.360094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.360120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:8368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.360152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.374270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.374300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6345 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.374331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.385505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.385536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:22571 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.385555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.400941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.400969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:13296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.400999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.416400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.416452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:24099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.416482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.432240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.432267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8809 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.432298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.443033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.443068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:21692 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.443099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.457363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.457412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.457429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.473241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.473271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.473288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.224 [2024-11-29 14:03:34.489097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.224 [2024-11-29 14:03:34.489125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.224 [2024-11-29 14:03:34.489155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.505225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.505253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.505284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.519500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.519531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.519548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.534410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.534440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.534456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.544494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.544522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:13660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.544552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.560071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.560098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.560129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.575675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.575704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.575744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.591619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.591649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:16152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.591665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.607522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.607552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:13621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.607584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.623528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.623573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:920 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.623588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.639913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.639941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.639972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.653973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.654003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.654028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.664551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.664580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:20643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.664611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.681800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.681835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.681853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.698940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.698975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:19731 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.699016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.710205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.710238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.710256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.726167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.726201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.726219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.744110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.744143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:1689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.744162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.484 [2024-11-29 14:03:34.759501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.484 [2024-11-29 14:03:34.759531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:22242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.484 [2024-11-29 14:03:34.759547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.771650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.771679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.771709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.788375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.788417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.788451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.799782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.799816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:22483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.799834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.817122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.817156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:8532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.817174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.833982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.834016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.834033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.851083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.851117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:24232 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.851136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.867984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.868017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:880 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.868035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.884828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.884862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:16348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.884880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.901728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.901762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:11403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.901780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.918641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.918687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:17307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.918703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.935471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.746 [2024-11-29 14:03:34.935501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5878 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.746 [2024-11-29 14:03:34.935518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.746 [2024-11-29 14:03:34.946235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.747 [2024-11-29 14:03:34.946268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:14623 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.747 [2024-11-29 14:03:34.946286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.747 [2024-11-29 14:03:34.969145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.747 [2024-11-29 14:03:34.969178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:12274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.747 [2024-11-29 14:03:34.969205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.747 [2024-11-29 14:03:34.985894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.747 [2024-11-29 14:03:34.985928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:12202 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.747 [2024-11-29 14:03:34.985945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.747 [2024-11-29 14:03:35.002594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.747 [2024-11-29 14:03:35.002622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.747 [2024-11-29 14:03:35.002652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.747 [2024-11-29 14:03:35.013479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:54.747 [2024-11-29 14:03:35.013523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.747 [2024-11-29 14:03:35.013539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.006 [2024-11-29 14:03:35.029478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.006 [2024-11-29 14:03:35.029507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:25304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.006 [2024-11-29 14:03:35.029537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.006 [2024-11-29 14:03:35.046337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.006 [2024-11-29 14:03:35.046370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:9860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.006 [2024-11-29 14:03:35.046389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.006 [2024-11-29 14:03:35.063370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.063411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:1097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.063431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.080571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.080600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:20049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.080616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.092302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.092334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.092352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.108796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.108836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:23042 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.108855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.126591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.126618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.126649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.143473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.143501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.143531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.160523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.160553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:19915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.160569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.171647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.171676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:8242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.171692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.188214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.188248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:15817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.188267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.204208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.204241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.204259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.216905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.216938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:9704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.216956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.233141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.233175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.233193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.250386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.250441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.250457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.267820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.267853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.267871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.007 [2024-11-29 14:03:35.284825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.007 [2024-11-29 14:03:35.284859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:19873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.007 [2024-11-29 14:03:35.284877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.296111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.296146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:16830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.296164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.312188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.312222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:11379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.312240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.330042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.330076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:11097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.330095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.347417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.347461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.347477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.364368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.364410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:1059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.364430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.375534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.375581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6120 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.375604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.391583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.391611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:20821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.391642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.409110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.409146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.409164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.426164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.426198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.426216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.443450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.443478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.443508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.460352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.460386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9703 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.460412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.477285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.477319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7007 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.477338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.492546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.492577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:20517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.492593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.504760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.504793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.504811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.521190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.521224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:3683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.521242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.267 [2024-11-29 14:03:35.539990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.267 [2024-11-29 14:03:35.540023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15331 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.267 [2024-11-29 14:03:35.540041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.526 [2024-11-29 14:03:35.556954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.556988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17383 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.557006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.573900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.573933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:20529 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.573952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.584545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.584573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.584603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.600888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.600921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.600939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.617718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.617751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:7659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.617769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.634571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.634599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:1094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.634629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.651344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.651377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.651409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.668301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.668334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:13767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.668352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.684548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.684577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.684608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.702063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.702106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:21054 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.702122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.718900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.718931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.718947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.729806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.729840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:13879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.729858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.745919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.745950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:23828 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.745967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.763652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.763681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21392 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.763695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.780375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.780418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:20360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.780451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.527 [2024-11-29 14:03:35.797881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.527 [2024-11-29 14:03:35.797925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.527 [2024-11-29 14:03:35.797944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.785 [2024-11-29 14:03:35.808992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.785 [2024-11-29 14:03:35.809025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:14814 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.785 [2024-11-29 14:03:35.809043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.785 [2024-11-29 14:03:35.825933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.825967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.825985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.840002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.840030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:19720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.840060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.857266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.857300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:11484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.857319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.874663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.874708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:18490 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.874723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.889982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.890016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:7314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.890034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.901699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.901732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:17239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.901750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.918994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.919028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:2114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.919046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.935860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.935894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:22638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.935913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.952952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.952986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:11169 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.953005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.969990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.970025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:12313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.970043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:35.986963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:35.986997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:35.987015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:36.003550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:36.003578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:10489 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:36.003607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:36.020583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:36.020612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:36.020627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 [2024-11-29 14:03:36.037388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e46300) 00:29:55.786 [2024-11-29 14:03:36.037441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.786 [2024-11-29 14:03:36.037457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.786 00:29:55.786 Latency(us) 00:29:55.786 [2024-11-29T13:03:36.068Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:55.786 [2024-11-29T13:03:36.068Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:55.786 nvme0n1 : 2.01 16378.16 63.98 0.00 0.00 7807.97 3495.25 32234.00 00:29:55.786 [2024-11-29T13:03:36.068Z] =================================================================================================================== 00:29:55.786 [2024-11-29T13:03:36.068Z] Total : 16378.16 63.98 0.00 0.00 7807.97 3495.25 32234.00 00:29:55.786 0 00:29:55.786 14:03:36 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:55.786 14:03:36 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:55.786 14:03:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:55.786 14:03:36 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:55.786 | .driver_specific 00:29:55.786 | .nvme_error 00:29:55.786 | .status_code 00:29:55.786 | .command_transient_transport_error' 00:29:56.043 14:03:36 -- host/digest.sh@71 -- # (( 128 > 0 )) 00:29:56.043 14:03:36 -- host/digest.sh@73 -- # killprocess 2424150 00:29:56.043 14:03:36 -- common/autotest_common.sh@936 -- # '[' -z 2424150 ']' 00:29:56.043 14:03:36 -- common/autotest_common.sh@940 -- # kill -0 2424150 00:29:56.043 14:03:36 -- common/autotest_common.sh@941 -- # uname 00:29:56.043 14:03:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:56.043 14:03:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2424150 00:29:56.301 14:03:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:56.301 14:03:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:56.301 14:03:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2424150' 00:29:56.301 killing process with pid 2424150 00:29:56.301 14:03:36 -- common/autotest_common.sh@955 -- # kill 2424150 00:29:56.301 Received shutdown signal, test time was about 2.000000 seconds 00:29:56.301 00:29:56.301 Latency(us) 00:29:56.301 [2024-11-29T13:03:36.583Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.301 [2024-11-29T13:03:36.583Z] =================================================================================================================== 00:29:56.301 [2024-11-29T13:03:36.583Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:56.301 14:03:36 -- common/autotest_common.sh@960 -- # wait 2424150 00:29:56.301 14:03:36 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:56.301 14:03:36 -- host/digest.sh@54 -- # local rw bs qd 00:29:56.301 14:03:36 -- host/digest.sh@56 -- # rw=randread 00:29:56.301 14:03:36 -- host/digest.sh@56 -- # bs=131072 00:29:56.301 14:03:36 -- host/digest.sh@56 -- # qd=16 00:29:56.301 14:03:36 -- host/digest.sh@58 -- # bperfpid=2424708 00:29:56.301 14:03:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:56.301 14:03:36 -- host/digest.sh@60 -- # waitforlisten 2424708 /var/tmp/bperf.sock 00:29:56.301 14:03:36 -- common/autotest_common.sh@829 -- # '[' -z 2424708 ']' 00:29:56.301 14:03:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:56.301 14:03:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.301 14:03:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:56.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:56.301 14:03:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.301 14:03:36 -- common/autotest_common.sh@10 -- # set +x 00:29:56.562 [2024-11-29 14:03:36.595277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:56.562 [2024-11-29 14:03:36.595355] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2424708 ] 00:29:56.562 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.562 Zero copy mechanism will not be used. 00:29:56.562 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.562 [2024-11-29 14:03:36.657227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:56.562 [2024-11-29 14:03:36.742460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.497 14:03:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:57.497 14:03:37 -- common/autotest_common.sh@862 -- # return 0 00:29:57.497 14:03:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:57.497 14:03:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:57.755 14:03:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:57.755 14:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.755 14:03:37 -- common/autotest_common.sh@10 -- # set +x 00:29:57.755 14:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.755 14:03:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.755 14:03:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:58.015 nvme0n1 00:29:58.276 14:03:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:58.276 14:03:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.276 14:03:38 -- common/autotest_common.sh@10 -- # set +x 00:29:58.276 14:03:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.276 14:03:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:58.276 14:03:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:58.276 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:58.276 Zero copy mechanism will not be used. 00:29:58.276 Running I/O for 2 seconds... 00:29:58.276 [2024-11-29 14:03:38.441227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.441309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.441332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.449167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.449200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.449233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.457129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.457162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.457195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.464719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.464766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.464784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.472369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.472427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.472455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.479918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.479948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.479981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.487580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.487622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.487640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.495022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.495068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.495087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.503536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.503566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.503596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.511719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.511770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.511790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.519718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.519748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.519784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.527339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.527374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.527406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.534913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.534963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.276 [2024-11-29 14:03:38.534983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.276 [2024-11-29 14:03:38.542479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.276 [2024-11-29 14:03:38.542509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.277 [2024-11-29 14:03:38.542541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.277 [2024-11-29 14:03:38.550344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.277 [2024-11-29 14:03:38.550380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.277 [2024-11-29 14:03:38.550412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.558534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.558565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.558598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.566143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.566180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.566199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.573875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.573912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.573932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.581481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.581511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.581545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.589061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.589098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.589118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.596783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.596820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.596840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.604440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.604486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.604502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.612008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.612044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.612064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.619763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.619805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.619826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.627475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.627506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.627523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.634983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.635019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.635039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.642594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.642625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.642656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.650030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.650066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.650087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.657622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.657652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.657684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.665241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.665277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.538 [2024-11-29 14:03:38.665297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.538 [2024-11-29 14:03:38.673004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.538 [2024-11-29 14:03:38.673040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.673059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.680666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.680695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.680711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.688273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.688309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.688328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.695809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.695845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.695864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.703186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.703223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.703243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.710764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.710800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.710820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.718290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.718327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.718347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.725940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.725976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.725995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.733590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.733621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.733654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.741070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.741106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.741126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.748790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.748826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.748852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.756491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.756521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.756555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.764012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.764047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.764065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.771553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.771598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.771615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.779126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.779161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.779180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.786760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.786795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.786814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.794219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.794253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.794271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.801513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.801545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.801578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.808745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.808794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.808812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.539 [2024-11-29 14:03:38.816249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.539 [2024-11-29 14:03:38.816289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.539 [2024-11-29 14:03:38.816308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.823517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.823548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.800 [2024-11-29 14:03:38.823581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.830838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.830872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.800 [2024-11-29 14:03:38.830890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.838342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.838376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.800 [2024-11-29 14:03:38.838402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.845807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.845841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.800 [2024-11-29 14:03:38.845859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.853268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.853303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.800 [2024-11-29 14:03:38.853321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.800 [2024-11-29 14:03:38.860741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.800 [2024-11-29 14:03:38.860777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.860796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.868060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.868094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.868113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.875315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.875349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.875367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.882537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.882568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.882600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.889805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.889839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.889857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.897015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.897049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.897068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.904345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.904380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.904413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.911747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.911782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.911801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.919328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.919364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.919384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.926718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.926764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.926783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.934314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.934349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.934368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.941822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.941858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.941884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.949382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.949443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.949462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.956719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.956767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.956787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.964097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.964133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.964153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.971658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.971688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.971721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.979124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.979160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.979179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.986613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.986643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.986676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:38.994329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:38.994366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:38.994385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.002003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.002039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.002059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.009705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.009751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.009771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.017261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.017298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.017318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.024824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.024860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.024880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.032639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.032670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.032708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.039872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.039908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.039928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.047536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.047568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.047586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.055016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.055053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.801 [2024-11-29 14:03:39.055073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.801 [2024-11-29 14:03:39.062547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.801 [2024-11-29 14:03:39.062578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.802 [2024-11-29 14:03:39.062609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.802 [2024-11-29 14:03:39.069923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.802 [2024-11-29 14:03:39.069960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.802 [2024-11-29 14:03:39.069986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.802 [2024-11-29 14:03:39.077491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:58.802 [2024-11-29 14:03:39.077538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.802 [2024-11-29 14:03:39.077554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.062 [2024-11-29 14:03:39.084909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.062 [2024-11-29 14:03:39.084947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.062 [2024-11-29 14:03:39.084967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.092463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.092508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.092525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.100095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.100130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.100150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.107656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.107686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.107720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.115119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.115155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.115175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.122691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.122722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.122756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.130219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.130256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.130276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.137719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.137763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.137783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.145167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.145205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.145224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.152669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.152714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.152730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.160413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.160460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.160475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.167898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.167935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.167956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.175507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.175537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.175552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.183357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.183403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.183425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.190986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.191023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.191042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.198445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.198478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.198510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.205901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.205938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.205958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.213226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.213258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.213294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.220668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.220715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.220733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.228581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.228612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.228644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.236934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.236972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.236992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.245763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.245800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.245819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.254623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.254661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.254692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.263305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.263342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.263362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.272373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.272425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.272464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.281159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.281195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.281215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.063 [2024-11-29 14:03:39.289662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.063 [2024-11-29 14:03:39.289719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.063 [2024-11-29 14:03:39.289763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.296666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.296708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.296754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.304013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.304049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.304069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.312224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.312260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.312280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.319405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.319467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.319487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.327433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.327482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.327500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.064 [2024-11-29 14:03:39.336003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.064 [2024-11-29 14:03:39.336038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.064 [2024-11-29 14:03:39.336057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.344418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.344488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.344531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.351893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.351939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.351970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.359191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.359236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.359268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.366289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.366335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.366369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.374733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.374769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.374789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.382277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.382323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.382355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.388626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.388668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.388697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.395512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.395545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.395563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.403161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.403197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.323 [2024-11-29 14:03:39.403217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.323 [2024-11-29 14:03:39.410642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.323 [2024-11-29 14:03:39.410675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.410693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.418156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.418192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.418212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.425703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.425735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.425752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.433537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.433568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.433585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.441191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.441228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.441247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.448744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.448782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.448801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.456349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.456386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.456416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.463810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.463842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.463860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.471348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.471384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.471434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.478827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.478863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.478883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.486559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.486592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.486609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.494098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.494133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.494152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.501551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.501582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.501598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.508741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.508774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.508804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.516341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.516377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.516406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.523839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.523871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.523888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.531335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.531370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.531390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.538772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.538804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.538836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.546044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.546076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.546110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.553444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.553475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.553493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.560844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.560890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.560907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.568309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.568344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.568362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.575806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.575841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.575860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.583344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.583381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.583552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.591238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.591274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.591293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.324 [2024-11-29 14:03:39.598886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.324 [2024-11-29 14:03:39.598923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.324 [2024-11-29 14:03:39.598948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.606377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.606423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.606443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.614124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.614160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.614180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.621777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.621813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.621833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.629356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.629406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.629430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.636937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.636973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.636993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.644493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.644525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.644542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.651993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.652028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.652047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.659410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.659444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.659478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.666773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.666812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.666831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.674078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.674111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.674129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.681370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.583 [2024-11-29 14:03:39.681410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.583 [2024-11-29 14:03:39.681444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.583 [2024-11-29 14:03:39.688666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.688699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.688716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.695649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.695681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.695699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.702554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.702586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.702604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.709509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.709541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.709560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.716287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.716320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.716352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.723120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.723152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.723170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.730239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.730271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.730288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.737877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.737909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.737928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.746116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.746149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.746166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.754029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.754061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.754079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.761585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.761616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.761633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.769957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.769991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.770009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.778914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.778946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.778964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.786201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.786247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.786280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.793442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.793480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.793531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.801414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.801461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.801478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.810429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.810461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.810478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.818235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.818281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.818314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.823502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.823533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.823567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.831530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.831570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.831592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.839765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.839800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.839819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.847017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.847052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.847072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.854537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.854567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.854597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.584 [2024-11-29 14:03:39.861974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.584 [2024-11-29 14:03:39.862016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.584 [2024-11-29 14:03:39.862037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.869422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.869469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.869486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.876753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.876789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.876809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.884253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.884289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.884309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.891775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.891811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.891831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.899462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.899492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.899524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.907057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.907094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.907113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.914530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.914560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.914592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.921913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.921949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.843 [2024-11-29 14:03:39.921968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.843 [2024-11-29 14:03:39.929372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.843 [2024-11-29 14:03:39.929420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.929454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.936902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.936938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.936959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.944476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.944507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.944540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.951795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.951832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.951852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.959298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.959334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.959354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.966628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.966658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.966692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.974141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.974176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.974196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.981718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.981769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.981789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.989211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.989246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.989272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:39.996761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:39.996797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:39.996816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.004249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.004289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.004310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.011668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.011721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.011740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.019024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.019068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.019087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.025989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.026027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.026047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.033534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.033567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.033601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.041025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.041064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.041085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.048491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.048523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.048556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.055958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.055995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.056015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.063471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.063501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.063532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.071033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.071069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.071088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.078531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.078562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.078595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.085983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.086019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.086039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.093486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.093517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.093550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.100909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.100945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.100964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.108490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.108522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.108555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.115824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.115860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.115887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.844 [2024-11-29 14:03:40.123348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:29:59.844 [2024-11-29 14:03:40.123384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.844 [2024-11-29 14:03:40.123412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.130953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.131000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.131017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.138308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.138349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.138369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.146047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.146083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.146103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.153639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.153671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.153706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.161172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.161209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.161228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.168588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.168619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.168651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.176159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.176195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.176215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.183660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.183713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.183735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.191155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.191191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.191210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.198637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.198668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.198700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.206226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.206262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.206282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.213830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.213866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.213885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.221383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.221442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.221458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.228808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.228844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.228863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.236388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.236447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.236465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.243912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.243948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.243967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.251445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.251478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.251496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.258887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.258923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.258942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.266493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.266524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.266555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.273903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.273939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.273959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.281597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.281628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.281661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.289096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.289132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.289151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.296596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.296627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.296659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.303946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.303984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.104 [2024-11-29 14:03:40.304003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.104 [2024-11-29 14:03:40.311376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.104 [2024-11-29 14:03:40.311429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.311475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.318899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.318936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.318956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.326515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.326546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.326562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.334059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.334095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.334114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.341617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.341648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.341679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.349136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.349173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.349193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.356652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.356699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.356717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.364121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.364157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.364177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.371593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.371624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.371656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.105 [2024-11-29 14:03:40.379116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.105 [2024-11-29 14:03:40.379158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.105 [2024-11-29 14:03:40.379178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.386557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.386590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.386608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.394148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.394185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.394204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.401529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.401562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.401580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.408995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.409031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.409051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.416507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.416540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.416558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.423823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.423860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.423881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.365 [2024-11-29 14:03:40.431464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x24a4190) 00:30:00.365 [2024-11-29 14:03:40.431513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.365 [2024-11-29 14:03:40.431531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.365 00:30:00.365 Latency(us) 00:30:00.365 [2024-11-29T13:03:40.647Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.365 [2024-11-29T13:03:40.647Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:00.365 nvme0n1 : 2.00 4096.24 512.03 0.00 0.00 3901.69 770.65 9611.95 00:30:00.365 [2024-11-29T13:03:40.647Z] =================================================================================================================== 00:30:00.365 [2024-11-29T13:03:40.647Z] Total : 4096.24 512.03 0.00 0.00 3901.69 770.65 9611.95 00:30:00.365 0 00:30:00.365 14:03:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:00.365 14:03:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:00.365 14:03:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:00.365 | .driver_specific 00:30:00.365 | .nvme_error 00:30:00.365 | .status_code 00:30:00.365 | .command_transient_transport_error' 00:30:00.365 14:03:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:00.624 14:03:40 -- host/digest.sh@71 -- # (( 264 > 0 )) 00:30:00.624 14:03:40 -- host/digest.sh@73 -- # killprocess 2424708 00:30:00.624 14:03:40 -- common/autotest_common.sh@936 -- # '[' -z 2424708 ']' 00:30:00.624 14:03:40 -- common/autotest_common.sh@940 -- # kill -0 2424708 00:30:00.624 14:03:40 -- common/autotest_common.sh@941 -- # uname 00:30:00.624 14:03:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.624 14:03:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2424708 00:30:00.624 14:03:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:00.624 14:03:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:00.624 14:03:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2424708' 00:30:00.624 killing process with pid 2424708 00:30:00.624 14:03:40 -- common/autotest_common.sh@955 -- # kill 2424708 00:30:00.624 Received shutdown signal, test time was about 2.000000 seconds 00:30:00.624 00:30:00.624 Latency(us) 00:30:00.624 [2024-11-29T13:03:40.906Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.624 [2024-11-29T13:03:40.906Z] =================================================================================================================== 00:30:00.624 [2024-11-29T13:03:40.906Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:00.624 14:03:40 -- common/autotest_common.sh@960 -- # wait 2424708 00:30:00.882 14:03:40 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:00.882 14:03:40 -- host/digest.sh@54 -- # local rw bs qd 00:30:00.882 14:03:40 -- host/digest.sh@56 -- # rw=randwrite 00:30:00.882 14:03:40 -- host/digest.sh@56 -- # bs=4096 00:30:00.882 14:03:40 -- host/digest.sh@56 -- # qd=128 00:30:00.882 14:03:40 -- host/digest.sh@58 -- # bperfpid=2425256 00:30:00.882 14:03:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:00.882 14:03:40 -- host/digest.sh@60 -- # waitforlisten 2425256 /var/tmp/bperf.sock 00:30:00.882 14:03:40 -- common/autotest_common.sh@829 -- # '[' -z 2425256 ']' 00:30:00.882 14:03:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:00.882 14:03:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.882 14:03:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:00.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:00.882 14:03:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.882 14:03:40 -- common/autotest_common.sh@10 -- # set +x 00:30:00.882 [2024-11-29 14:03:41.026127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.882 [2024-11-29 14:03:41.026207] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2425256 ] 00:30:00.882 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.882 [2024-11-29 14:03:41.088055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:01.140 [2024-11-29 14:03:41.174021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:01.705 14:03:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.705 14:03:41 -- common/autotest_common.sh@862 -- # return 0 00:30:01.705 14:03:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:01.705 14:03:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:01.963 14:03:42 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:01.963 14:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.963 14:03:42 -- common/autotest_common.sh@10 -- # set +x 00:30:01.963 14:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.963 14:03:42 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.963 14:03:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:02.528 nvme0n1 00:30:02.528 14:03:42 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:02.528 14:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.528 14:03:42 -- common/autotest_common.sh@10 -- # set +x 00:30:02.528 14:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.528 14:03:42 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:02.528 14:03:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:02.528 Running I/O for 2 seconds... 00:30:02.528 [2024-11-29 14:03:42.716618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.716923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.716963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.729741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.729996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.730026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.742311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.742565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24448 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.742594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.754815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.755063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.755090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.767650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.767938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:20293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.767967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.780455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.780685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:10153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.780714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.793091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.793373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.793410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.528 [2024-11-29 14:03:42.805586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.528 [2024-11-29 14:03:42.805868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15040 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.528 [2024-11-29 14:03:42.805897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.818196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.818442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1028 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.818470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.830195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.830468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24749 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.830496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.842816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.843094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.843122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.855975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.856253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:19177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.856281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.868525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.868812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.868839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.881226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.881514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.881542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.893666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.893889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.893922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.905898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.906157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:11933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.906199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.918544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.918788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.918815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.931009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.931285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.931312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.943839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.944125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:20170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.944152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.956332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.956581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.956609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.968835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.969118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.969146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.981767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.982043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:24106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.982070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:42.994444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:42.994750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:14287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:42.994778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:43.007016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:43.007262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:43.007289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:43.019227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:43.019469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:1594 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:43.019497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:43.031466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:43.031792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:43.031819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:43.044024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:43.044304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:20637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:43.044331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.787 [2024-11-29 14:03:43.056414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:02.787 [2024-11-29 14:03:43.056639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:16751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.787 [2024-11-29 14:03:43.056666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.068825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.069109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.069137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.081665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.081980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:11592 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.082008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.093943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.094219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.094245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.106338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.106602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:7603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.106630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.118534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.118777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19556 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.118804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.131210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.131468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.131495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.143536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.046 [2024-11-29 14:03:43.143800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.046 [2024-11-29 14:03:43.143831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.046 [2024-11-29 14:03:43.156131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.156371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.156421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.168405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.168708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:2593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.168735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.180371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.180634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.180663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.193148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.193399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.193426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.205305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.205562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.205589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.217808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.218055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.218088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.230105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.230367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:20586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.230407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.243187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.243462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:25357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.243490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.255974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.256221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:2889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.256248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.268264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.268516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:8647 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.268544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.280923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.281168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:11723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.281195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.293159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.293413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:21781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.293440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.305873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.306119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:12116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.306146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.047 [2024-11-29 14:03:43.318610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.047 [2024-11-29 14:03:43.318861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.047 [2024-11-29 14:03:43.318888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.331658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.331973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:16518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.332000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.344627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.344974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:21923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.345002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.357471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.357708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:8633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.357735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.370210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.370484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:5675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.370512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.383083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.383330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.383357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.395914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.396162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:1213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.305 [2024-11-29 14:03:43.396190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.305 [2024-11-29 14:03:43.408769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.305 [2024-11-29 14:03:43.409038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.409069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.421625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.421880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.421907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.434473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.434709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.434735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.447263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.447518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.447546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.460208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.460468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.460496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.473129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.473379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.473415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.485849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.486097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:7101 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.486126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.499143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.499414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:8997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.499442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.512457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.512673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:23136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.512715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.525484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.525747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.525794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.538591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.538847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.538875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.551559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.551790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.551822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.564708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.564956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:21363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.564983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.306 [2024-11-29 14:03:43.577482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.306 [2024-11-29 14:03:43.577700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:4382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.306 [2024-11-29 14:03:43.577726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.590700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.590937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:9701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.590964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.603579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.603808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4683 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.603834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.616456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.616689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:1139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.616715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.629298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.629538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.629565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.642288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.642561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.642592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.655458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.655695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.655722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.668313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.668546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:16498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.564 [2024-11-29 14:03:43.668573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.564 [2024-11-29 14:03:43.681288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.564 [2024-11-29 14:03:43.681527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:21797 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.681555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.695146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.695416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.695460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.708133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.708444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:20266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.708473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.721742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.721999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:13749 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.722028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.735108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.735359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.735411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.748135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.748407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.748435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.761171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.761449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18096 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.761477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.774274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.774576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.774604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.787549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.787785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:6362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.787813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.800200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.800498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.800527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.812740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.812984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:7614 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.813012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.825368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.825621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.825648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.565 [2024-11-29 14:03:43.838022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.565 [2024-11-29 14:03:43.838269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:25371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.565 [2024-11-29 14:03:43.838296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.851157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.851511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:10258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.851539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.864129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.864375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.864418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.876734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.877026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:24964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.877054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.889577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.889812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.889844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.903308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.903571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:15213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.903600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.916782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.917025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:21763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.917052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.930196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.930443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.930470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.943924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.944160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:2549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.944187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.957527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.957788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:13837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.957820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.971309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.971574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.971603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.985033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.985290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:17741 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.985321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:43.998780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:43.999026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:7999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:43.999072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.012314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.012585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:8700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.012618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.025611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.025865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.025896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.039196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.039437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.039464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.052632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.052889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:2228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.052920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.066006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.066241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4984 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.066268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.079130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.079385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:8625 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.079443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:03.824 [2024-11-29 14:03:44.092874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:03.824 [2024-11-29 14:03:44.093141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:5480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.824 [2024-11-29 14:03:44.093168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.084 [2024-11-29 14:03:44.106412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.084 [2024-11-29 14:03:44.106673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7015 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.084 [2024-11-29 14:03:44.106705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.084 [2024-11-29 14:03:44.119854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.120094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.120140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.133150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.133381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:7313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.133415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.146568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.146829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:24770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.146860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.159796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.160113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10516 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.160140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.173312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.173575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:9969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.173604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.186706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.186965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13551 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.186996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.200166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.200424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.200452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.213581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.213815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:7725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.213842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.227046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.227280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:3670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.227307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.240546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.240806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.240843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.253945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.254204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:20690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.254236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.267583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.267883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.267914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.281088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.281357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.281388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.294595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.294851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.294881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.308231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.308475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.308520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.321664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.321896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:12749 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.321922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.335007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.335241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8024 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.335267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.348343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.348624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:1459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.348656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.085 [2024-11-29 14:03:44.361877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.085 [2024-11-29 14:03:44.362125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:2616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.085 [2024-11-29 14:03:44.362153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.375303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.375605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.375636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.389110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.389347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.389375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.402599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.402854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.402885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.415588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.415823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:23603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.415850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.428999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.429256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:3970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.429284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.442344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.442587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24590 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.442614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.455576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.455877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:21043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.455905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.468867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.469104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:25042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.469132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.482047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.482283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4683 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.482310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.495466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.495701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:13511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.495728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.508745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.509019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:5678 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.509050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.522368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.522640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.522678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.536220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.536490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:21387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.536518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.549843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.550075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15764 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.550101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.563290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.563529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.563556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.576722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.576986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.577017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.590025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.590261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:2691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.590293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.603091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.603347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:25231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.603378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.616528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.616764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:23394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.616791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.357 [2024-11-29 14:03:44.629905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.357 [2024-11-29 14:03:44.630131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:23354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.357 [2024-11-29 14:03:44.630158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 [2024-11-29 14:03:44.643757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.646 [2024-11-29 14:03:44.644023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.646 [2024-11-29 14:03:44.644054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 [2024-11-29 14:03:44.657134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.646 [2024-11-29 14:03:44.657377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:9221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.646 [2024-11-29 14:03:44.657412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 [2024-11-29 14:03:44.670285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.646 [2024-11-29 14:03:44.670527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.646 [2024-11-29 14:03:44.670556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 [2024-11-29 14:03:44.683531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.646 [2024-11-29 14:03:44.683779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:12813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.646 [2024-11-29 14:03:44.683806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 [2024-11-29 14:03:44.696905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba13f0) with pdu=0x2000190fe2e8 00:30:04.646 [2024-11-29 14:03:44.697143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:9735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:04.646 [2024-11-29 14:03:44.697170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:04.646 00:30:04.646 Latency(us) 00:30:04.646 [2024-11-29T13:03:44.928Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:04.646 [2024-11-29T13:03:44.928Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:04.646 nvme0n1 : 2.01 19525.92 76.27 0.00 0.00 6541.29 5776.88 16505.36 00:30:04.646 [2024-11-29T13:03:44.928Z] =================================================================================================================== 00:30:04.646 [2024-11-29T13:03:44.928Z] Total : 19525.92 76.27 0.00 0.00 6541.29 5776.88 16505.36 00:30:04.646 0 00:30:04.646 14:03:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:04.646 14:03:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:04.646 14:03:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:04.646 | .driver_specific 00:30:04.646 | .nvme_error 00:30:04.646 | .status_code 00:30:04.646 | .command_transient_transport_error' 00:30:04.646 14:03:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:04.903 14:03:44 -- host/digest.sh@71 -- # (( 153 > 0 )) 00:30:04.903 14:03:44 -- host/digest.sh@73 -- # killprocess 2425256 00:30:04.903 14:03:44 -- common/autotest_common.sh@936 -- # '[' -z 2425256 ']' 00:30:04.903 14:03:44 -- common/autotest_common.sh@940 -- # kill -0 2425256 00:30:04.903 14:03:44 -- common/autotest_common.sh@941 -- # uname 00:30:04.903 14:03:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:04.903 14:03:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2425256 00:30:04.903 14:03:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:04.903 14:03:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:04.903 14:03:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2425256' 00:30:04.903 killing process with pid 2425256 00:30:04.903 14:03:45 -- common/autotest_common.sh@955 -- # kill 2425256 00:30:04.903 Received shutdown signal, test time was about 2.000000 seconds 00:30:04.903 00:30:04.903 Latency(us) 00:30:04.903 [2024-11-29T13:03:45.185Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:04.903 [2024-11-29T13:03:45.185Z] =================================================================================================================== 00:30:04.903 [2024-11-29T13:03:45.185Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:04.903 14:03:45 -- common/autotest_common.sh@960 -- # wait 2425256 00:30:05.160 14:03:45 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:05.160 14:03:45 -- host/digest.sh@54 -- # local rw bs qd 00:30:05.160 14:03:45 -- host/digest.sh@56 -- # rw=randwrite 00:30:05.160 14:03:45 -- host/digest.sh@56 -- # bs=131072 00:30:05.160 14:03:45 -- host/digest.sh@56 -- # qd=16 00:30:05.160 14:03:45 -- host/digest.sh@58 -- # bperfpid=2425812 00:30:05.160 14:03:45 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:05.160 14:03:45 -- host/digest.sh@60 -- # waitforlisten 2425812 /var/tmp/bperf.sock 00:30:05.160 14:03:45 -- common/autotest_common.sh@829 -- # '[' -z 2425812 ']' 00:30:05.160 14:03:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:05.160 14:03:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:05.160 14:03:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:05.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:05.160 14:03:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:05.160 14:03:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.160 [2024-11-29 14:03:45.290997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:05.160 [2024-11-29 14:03:45.291074] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2425812 ] 00:30:05.160 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:05.160 Zero copy mechanism will not be used. 00:30:05.160 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.160 [2024-11-29 14:03:45.350232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:05.160 [2024-11-29 14:03:45.433016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:06.093 14:03:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:06.093 14:03:46 -- common/autotest_common.sh@862 -- # return 0 00:30:06.093 14:03:46 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:06.093 14:03:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:06.350 14:03:46 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:06.350 14:03:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.350 14:03:46 -- common/autotest_common.sh@10 -- # set +x 00:30:06.350 14:03:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.350 14:03:46 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:06.350 14:03:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:06.916 nvme0n1 00:30:06.916 14:03:47 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:06.916 14:03:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.916 14:03:47 -- common/autotest_common.sh@10 -- # set +x 00:30:06.916 14:03:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.916 14:03:47 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:06.916 14:03:47 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:07.176 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:07.176 Zero copy mechanism will not be used. 00:30:07.176 Running I/O for 2 seconds... 00:30:07.176 [2024-11-29 14:03:47.211107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.176 [2024-11-29 14:03:47.211446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.176 [2024-11-29 14:03:47.211490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.176 [2024-11-29 14:03:47.215976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.176 [2024-11-29 14:03:47.216103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.176 [2024-11-29 14:03:47.216136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.176 [2024-11-29 14:03:47.221178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.176 [2024-11-29 14:03:47.221276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.221304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.226387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.226479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.226508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.231488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.231604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.231635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.236777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.236871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.236903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.242172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.242286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.242316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.247489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.247702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.247734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.252748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.252893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.252922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.258067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.258185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.258217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.263251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.263446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.263477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.268472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.268586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.268615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.273707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.273835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.273866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.278703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.278796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.278829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.284011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.284168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.284199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.288477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.288653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.288684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.292551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.292737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.292767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.296573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.296705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.296737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.300536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.300672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.300703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.304816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.304933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.304966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.308903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.309060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.309089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.312999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.313116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.313146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.317042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.317205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.317241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.321151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.321347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.321377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.325215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.325418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.325448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.329223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.329348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.329379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.333195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.333342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.333375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.337259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.337391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.337432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.341320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.177 [2024-11-29 14:03:47.341477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.177 [2024-11-29 14:03:47.341508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.177 [2024-11-29 14:03:47.345433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.345563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.345593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.349554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.349717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.349752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.353639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.353828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.353858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.357844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.358064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.358095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.361860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.362015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.362047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.365955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.366114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.366146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.369951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.370097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.370126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.373968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.374135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.374165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.378059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.378176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.378205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.382117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.382297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.382326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.386178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.386391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.386441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.390297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.390494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.390524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.394326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.394475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.394505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.398353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.398534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.398564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.402471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.402576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.402605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.406538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.406686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.406715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.410536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.410637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.410667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.414588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.414739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.414771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.418620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.418799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.418829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.422758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.422965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.422996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.426807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.426948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.426978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.430934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.431092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.431126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.434995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.435122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.435152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.439087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.439224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.439265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.443063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.443197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.443229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.447146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.447328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.447358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.451336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.178 [2024-11-29 14:03:47.451533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.178 [2024-11-29 14:03:47.451565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.178 [2024-11-29 14:03:47.455489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.439 [2024-11-29 14:03:47.455690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.439 [2024-11-29 14:03:47.455721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.439 [2024-11-29 14:03:47.459599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.439 [2024-11-29 14:03:47.459714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.439 [2024-11-29 14:03:47.459744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.439 [2024-11-29 14:03:47.463776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.463937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.463967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.467962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.468081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.468110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.472007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.472183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.472213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.476024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.476131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.476161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.480078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.480254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.480284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.484153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.484333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.484361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.488241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.488454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.488483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.492290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.492433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.492469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.496370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.496544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.496574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.500348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.500483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.500513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.504423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.504566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.504597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.508414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.508527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.508556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.512445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.512581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.512614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.516476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.516656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.516685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.520569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.520749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.520778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.524542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.524677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.524709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.528500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.528646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.528676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.532564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.532677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.532707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.536635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.536779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.536808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.540626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.540741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.540770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.544748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.544930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.544959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.548938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.549133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.549163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.553061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.553257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.553286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.557189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.557318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.557347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.561348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.561544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.561580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.565387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.440 [2024-11-29 14:03:47.565519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.440 [2024-11-29 14:03:47.565550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.440 [2024-11-29 14:03:47.569428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.569549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.569577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.573552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.573668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.573696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.577662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.577825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.577853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.581744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.581937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.581967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.585918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.586110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.586140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.589951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.590068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.590098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.594155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.594343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.594372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.599285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.599462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.599491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.605156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.605310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.605339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.610496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.610711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.610741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.615308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.615518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.615548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.619732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.619933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.619967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.624036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.624252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.624284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.628842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.628963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.628992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.634544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.634737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.634765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.638705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.638815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.638843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.642807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.642966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.642995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.646844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.646948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.646980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.650901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.651091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.651120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.654985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.655173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.655202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.659134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.659327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.659356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.663211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.663359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.663387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.667273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.667437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.667466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.671261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.671371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.671408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.675234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.675404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.441 [2024-11-29 14:03:47.675440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.441 [2024-11-29 14:03:47.679220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.441 [2024-11-29 14:03:47.679337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.679367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.683332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.683488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.683517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.687492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.687668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.687697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.691651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.691831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.691860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.695612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.695721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.695750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.699614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.699761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.699793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.703676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.703817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.703845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.707813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.707969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.707998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.711838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.711974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.712003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.442 [2024-11-29 14:03:47.716013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.442 [2024-11-29 14:03:47.716152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.442 [2024-11-29 14:03:47.716185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.720212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.720418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.720451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.724271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.724456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.724486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.728307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.728443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.728475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.732336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.732514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.732544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.736509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.736665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.736694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.740909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.741068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.741098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.744942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.745068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.703 [2024-11-29 14:03:47.745097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.703 [2024-11-29 14:03:47.749006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.703 [2024-11-29 14:03:47.749184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.749213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.753215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.753441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.753475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.757405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.757579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.757612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.761703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.761911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.761940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.767170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.767313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.767342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.772047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.772171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.772200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.776402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.776558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.776588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.780473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.780592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.780621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.785283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.785563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.785599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.791069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.791307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.791339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.795534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.795707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.795738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.799909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.800043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.800072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.804927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.805057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.805086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.809683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.809823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.809851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.813768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.813894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.813923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.817802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.817952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.817981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.821908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.822084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.822114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.825939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.826136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.826166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.830185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.830386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.830424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.834274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.834433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.834466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.838300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.838463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.838492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.842351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.842495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.842525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.846370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.846547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.846576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.850507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.850622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.850650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.854566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.854729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.704 [2024-11-29 14:03:47.854761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.704 [2024-11-29 14:03:47.858713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.704 [2024-11-29 14:03:47.858918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.858956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.862817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.863010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.863039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.867071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.867220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.867250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.871695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.871852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.871881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.877263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.877410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.877438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.882532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.882698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.882729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.887361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.887517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.887546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.892288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.892460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.892492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.897278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.897501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.897535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.902041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.902256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.902284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.906865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.907057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.907086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.911471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.911623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.911651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.915455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.915578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.915608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.919534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.919691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.919723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.923541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.923650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.923682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.928410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.928592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.928622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.933128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.933335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.933365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.937118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.937316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.937345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.941222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.941386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.941423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.945226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.945400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.945430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.949228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.949345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.949373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.953176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.953329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.953358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.957196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.957354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.957383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.961214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.961407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.961436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.965245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.965445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.965474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.969276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.969484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.969514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.973268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.705 [2024-11-29 14:03:47.973421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.705 [2024-11-29 14:03:47.973458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.705 [2024-11-29 14:03:47.977344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.706 [2024-11-29 14:03:47.977482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.706 [2024-11-29 14:03:47.977512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.706 [2024-11-29 14:03:47.981385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.706 [2024-11-29 14:03:47.981526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.706 [2024-11-29 14:03:47.981555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:47.985516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:47.985671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:47.985700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:47.989524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:47.989617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:47.989644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:47.993640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:47.993806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:47.993836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:47.997804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:47.997993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:47.998022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.001906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.002106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:48.002135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.005922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.006063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:48.006091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.010019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.010190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:48.010219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.014050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.014177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:48.014206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.018090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.018237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.966 [2024-11-29 14:03:48.018269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.966 [2024-11-29 14:03:48.022076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.966 [2024-11-29 14:03:48.022193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.022221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.026157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.026312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.026342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.030202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.030411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.030440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.034405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.034590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.034620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.038508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.038623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.038651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.042498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.042644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.042673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.046496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.046617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.046646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.050617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.050769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.050799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.054582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.054693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.054722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.058716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.058894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.058922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.063774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.064027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.064058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.069494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.069727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.069757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.074625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.074788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.074818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.079691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.079883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.079915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.084213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.084338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.084377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.089790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.089944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.089973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.094259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.094415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.094445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.098681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.098867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.098897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.104311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.104477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.104508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.109572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.109772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.109804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.114256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.114387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.114426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.118502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.118659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.118689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.123489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.123642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.123673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.128991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.129157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.129186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.135063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.135296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.135324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.141734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.141916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.141946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.148189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.148347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.967 [2024-11-29 14:03:48.148375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.967 [2024-11-29 14:03:48.154864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.967 [2024-11-29 14:03:48.155112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.155141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.161230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.161458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.161487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.167498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.167682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.167712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.174132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.174311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.174339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.180537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.180786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.180814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.186994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.187131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.187160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.193663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.193905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.193934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.200462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.200716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.200746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.206901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.207140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.207172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.213405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.213539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.213566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.220025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.220198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.220231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.225634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.225800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.225836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.230010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.230129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.230162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.234405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.234594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.234631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.239037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.239206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.239241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.968 [2024-11-29 14:03:48.243659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:07.968 [2024-11-29 14:03:48.243915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.968 [2024-11-29 14:03:48.243949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.248000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.248213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.248245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.252419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.252604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.252634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.256683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.256838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.256871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.261028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.261151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.261187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.265362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.265497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.265529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.269940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.270106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.270138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.274406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.274560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.274591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.279003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.279235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.279272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.283522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.283763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.283798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.288029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.288232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.288266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.292520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.292633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.292664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.296934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.297053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.297086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.301312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.301448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.301502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.305866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.306046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.306081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.310312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.310508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.310538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.314911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.315163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.227 [2024-11-29 14:03:48.315216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.227 [2024-11-29 14:03:48.319434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.227 [2024-11-29 14:03:48.319625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.319654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.323891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.324069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.324101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.328304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.328485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.328519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.332677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.332818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.332851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.337079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.337218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.337251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.341577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.341763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.341798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.345965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.346114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.346147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.350468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.350722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.350762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.354847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.355086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.355123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.359286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.359468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.359498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.363729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.363881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.363914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.368102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.368226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.368259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.372499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.372600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.372630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.377042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.377267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.377300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.381684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.381848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.381885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.386668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.386948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.386982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.392382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.392658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.392687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.398962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.399195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.399227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.404930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.405094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.405127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.409630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.409806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.409843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.414372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.414530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.414559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.420115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.420319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.420352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.425304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.425542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.425575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.431413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.431779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.431813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.436972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.437273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.437308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.442573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.442789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.442821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.448383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.448553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.448582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.228 [2024-11-29 14:03:48.454531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.228 [2024-11-29 14:03:48.454673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.228 [2024-11-29 14:03:48.454702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.460030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.460257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.460288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.466010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.466212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.466245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.471324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.471524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.471555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.476309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.476496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.476526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.481833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.482119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.482152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.487713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.487807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.487844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.494092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.494310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.494341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.229 [2024-11-29 14:03:48.500858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.229 [2024-11-29 14:03:48.501044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.229 [2024-11-29 14:03:48.501076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.507734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.507923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.507956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.513781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.513973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.514005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.519495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.519608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.519638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.525159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.525386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.525457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.530504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.530702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.530749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.535229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.535464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.535495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.540729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.540919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.540953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.546683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.546828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.546859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.553638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.553803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.553835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.559828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.560096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.560129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.565896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.566073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.566105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.572358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.572699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.572746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.578760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.579062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.579095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.585221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.585525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.585555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.591790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.591974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.592005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.597941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.598130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.598161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.604341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.604484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.604512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.610715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.610932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.610964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.616827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.616978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.617011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.623215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.623547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.623578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.628726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.629010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.629048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.633337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.633501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.633530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.638453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.638617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.638650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.642945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.643100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.643144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.647535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.647731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.488 [2024-11-29 14:03:48.647761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.488 [2024-11-29 14:03:48.653440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.488 [2024-11-29 14:03:48.653654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.653684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.660078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.660215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.660247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.666216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.666329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.666361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.672544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.672756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.672785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.679371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.679558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.679587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.684999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.685197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.685229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.690911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.691058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.691090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.696051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.696182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.696214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.702003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.702184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.702217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.708359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.708628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.708660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.715039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.715332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.715364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.720955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.721187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.721220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.727803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.728041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.728076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.733638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.733795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.733829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.738624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.738838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.738868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.744404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.744541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.744570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.750037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.750232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.750265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.755135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.755334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.755369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.760130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.760468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.760498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.489 [2024-11-29 14:03:48.765917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.489 [2024-11-29 14:03:48.766198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.489 [2024-11-29 14:03:48.766230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.747 [2024-11-29 14:03:48.771289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.747 [2024-11-29 14:03:48.771574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.747 [2024-11-29 14:03:48.771603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.747 [2024-11-29 14:03:48.776848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.747 [2024-11-29 14:03:48.777107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.747 [2024-11-29 14:03:48.777144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.782344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.782508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.782537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.787754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.787969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.788002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.793333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.793519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.793555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.799011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.799162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.799196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.804894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.805195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.805227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.811791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.811911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.811944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.818351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.818559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.818589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.825299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.825581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.825610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.832111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.832239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.832270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.838378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.838552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.838582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.845167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.845365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.845405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.851949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.852175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.852208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.858790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.859091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.859125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.865530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.865692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.865721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.872274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.872558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.872589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.879016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.879289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.879323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.885541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.885672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.885701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.890389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.890601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.890630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.894865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.895024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.895058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.899380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.899559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.899588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.904039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.904278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.904311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.908765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.909012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.909045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.914484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.914741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.914770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.920440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.920617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.920646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.748 [2024-11-29 14:03:48.926676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.748 [2024-11-29 14:03:48.926835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.748 [2024-11-29 14:03:48.926867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.931468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.931605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.931635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.936484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.936611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.936640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.941420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.941570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.941598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.946035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.946253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.946291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.951250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.951498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.951527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.957064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.957375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.957416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.963644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.963910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.963942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.969730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.969819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.969849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.976510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.976694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.976723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.983136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.983332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.983364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.990009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.990200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.990228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:48.996592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:48.996819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:48.996850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.001243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.001493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.001523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.006169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.006422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.006469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.010592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.010772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.010802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.014972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.015081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.015114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.020459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.020614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.020644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.749 [2024-11-29 14:03:49.025083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:08.749 [2024-11-29 14:03:49.025249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.749 [2024-11-29 14:03:49.025282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.008 [2024-11-29 14:03:49.029545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.029647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.029679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.034013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.034234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.034266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.038492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.038682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.038711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.042750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.042966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.042995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.046784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.046959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.046987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.050744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.050855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.050885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.054931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.055119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.055151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.059963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.060143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.060173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.065415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.065567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.065600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.070939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.071185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.071214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.075723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.075899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.075928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.079878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.080043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.080078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.084019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.084225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.084258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.088223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.088371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.088414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.092886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.093056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.093085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.098206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.098313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.098341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.102562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.102669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.102697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.106590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.106754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.106783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.110522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.110644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.110673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.114466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.114620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.114648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.118453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.118650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.118679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.122371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.122505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.122534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.126316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.126508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.126537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.130357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.130517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.130546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.134241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.134344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.134376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.138258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.138446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.138476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.142166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.142280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.142309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.009 [2024-11-29 14:03:49.146376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.009 [2024-11-29 14:03:49.146564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.009 [2024-11-29 14:03:49.146592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.150825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.151026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.151059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.155193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.155309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.155341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.160580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.160783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.160812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.166006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.166207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.166239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.170961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.171123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.171154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.176033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.176236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.176267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.181024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.181183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.181215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.185639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.185843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.185873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.190752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.190929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.190961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.195730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.195877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.195919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.200705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.200953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.200989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:09.010 [2024-11-29 14:03:49.205376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1ba1590) with pdu=0x2000190fef90 00:30:09.010 [2024-11-29 14:03:49.205483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.010 [2024-11-29 14:03:49.205511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:09.010 00:30:09.010 Latency(us) 00:30:09.010 [2024-11-29T13:03:49.292Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:09.010 [2024-11-29T13:03:49.292Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:09.010 nvme0n1 : 2.00 6412.35 801.54 0.00 0.00 2487.97 1699.08 9806.13 00:30:09.010 [2024-11-29T13:03:49.292Z] =================================================================================================================== 00:30:09.010 [2024-11-29T13:03:49.292Z] Total : 6412.35 801.54 0.00 0.00 2487.97 1699.08 9806.13 00:30:09.010 0 00:30:09.010 14:03:49 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:09.010 14:03:49 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:09.010 14:03:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:09.010 14:03:49 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:09.010 | .driver_specific 00:30:09.010 | .nvme_error 00:30:09.010 | .status_code 00:30:09.010 | .command_transient_transport_error' 00:30:09.268 14:03:49 -- host/digest.sh@71 -- # (( 414 > 0 )) 00:30:09.268 14:03:49 -- host/digest.sh@73 -- # killprocess 2425812 00:30:09.268 14:03:49 -- common/autotest_common.sh@936 -- # '[' -z 2425812 ']' 00:30:09.268 14:03:49 -- common/autotest_common.sh@940 -- # kill -0 2425812 00:30:09.268 14:03:49 -- common/autotest_common.sh@941 -- # uname 00:30:09.268 14:03:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:09.268 14:03:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2425812 00:30:09.268 14:03:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:09.268 14:03:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:09.268 14:03:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2425812' 00:30:09.268 killing process with pid 2425812 00:30:09.268 14:03:49 -- common/autotest_common.sh@955 -- # kill 2425812 00:30:09.268 Received shutdown signal, test time was about 2.000000 seconds 00:30:09.268 00:30:09.268 Latency(us) 00:30:09.268 [2024-11-29T13:03:49.550Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:09.268 [2024-11-29T13:03:49.550Z] =================================================================================================================== 00:30:09.268 [2024-11-29T13:03:49.550Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:09.268 14:03:49 -- common/autotest_common.sh@960 -- # wait 2425812 00:30:09.526 14:03:49 -- host/digest.sh@115 -- # killprocess 2424131 00:30:09.526 14:03:49 -- common/autotest_common.sh@936 -- # '[' -z 2424131 ']' 00:30:09.526 14:03:49 -- common/autotest_common.sh@940 -- # kill -0 2424131 00:30:09.526 14:03:49 -- common/autotest_common.sh@941 -- # uname 00:30:09.526 14:03:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:09.526 14:03:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2424131 00:30:09.526 14:03:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:09.526 14:03:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:09.526 14:03:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2424131' 00:30:09.526 killing process with pid 2424131 00:30:09.526 14:03:49 -- common/autotest_common.sh@955 -- # kill 2424131 00:30:09.526 14:03:49 -- common/autotest_common.sh@960 -- # wait 2424131 00:30:09.783 00:30:09.783 real 0m18.230s 00:30:09.783 user 0m37.348s 00:30:09.783 sys 0m4.495s 00:30:09.783 14:03:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:09.783 14:03:49 -- common/autotest_common.sh@10 -- # set +x 00:30:09.783 ************************************ 00:30:09.783 END TEST nvmf_digest_error 00:30:09.783 ************************************ 00:30:09.783 14:03:50 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:09.783 14:03:50 -- host/digest.sh@139 -- # nvmftestfini 00:30:09.783 14:03:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:09.783 14:03:50 -- nvmf/common.sh@116 -- # sync 00:30:09.783 14:03:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:09.783 14:03:50 -- nvmf/common.sh@119 -- # set +e 00:30:09.783 14:03:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:09.784 14:03:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:09.784 rmmod nvme_tcp 00:30:09.784 rmmod nvme_fabrics 00:30:09.784 rmmod nvme_keyring 00:30:09.784 14:03:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:10.043 14:03:50 -- nvmf/common.sh@123 -- # set -e 00:30:10.043 14:03:50 -- nvmf/common.sh@124 -- # return 0 00:30:10.043 14:03:50 -- nvmf/common.sh@477 -- # '[' -n 2424131 ']' 00:30:10.043 14:03:50 -- nvmf/common.sh@478 -- # killprocess 2424131 00:30:10.043 14:03:50 -- common/autotest_common.sh@936 -- # '[' -z 2424131 ']' 00:30:10.043 14:03:50 -- common/autotest_common.sh@940 -- # kill -0 2424131 00:30:10.043 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2424131) - No such process 00:30:10.043 14:03:50 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2424131 is not found' 00:30:10.043 Process with pid 2424131 is not found 00:30:10.043 14:03:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:10.043 14:03:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:10.043 14:03:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:10.043 14:03:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:10.043 14:03:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:10.043 14:03:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:10.043 14:03:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:10.043 14:03:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.947 14:03:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:11.947 00:30:11.947 real 0m38.075s 00:30:11.947 user 1m9.024s 00:30:11.947 sys 0m10.306s 00:30:11.947 14:03:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.947 14:03:52 -- common/autotest_common.sh@10 -- # set +x 00:30:11.947 ************************************ 00:30:11.947 END TEST nvmf_digest 00:30:11.947 ************************************ 00:30:11.947 14:03:52 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:11.947 14:03:52 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:11.947 14:03:52 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:11.947 14:03:52 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.947 14:03:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:11.947 14:03:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.947 14:03:52 -- common/autotest_common.sh@10 -- # set +x 00:30:11.947 ************************************ 00:30:11.947 START TEST nvmf_bdevperf 00:30:11.947 ************************************ 00:30:11.947 14:03:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.947 * Looking for test storage... 00:30:11.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:11.947 14:03:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:11.947 14:03:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:11.947 14:03:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:12.206 14:03:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:12.206 14:03:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:12.206 14:03:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:12.206 14:03:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:12.206 14:03:52 -- scripts/common.sh@335 -- # IFS=.-: 00:30:12.206 14:03:52 -- scripts/common.sh@335 -- # read -ra ver1 00:30:12.206 14:03:52 -- scripts/common.sh@336 -- # IFS=.-: 00:30:12.206 14:03:52 -- scripts/common.sh@336 -- # read -ra ver2 00:30:12.206 14:03:52 -- scripts/common.sh@337 -- # local 'op=<' 00:30:12.206 14:03:52 -- scripts/common.sh@339 -- # ver1_l=2 00:30:12.206 14:03:52 -- scripts/common.sh@340 -- # ver2_l=1 00:30:12.206 14:03:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:12.206 14:03:52 -- scripts/common.sh@343 -- # case "$op" in 00:30:12.206 14:03:52 -- scripts/common.sh@344 -- # : 1 00:30:12.206 14:03:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:12.206 14:03:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:12.206 14:03:52 -- scripts/common.sh@364 -- # decimal 1 00:30:12.206 14:03:52 -- scripts/common.sh@352 -- # local d=1 00:30:12.206 14:03:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:12.206 14:03:52 -- scripts/common.sh@354 -- # echo 1 00:30:12.206 14:03:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:12.206 14:03:52 -- scripts/common.sh@365 -- # decimal 2 00:30:12.206 14:03:52 -- scripts/common.sh@352 -- # local d=2 00:30:12.206 14:03:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:12.206 14:03:52 -- scripts/common.sh@354 -- # echo 2 00:30:12.206 14:03:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:12.206 14:03:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:12.206 14:03:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:12.206 14:03:52 -- scripts/common.sh@367 -- # return 0 00:30:12.206 14:03:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:12.206 14:03:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:12.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.206 --rc genhtml_branch_coverage=1 00:30:12.206 --rc genhtml_function_coverage=1 00:30:12.206 --rc genhtml_legend=1 00:30:12.206 --rc geninfo_all_blocks=1 00:30:12.206 --rc geninfo_unexecuted_blocks=1 00:30:12.206 00:30:12.206 ' 00:30:12.206 14:03:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:12.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.206 --rc genhtml_branch_coverage=1 00:30:12.206 --rc genhtml_function_coverage=1 00:30:12.206 --rc genhtml_legend=1 00:30:12.206 --rc geninfo_all_blocks=1 00:30:12.206 --rc geninfo_unexecuted_blocks=1 00:30:12.206 00:30:12.206 ' 00:30:12.206 14:03:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:12.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.206 --rc genhtml_branch_coverage=1 00:30:12.206 --rc genhtml_function_coverage=1 00:30:12.206 --rc genhtml_legend=1 00:30:12.206 --rc geninfo_all_blocks=1 00:30:12.206 --rc geninfo_unexecuted_blocks=1 00:30:12.206 00:30:12.206 ' 00:30:12.206 14:03:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:12.206 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.206 --rc genhtml_branch_coverage=1 00:30:12.206 --rc genhtml_function_coverage=1 00:30:12.206 --rc genhtml_legend=1 00:30:12.206 --rc geninfo_all_blocks=1 00:30:12.206 --rc geninfo_unexecuted_blocks=1 00:30:12.206 00:30:12.206 ' 00:30:12.206 14:03:52 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:12.206 14:03:52 -- nvmf/common.sh@7 -- # uname -s 00:30:12.206 14:03:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:12.206 14:03:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:12.206 14:03:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:12.206 14:03:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:12.206 14:03:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:12.206 14:03:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:12.206 14:03:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:12.206 14:03:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:12.206 14:03:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:12.206 14:03:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:12.206 14:03:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.206 14:03:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.207 14:03:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:12.207 14:03:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:12.207 14:03:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:12.207 14:03:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:12.207 14:03:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:12.207 14:03:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:12.207 14:03:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:12.207 14:03:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.207 14:03:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.207 14:03:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.207 14:03:52 -- paths/export.sh@5 -- # export PATH 00:30:12.207 14:03:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.207 14:03:52 -- nvmf/common.sh@46 -- # : 0 00:30:12.207 14:03:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:12.207 14:03:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:12.207 14:03:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:12.207 14:03:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:12.207 14:03:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:12.207 14:03:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:12.207 14:03:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:12.207 14:03:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:12.207 14:03:52 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:12.207 14:03:52 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:12.207 14:03:52 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:12.207 14:03:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:12.207 14:03:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:12.207 14:03:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:12.207 14:03:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:12.207 14:03:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:12.207 14:03:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.207 14:03:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:12.207 14:03:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:12.207 14:03:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:12.207 14:03:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:12.207 14:03:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:12.207 14:03:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.106 14:03:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:14.106 14:03:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:14.106 14:03:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:14.106 14:03:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:14.106 14:03:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:14.106 14:03:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:14.106 14:03:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:14.106 14:03:54 -- nvmf/common.sh@294 -- # net_devs=() 00:30:14.106 14:03:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:14.106 14:03:54 -- nvmf/common.sh@295 -- # e810=() 00:30:14.106 14:03:54 -- nvmf/common.sh@295 -- # local -ga e810 00:30:14.106 14:03:54 -- nvmf/common.sh@296 -- # x722=() 00:30:14.106 14:03:54 -- nvmf/common.sh@296 -- # local -ga x722 00:30:14.107 14:03:54 -- nvmf/common.sh@297 -- # mlx=() 00:30:14.107 14:03:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:14.107 14:03:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:14.107 14:03:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:14.107 14:03:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:14.107 14:03:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.107 14:03:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:14.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:14.107 14:03:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.107 14:03:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:14.107 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:14.107 14:03:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.107 14:03:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.107 14:03:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.107 14:03:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:14.107 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:14.107 14:03:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.107 14:03:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.107 14:03:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.107 14:03:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.107 14:03:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:14.107 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:14.107 14:03:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.107 14:03:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:14.107 14:03:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:14.107 14:03:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:14.107 14:03:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:14.107 14:03:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:14.107 14:03:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:14.107 14:03:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:14.107 14:03:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:14.107 14:03:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:14.107 14:03:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:14.107 14:03:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:14.107 14:03:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:14.107 14:03:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:14.107 14:03:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:14.107 14:03:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:14.107 14:03:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:14.365 14:03:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:14.365 14:03:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:14.365 14:03:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:14.365 14:03:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:14.365 14:03:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:14.365 14:03:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:14.365 14:03:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:14.365 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:14.365 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:30:14.365 00:30:14.365 --- 10.0.0.2 ping statistics --- 00:30:14.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.365 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:30:14.365 14:03:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:14.365 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:14.365 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:30:14.365 00:30:14.365 --- 10.0.0.1 ping statistics --- 00:30:14.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.365 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:30:14.365 14:03:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:14.365 14:03:54 -- nvmf/common.sh@410 -- # return 0 00:30:14.365 14:03:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:14.365 14:03:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:14.365 14:03:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:14.365 14:03:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:14.365 14:03:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:14.365 14:03:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:14.365 14:03:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:14.365 14:03:54 -- host/bdevperf.sh@25 -- # tgt_init 00:30:14.365 14:03:54 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:14.365 14:03:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:14.365 14:03:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:14.365 14:03:54 -- common/autotest_common.sh@10 -- # set +x 00:30:14.365 14:03:54 -- nvmf/common.sh@469 -- # nvmfpid=2428322 00:30:14.365 14:03:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:14.365 14:03:54 -- nvmf/common.sh@470 -- # waitforlisten 2428322 00:30:14.365 14:03:54 -- common/autotest_common.sh@829 -- # '[' -z 2428322 ']' 00:30:14.365 14:03:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:14.365 14:03:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:14.365 14:03:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:14.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:14.365 14:03:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:14.365 14:03:54 -- common/autotest_common.sh@10 -- # set +x 00:30:14.365 [2024-11-29 14:03:54.545917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:14.365 [2024-11-29 14:03:54.545996] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:14.365 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.365 [2024-11-29 14:03:54.615270] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:14.623 [2024-11-29 14:03:54.706316] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:14.623 [2024-11-29 14:03:54.706506] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:14.623 [2024-11-29 14:03:54.706528] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:14.623 [2024-11-29 14:03:54.706543] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:14.623 [2024-11-29 14:03:54.706614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:14.623 [2024-11-29 14:03:54.706729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:14.623 [2024-11-29 14:03:54.706733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:15.555 14:03:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:15.555 14:03:55 -- common/autotest_common.sh@862 -- # return 0 00:30:15.555 14:03:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:15.555 14:03:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 14:03:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:15.555 14:03:55 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:15.555 14:03:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 [2024-11-29 14:03:55.528247] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:15.555 14:03:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.555 14:03:55 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:15.555 14:03:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 Malloc0 00:30:15.555 14:03:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.555 14:03:55 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:15.555 14:03:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 14:03:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.555 14:03:55 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:15.555 14:03:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 14:03:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.555 14:03:55 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:15.555 14:03:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.555 14:03:55 -- common/autotest_common.sh@10 -- # set +x 00:30:15.555 [2024-11-29 14:03:55.588009] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:15.555 14:03:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.555 14:03:55 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:15.555 14:03:55 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:15.555 14:03:55 -- nvmf/common.sh@520 -- # config=() 00:30:15.555 14:03:55 -- nvmf/common.sh@520 -- # local subsystem config 00:30:15.555 14:03:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:15.555 14:03:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:15.555 { 00:30:15.555 "params": { 00:30:15.555 "name": "Nvme$subsystem", 00:30:15.555 "trtype": "$TEST_TRANSPORT", 00:30:15.555 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:15.555 "adrfam": "ipv4", 00:30:15.555 "trsvcid": "$NVMF_PORT", 00:30:15.555 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:15.555 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:15.555 "hdgst": ${hdgst:-false}, 00:30:15.555 "ddgst": ${ddgst:-false} 00:30:15.555 }, 00:30:15.555 "method": "bdev_nvme_attach_controller" 00:30:15.555 } 00:30:15.555 EOF 00:30:15.555 )") 00:30:15.555 14:03:55 -- nvmf/common.sh@542 -- # cat 00:30:15.555 14:03:55 -- nvmf/common.sh@544 -- # jq . 00:30:15.555 14:03:55 -- nvmf/common.sh@545 -- # IFS=, 00:30:15.555 14:03:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:15.555 "params": { 00:30:15.555 "name": "Nvme1", 00:30:15.555 "trtype": "tcp", 00:30:15.555 "traddr": "10.0.0.2", 00:30:15.555 "adrfam": "ipv4", 00:30:15.555 "trsvcid": "4420", 00:30:15.555 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:15.555 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:15.555 "hdgst": false, 00:30:15.555 "ddgst": false 00:30:15.555 }, 00:30:15.555 "method": "bdev_nvme_attach_controller" 00:30:15.555 }' 00:30:15.555 [2024-11-29 14:03:55.629964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:15.555 [2024-11-29 14:03:55.630038] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2428482 ] 00:30:15.555 EAL: No free 2048 kB hugepages reported on node 1 00:30:15.555 [2024-11-29 14:03:55.691474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:15.555 [2024-11-29 14:03:55.779619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:15.812 Running I/O for 1 seconds... 00:30:16.745 00:30:16.745 Latency(us) 00:30:16.745 [2024-11-29T13:03:57.027Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.745 [2024-11-29T13:03:57.027Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:16.745 Verification LBA range: start 0x0 length 0x4000 00:30:16.745 Nvme1n1 : 1.01 12757.02 49.83 0.00 0.00 9986.67 1432.08 17476.27 00:30:16.745 [2024-11-29T13:03:57.027Z] =================================================================================================================== 00:30:16.745 [2024-11-29T13:03:57.027Z] Total : 12757.02 49.83 0.00 0.00 9986.67 1432.08 17476.27 00:30:17.003 14:03:57 -- host/bdevperf.sh@30 -- # bdevperfpid=2428629 00:30:17.003 14:03:57 -- host/bdevperf.sh@32 -- # sleep 3 00:30:17.003 14:03:57 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:17.003 14:03:57 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:17.003 14:03:57 -- nvmf/common.sh@520 -- # config=() 00:30:17.003 14:03:57 -- nvmf/common.sh@520 -- # local subsystem config 00:30:17.003 14:03:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:17.003 14:03:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:17.003 { 00:30:17.003 "params": { 00:30:17.003 "name": "Nvme$subsystem", 00:30:17.003 "trtype": "$TEST_TRANSPORT", 00:30:17.003 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:17.003 "adrfam": "ipv4", 00:30:17.003 "trsvcid": "$NVMF_PORT", 00:30:17.003 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:17.003 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:17.003 "hdgst": ${hdgst:-false}, 00:30:17.003 "ddgst": ${ddgst:-false} 00:30:17.003 }, 00:30:17.003 "method": "bdev_nvme_attach_controller" 00:30:17.003 } 00:30:17.003 EOF 00:30:17.003 )") 00:30:17.003 14:03:57 -- nvmf/common.sh@542 -- # cat 00:30:17.003 14:03:57 -- nvmf/common.sh@544 -- # jq . 00:30:17.003 14:03:57 -- nvmf/common.sh@545 -- # IFS=, 00:30:17.003 14:03:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:17.003 "params": { 00:30:17.003 "name": "Nvme1", 00:30:17.003 "trtype": "tcp", 00:30:17.003 "traddr": "10.0.0.2", 00:30:17.003 "adrfam": "ipv4", 00:30:17.003 "trsvcid": "4420", 00:30:17.003 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:17.003 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:17.003 "hdgst": false, 00:30:17.003 "ddgst": false 00:30:17.003 }, 00:30:17.003 "method": "bdev_nvme_attach_controller" 00:30:17.003 }' 00:30:17.004 [2024-11-29 14:03:57.214666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:17.004 [2024-11-29 14:03:57.214754] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2428629 ] 00:30:17.004 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.004 [2024-11-29 14:03:57.278670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:17.261 [2024-11-29 14:03:57.363215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:17.261 Running I/O for 15 seconds... 00:30:20.544 14:04:00 -- host/bdevperf.sh@33 -- # kill -9 2428322 00:30:20.544 14:04:00 -- host/bdevperf.sh@35 -- # sleep 3 00:30:20.544 [2024-11-29 14:04:00.189528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.544 [2024-11-29 14:04:00.189610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:6184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.544 [2024-11-29 14:04:00.189656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.544 [2024-11-29 14:04:00.189690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.544 [2024-11-29 14:04:00.189723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.544 [2024-11-29 14:04:00.189771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.544 [2024-11-29 14:04:00.189785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.189831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.189864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.189911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.189942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.189971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.189986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:6296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:6304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:6312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:6320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:6344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:6376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:6384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:6400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:6416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:6432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.545 [2024-11-29 14:04:00.190953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:6440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.190979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.190992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:6448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.191005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.545 [2024-11-29 14:04:00.191018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:6456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.545 [2024-11-29 14:04:00.191030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:6464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:6520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:6528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:6536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:6568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:6576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:6592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:6608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:6616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:6624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.191952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.191978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.191992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:6648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.192005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:6656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.192032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.192063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.192089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:6680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.192116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:6688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.546 [2024-11-29 14:04:00.192142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.192183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:6704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.546 [2024-11-29 14:04:00.192210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.546 [2024-11-29 14:04:00.192239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:6712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.192251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.192275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:6728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.192300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.192867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.192892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:6768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.192960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.192990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:6776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:6792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:6808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:6824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:6832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:6840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:6864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:20.547 [2024-11-29 14:04:00.193333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.547 [2024-11-29 14:04:00.193466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.547 [2024-11-29 14:04:00.193481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.548 [2024-11-29 14:04:00.193494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.548 [2024-11-29 14:04:00.193510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.548 [2024-11-29 14:04:00.193533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.548 [2024-11-29 14:04:00.193547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.548 [2024-11-29 14:04:00.193561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.548 [2024-11-29 14:04:00.193575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1155900 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.193598] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:20.548 [2024-11-29 14:04:00.193609] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:20.548 [2024-11-29 14:04:00.193621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6288 len:8 PRP1 0x0 PRP2 0x0 00:30:20.548 [2024-11-29 14:04:00.193638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:20.548 [2024-11-29 14:04:00.193722] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1155900 was disconnected and freed. reset controller. 00:30:20.548 [2024-11-29 14:04:00.195746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.195824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.196448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.196591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.196618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.196634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.196804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.196946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.196965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.196981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.199605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.208491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.208803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.208947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.208974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.208990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.209212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.209409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.209443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.209457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.211768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.220973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.221359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.221522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.221552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.221570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.221753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.221959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.221989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.222005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.224262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.233621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.234063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.234231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.234260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.234278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.234511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.234645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.234668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.234684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.237059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.246252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.246624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.246800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.246829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.246847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.247011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.247163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.247186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.247202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.249516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.258897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.259195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.259365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.259405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.259426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.259627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.259814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.259837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.259859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.262182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.271414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.271717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.271949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.271978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.271996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.272160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.272330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.272353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.272369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.274665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.548 [2024-11-29 14:04:00.283814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.548 [2024-11-29 14:04:00.284146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.284283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-29 14:04:00.284308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.548 [2024-11-29 14:04:00.284323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.548 [2024-11-29 14:04:00.284479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.548 [2024-11-29 14:04:00.284568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.548 [2024-11-29 14:04:00.284588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.548 [2024-11-29 14:04:00.284602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.548 [2024-11-29 14:04:00.286969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.296439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.296686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.296842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.296869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.296885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.297032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.297191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.297210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.297222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.299514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.309072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.309324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.309465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.309494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.309511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.309658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.309882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.309905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.309921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.312066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.321706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.322124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.322239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.322267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.322284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.322426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.322613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.322637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.322653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.324908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.334223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.334651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.334809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.334835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.334851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.335015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.335200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.335219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.335231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.337523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.346775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.347098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.347237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.347265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.347283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.347424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.347612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.347635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.347650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.349879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.359511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.359923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.360036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.360063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.360080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.360244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.360437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.360463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.360478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.362980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.372228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.372646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.372815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-29 14:04:00.372842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.549 [2024-11-29 14:04:00.372858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.549 [2024-11-29 14:04:00.373004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.549 [2024-11-29 14:04:00.373206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.549 [2024-11-29 14:04:00.373225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.549 [2024-11-29 14:04:00.373238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.549 [2024-11-29 14:04:00.375708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.549 [2024-11-29 14:04:00.384753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.549 [2024-11-29 14:04:00.385075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.385241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.385271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.385289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.385466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.385618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.385642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.385657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.388316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.397385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.397711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.397892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.397918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.397934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.398096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.398269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.398288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.398300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.400690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.410076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.410408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.410539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.410564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.410580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.410728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.410916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.410934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.410947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.413284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.422639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.423059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.423220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.423255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.423274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.423456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.423608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.423632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.423647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.426237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.435282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.435587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.435805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.435867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.435885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.436067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.436219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.436242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.436257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.438601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.447879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.448179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.448343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.448373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.448390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.448568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.448774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.448797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.448813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.451086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.460353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.460610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.460727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.460753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.460775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.460924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.461131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.461151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.461163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.463340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.472828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.473190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.473377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.473412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.473430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.473562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.473770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.473789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.473802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.476088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.485456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.485830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.485998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.486027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.486045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.486211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.550 [2024-11-29 14:04:00.486379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.550 [2024-11-29 14:04:00.486414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.550 [2024-11-29 14:04:00.486431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.550 [2024-11-29 14:04:00.488768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.550 [2024-11-29 14:04:00.498101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.550 [2024-11-29 14:04:00.498452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.498588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-29 14:04:00.498617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.550 [2024-11-29 14:04:00.498635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.550 [2024-11-29 14:04:00.498733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.498884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.498908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.498923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.501176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.510660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.510932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.511190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.511239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.511257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.511414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.511584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.511607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.511623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.514015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.523269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.523588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.523723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.523751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.523769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.523915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.524084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.524107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.524122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.526506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.535965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.536223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.536386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.536423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.536441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.536588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.536783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.536806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.536822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.539303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.548391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.548685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.548907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.548932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.548948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.549151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.549344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.549362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.549389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.551647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.561039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.561324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.561461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.561491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.561508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.561655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.561841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.561864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.561880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.564092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.573735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.574030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.574226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.574276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.574294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.574470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.574622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.574651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.574667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.577023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.586273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.586560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.586698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.586727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.586744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.586926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.587077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.587101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.587116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.589368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.598913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.599201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.599343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.599373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.599391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.599605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.599775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.599799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.599814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.551 [2024-11-29 14:04:00.602099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.551 [2024-11-29 14:04:00.611489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.551 [2024-11-29 14:04:00.611811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.611951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-29 14:04:00.611980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.551 [2024-11-29 14:04:00.611997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.551 [2024-11-29 14:04:00.612144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.551 [2024-11-29 14:04:00.612331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.551 [2024-11-29 14:04:00.612355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.551 [2024-11-29 14:04:00.612376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.614833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.624100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.624408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.624583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.624611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.624629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.624776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.624928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.624951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.624967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.627233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.636762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.637085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.637219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.637248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.637265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.637440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.637610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.637633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.637649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.639915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.649302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.649573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.649719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.649748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.649765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.649893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.650063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.650086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.650102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.652492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.661915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.662351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.662495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.662524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.662542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.662706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.662893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.662916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.662931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.665287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.674429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.674744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.674903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.674931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.674949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.675149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.675300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.675323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.675338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.677525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.686842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.687166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.687318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.687347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.687364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.687558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.687746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.687769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.687785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.690102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.699642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.699963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.700135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.700163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.700181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.700345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.700482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.700507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.700523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.702960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.712364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.712599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.712771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.712799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.712817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.713000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.713168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.713191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.713207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.715529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.725035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.725312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.725460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.725487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.552 [2024-11-29 14:04:00.725503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.552 [2024-11-29 14:04:00.725619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.552 [2024-11-29 14:04:00.725787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.552 [2024-11-29 14:04:00.725808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.552 [2024-11-29 14:04:00.725822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.552 [2024-11-29 14:04:00.727981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.552 [2024-11-29 14:04:00.737601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.552 [2024-11-29 14:04:00.737958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.738156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-29 14:04:00.738199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.738217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.738363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.738517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.738540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.738553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.740979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.750231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.750573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.750714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.750740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.750756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.750899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.751070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.751093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.751108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.753339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.762651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.763007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.763193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.763222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.763240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.763451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.763639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.763663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.763678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.765963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.775203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.775523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.775643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.775678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.775696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.775860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.776012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.776036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.776051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.778246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.787918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.788276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.788438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.788468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.788486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.788650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.788837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.788861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.788876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.791180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.800375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.800789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.800963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.801018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.801036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.801254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.801452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.801476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.801491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.803969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-29 14:04:00.813090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-29 14:04:00.813471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.813585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-29 14:04:00.813614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-29 14:04:00.813637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.553 [2024-11-29 14:04:00.813821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.553 [2024-11-29 14:04:00.813954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-29 14:04:00.813977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-29 14:04:00.813993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-29 14:04:00.816265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.825662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.825952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.826112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.826138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.826153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.826368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.826533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.826553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.826567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.828752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.838167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.838509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.838666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.838712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.838730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.838894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.839045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.839068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.839084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.841551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.850683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.850968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.851107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.851136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.851153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.851341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.851484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.851509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.851525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.853897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.863055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.863351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.863489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.863519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.863536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.863719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.863887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.863911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.863927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.866300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.875679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.875995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.876132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.876161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.876178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.876378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.876580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.876604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.876619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.878974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.888238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.888464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.888604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.888633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.888650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.888833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.889044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.889068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.889083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.891427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.900737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.901048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.901209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.901237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.901255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.901467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.901620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.901643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.901658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.903850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.913166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.913489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.913600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.913627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.813 [2024-11-29 14:04:00.913644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.813 [2024-11-29 14:04:00.913827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.813 [2024-11-29 14:04:00.914014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.813 [2024-11-29 14:04:00.914037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.813 [2024-11-29 14:04:00.914052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.813 [2024-11-29 14:04:00.916286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.813 [2024-11-29 14:04:00.925751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.813 [2024-11-29 14:04:00.926053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.926222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.813 [2024-11-29 14:04:00.926250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.926267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.926378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.926558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.926587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.926603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.928976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:00.938194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:00.938488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.938636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.938661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.938677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.938877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.939029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.939052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.939066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.941501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:00.950888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:00.951266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.951420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.951450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.951468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.951651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.951892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.951916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.951931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.954186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:00.963452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:00.963737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.963876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.963904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.963922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.964087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.964220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.964243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.964264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.966612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:00.975897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:00.976196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.976339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.976367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.976384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.976559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.976764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.976787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.976802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.978938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:00.988377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:00.988707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.988864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:00.988911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:00.988929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:00.989146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:00.989316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:00.989339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:00.989354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:00.991702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:01.001004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:01.001315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.001480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.001510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:01.001528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:01.001711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:01.001845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:01.001868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:01.001883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:01.004047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:01.013589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:01.013956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.014118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.014146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:01.014162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:01.014309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:01.014539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:01.014564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:01.014579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:01.016824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:01.026132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:01.026452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.026656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.026685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:01.026703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:01.026850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.814 [2024-11-29 14:04:01.027001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.814 [2024-11-29 14:04:01.027023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.814 [2024-11-29 14:04:01.027038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.814 [2024-11-29 14:04:01.029528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.814 [2024-11-29 14:04:01.038741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.814 [2024-11-29 14:04:01.039094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.039199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.814 [2024-11-29 14:04:01.039226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.814 [2024-11-29 14:04:01.039242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.814 [2024-11-29 14:04:01.039372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.815 [2024-11-29 14:04:01.039534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.815 [2024-11-29 14:04:01.039558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.815 [2024-11-29 14:04:01.039574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.815 [2024-11-29 14:04:01.041982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.815 [2024-11-29 14:04:01.051310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.815 [2024-11-29 14:04:01.051598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.051728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.051774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.815 [2024-11-29 14:04:01.051792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.815 [2024-11-29 14:04:01.051921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.815 [2024-11-29 14:04:01.052126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.815 [2024-11-29 14:04:01.052149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.815 [2024-11-29 14:04:01.052164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.815 [2024-11-29 14:04:01.054501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.815 [2024-11-29 14:04:01.064081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.815 [2024-11-29 14:04:01.064387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.064535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.064564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.815 [2024-11-29 14:04:01.064582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.815 [2024-11-29 14:04:01.064729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.815 [2024-11-29 14:04:01.064898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.815 [2024-11-29 14:04:01.064921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.815 [2024-11-29 14:04:01.064937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.815 [2024-11-29 14:04:01.067403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.815 [2024-11-29 14:04:01.076638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.815 [2024-11-29 14:04:01.076942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.077080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.077109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.815 [2024-11-29 14:04:01.077127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.815 [2024-11-29 14:04:01.077274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.815 [2024-11-29 14:04:01.077490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.815 [2024-11-29 14:04:01.077514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.815 [2024-11-29 14:04:01.077530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.815 [2024-11-29 14:04:01.079865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.815 [2024-11-29 14:04:01.089252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.815 [2024-11-29 14:04:01.089601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.089736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.815 [2024-11-29 14:04:01.089765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:20.815 [2024-11-29 14:04:01.089783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:20.815 [2024-11-29 14:04:01.089965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:20.815 [2024-11-29 14:04:01.090098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.815 [2024-11-29 14:04:01.090121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.815 [2024-11-29 14:04:01.090137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.815 [2024-11-29 14:04:01.092440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.074 [2024-11-29 14:04:01.101763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.074 [2024-11-29 14:04:01.102101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.074 [2024-11-29 14:04:01.102254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.074 [2024-11-29 14:04:01.102285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.074 [2024-11-29 14:04:01.102303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.074 [2024-11-29 14:04:01.102423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.074 [2024-11-29 14:04:01.102646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.074 [2024-11-29 14:04:01.102670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.074 [2024-11-29 14:04:01.102685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.074 [2024-11-29 14:04:01.105020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.074 [2024-11-29 14:04:01.114427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.074 [2024-11-29 14:04:01.114753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.074 [2024-11-29 14:04:01.114941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.074 [2024-11-29 14:04:01.114994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.074 [2024-11-29 14:04:01.115012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.074 [2024-11-29 14:04:01.115177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.074 [2024-11-29 14:04:01.115382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.074 [2024-11-29 14:04:01.115417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.074 [2024-11-29 14:04:01.115432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.074 [2024-11-29 14:04:01.117625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.074 [2024-11-29 14:04:01.127109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.074 [2024-11-29 14:04:01.127432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.127574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.127612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.127631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.127814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.128037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.128061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.128076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.130550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.139946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.140226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.140364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.140403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.140423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.140571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.140776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.140800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.140815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.143162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.152358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.152655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.152875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.152931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.152949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.153078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.153247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.153271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.153285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.155516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.164800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.165115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.165254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.165282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.165306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.165482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.165652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.165675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.165690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.167846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.177484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.177803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.177945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.177973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.177991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.178174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.178307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.178330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.178345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.180744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.190069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.190400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.190531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.190561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.190579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.190780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.190984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.191007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.191022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.193435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.202417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.202729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.202880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.202906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.202922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.203073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.203219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.203243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.203259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.205537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.215059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.215364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.215485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.075 [2024-11-29 14:04:01.215514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.075 [2024-11-29 14:04:01.215532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.075 [2024-11-29 14:04:01.215715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.075 [2024-11-29 14:04:01.215884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.075 [2024-11-29 14:04:01.215907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.075 [2024-11-29 14:04:01.215922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.075 [2024-11-29 14:04:01.218296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.075 [2024-11-29 14:04:01.227625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.075 [2024-11-29 14:04:01.227926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.228066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.228093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.228110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.228239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.228438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.228462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.228478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.230775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.240018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.240344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.240491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.240520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.240537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.240702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.240894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.240917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.240933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.243237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.252495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.252817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.252955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.252983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.253001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.253200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.253351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.253375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.253390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.255634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.264935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.265279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.265387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.265422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.265440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.265587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.265774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.265798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.265812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.268127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.277265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.277636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.277806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.277835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.277853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.278036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.278205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.278234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.278250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.280655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.290035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.290361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.290509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.290538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.290556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.290720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.290924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.290948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.290963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.293316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.302582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.302947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.303129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.303185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.303203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.303367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.303584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.303608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.303623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.305908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.315148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.315500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.315708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.315737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.315754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.315918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.316087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.316110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.316132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.318462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.327849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.328147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.328289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.328317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.328334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.076 [2024-11-29 14:04:01.328511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.076 [2024-11-29 14:04:01.328663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.076 [2024-11-29 14:04:01.328686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.076 [2024-11-29 14:04:01.328702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.076 [2024-11-29 14:04:01.330878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.076 [2024-11-29 14:04:01.340542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.076 [2024-11-29 14:04:01.340857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.340968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.076 [2024-11-29 14:04:01.340996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.076 [2024-11-29 14:04:01.341014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.077 [2024-11-29 14:04:01.341160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.077 [2024-11-29 14:04:01.341311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.077 [2024-11-29 14:04:01.341334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.077 [2024-11-29 14:04:01.341350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.077 [2024-11-29 14:04:01.343698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.077 [2024-11-29 14:04:01.353222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.077 [2024-11-29 14:04:01.353510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.077 [2024-11-29 14:04:01.353676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.077 [2024-11-29 14:04:01.353704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.077 [2024-11-29 14:04:01.353722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.077 [2024-11-29 14:04:01.353904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.077 [2024-11-29 14:04:01.354092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.077 [2024-11-29 14:04:01.354115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.077 [2024-11-29 14:04:01.354131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.335 [2024-11-29 14:04:01.356414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.335 [2024-11-29 14:04:01.365699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.335 [2024-11-29 14:04:01.366001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.335 [2024-11-29 14:04:01.366136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.335 [2024-11-29 14:04:01.366164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.335 [2024-11-29 14:04:01.366181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.335 [2024-11-29 14:04:01.366345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.335 [2024-11-29 14:04:01.366561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.366586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.366601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.369077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.378288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.378643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.378812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.378840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.378857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.379040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.379191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.379215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.379230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.381665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.390945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.391252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.391417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.391447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.391465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.391630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.391762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.391786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.391801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.394338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.403466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.403789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.403964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.404014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.404031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.404214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.404412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.404437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.404452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.406643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.415945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.416285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.416420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.416450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.416477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.416644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.416831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.416854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.416869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.419206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.428624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.428906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.429047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.429076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.429093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.429204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.429391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.429426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.429441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.431654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.441186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.441530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.441683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.441717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.441753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.441882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.442051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.442074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.442089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.444301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.453646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.453921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.454039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.454067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.454085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.454268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.454450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.454475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.454491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.456749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.466304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.466625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.466763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.466792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.466809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.466974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.467169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.467189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.467202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.469574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.336 [2024-11-29 14:04:01.478865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.336 [2024-11-29 14:04:01.479187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.479295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.336 [2024-11-29 14:04:01.479325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.336 [2024-11-29 14:04:01.479342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.336 [2024-11-29 14:04:01.479503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.336 [2024-11-29 14:04:01.479674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.336 [2024-11-29 14:04:01.479694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.336 [2024-11-29 14:04:01.479708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.336 [2024-11-29 14:04:01.482078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.491447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.491717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.491854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.491883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.491900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.492046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.492233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.492256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.492272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.494631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.503916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.504202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.504333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.504374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.504390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.504518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.504688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.504712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.504727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.507065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.516471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.516771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.516890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.516920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.516944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.517075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.517261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.517284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.517300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.519524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.528973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.529298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.529453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.529480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.529496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.529663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.529884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.529908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.529923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.532261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.541479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.541755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.541867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.541897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.541915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.542080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.542285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.542308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.542323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.544401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.553780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.554109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.554286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.554311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.554327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.554509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.554625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.554648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.554663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.557091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.566354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.566699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.566891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.566937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.566955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.567119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.567288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.567311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.567326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.569656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.578828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.579095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.579201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.579229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.579246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.579422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.579609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.579633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.579648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.581806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.591376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.591745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.591885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.591931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.337 [2024-11-29 14:04:01.591949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.337 [2024-11-29 14:04:01.592114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.337 [2024-11-29 14:04:01.592288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.337 [2024-11-29 14:04:01.592311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.337 [2024-11-29 14:04:01.592327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.337 [2024-11-29 14:04:01.594855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.337 [2024-11-29 14:04:01.603983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.337 [2024-11-29 14:04:01.604294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.604435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.337 [2024-11-29 14:04:01.604461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.338 [2024-11-29 14:04:01.604477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.338 [2024-11-29 14:04:01.604656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.338 [2024-11-29 14:04:01.604842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.338 [2024-11-29 14:04:01.604866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.338 [2024-11-29 14:04:01.604881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.338 [2024-11-29 14:04:01.607164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.616631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.616953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.617117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.617146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.617163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.617310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.617508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.617532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.617548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.620032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.629280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.629566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.629701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.629729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.629746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.629857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.630026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.630055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.630071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.632267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.641756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.642113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.642276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.642304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.642321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.642443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.642613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.642636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.642651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.645043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.654295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.654670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.654770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.654796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.654812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.654957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.655102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.655126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.655141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.657578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.666929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.667275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.667429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.667459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.667476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.667605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.667755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.667779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.667800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.670138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.679679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.679994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.680157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.680186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.680203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.680332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.680494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.680518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.680534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.682871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.692060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.692409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.692552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.692581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.692598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.692745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.692932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.692955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.692970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.695146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.704686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.705044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.705169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.705197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.705215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.705344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.705526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.705552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.596 [2024-11-29 14:04:01.705569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.596 [2024-11-29 14:04:01.707964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.596 [2024-11-29 14:04:01.717109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.596 [2024-11-29 14:04:01.717461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.717641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.596 [2024-11-29 14:04:01.717668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.596 [2024-11-29 14:04:01.717684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.596 [2024-11-29 14:04:01.717849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.596 [2024-11-29 14:04:01.718026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.596 [2024-11-29 14:04:01.718047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.718061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.720488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.729357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.729658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.729787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.729811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.729827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.730005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.730194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.730218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.730233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.732560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.741994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.742282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.742426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.742455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.742472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.742619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.742834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.742858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.742872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.745214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.754610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.754906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.755037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.755066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.755083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.755248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.755463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.755487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.755503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.757964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.766972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.767308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.767428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.767456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.767472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.767596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.767765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.767788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.767803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.770426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.779653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.779943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.780094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.780121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.780137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.780310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.780517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.780541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.780557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.782768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.792165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.792550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.792735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.792780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.792797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.792944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.793077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.793100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.793115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.795312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.804845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.805145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.805291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.805318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.805336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.805495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.805664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.805688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.805703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.807938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.817474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.817813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.817977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.818006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.818024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.818134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.818339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.818363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.818379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.820887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.829915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.597 [2024-11-29 14:04:01.830299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.830416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.597 [2024-11-29 14:04:01.830454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.597 [2024-11-29 14:04:01.830473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.597 [2024-11-29 14:04:01.830674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.597 [2024-11-29 14:04:01.830860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.597 [2024-11-29 14:04:01.830884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.597 [2024-11-29 14:04:01.830899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.597 [2024-11-29 14:04:01.833185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.597 [2024-11-29 14:04:01.842600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.598 [2024-11-29 14:04:01.842924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.843084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.843131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.598 [2024-11-29 14:04:01.843149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.598 [2024-11-29 14:04:01.843314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.598 [2024-11-29 14:04:01.843511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.598 [2024-11-29 14:04:01.843535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.598 [2024-11-29 14:04:01.843549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.598 [2024-11-29 14:04:01.845962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.598 [2024-11-29 14:04:01.855171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.598 [2024-11-29 14:04:01.855489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.855667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.855696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.598 [2024-11-29 14:04:01.855713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.598 [2024-11-29 14:04:01.855860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.598 [2024-11-29 14:04:01.856047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.598 [2024-11-29 14:04:01.856071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.598 [2024-11-29 14:04:01.856086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.598 [2024-11-29 14:04:01.858435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.598 [2024-11-29 14:04:01.867769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.598 [2024-11-29 14:04:01.868070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.868210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.598 [2024-11-29 14:04:01.868239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.598 [2024-11-29 14:04:01.868262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.598 [2024-11-29 14:04:01.868475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.598 [2024-11-29 14:04:01.868609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.598 [2024-11-29 14:04:01.868633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.598 [2024-11-29 14:04:01.868648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.598 [2024-11-29 14:04:01.870954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.856 [2024-11-29 14:04:01.880235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.856 [2024-11-29 14:04:01.880546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.880696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.880725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.856 [2024-11-29 14:04:01.880743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.856 [2024-11-29 14:04:01.880925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.856 [2024-11-29 14:04:01.881113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.856 [2024-11-29 14:04:01.881136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.856 [2024-11-29 14:04:01.881151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.856 [2024-11-29 14:04:01.883369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.856 [2024-11-29 14:04:01.892932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.856 [2024-11-29 14:04:01.893223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.893361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.893390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.856 [2024-11-29 14:04:01.893419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.856 [2024-11-29 14:04:01.893566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.856 [2024-11-29 14:04:01.893718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.856 [2024-11-29 14:04:01.893741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.856 [2024-11-29 14:04:01.893756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.856 [2024-11-29 14:04:01.896308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.856 [2024-11-29 14:04:01.905292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.856 [2024-11-29 14:04:01.905634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.905771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.905799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.856 [2024-11-29 14:04:01.905817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.856 [2024-11-29 14:04:01.905988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.856 [2024-11-29 14:04:01.906211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.856 [2024-11-29 14:04:01.906234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.856 [2024-11-29 14:04:01.906249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.856 [2024-11-29 14:04:01.908508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.856 [2024-11-29 14:04:01.917787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.856 [2024-11-29 14:04:01.918070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.918211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.918240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.856 [2024-11-29 14:04:01.918258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.856 [2024-11-29 14:04:01.918453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.856 [2024-11-29 14:04:01.918658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.856 [2024-11-29 14:04:01.918682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.856 [2024-11-29 14:04:01.918697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.856 [2024-11-29 14:04:01.921071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.856 [2024-11-29 14:04:01.930333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.856 [2024-11-29 14:04:01.930667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.930865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.856 [2024-11-29 14:04:01.930912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.856 [2024-11-29 14:04:01.930930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.856 [2024-11-29 14:04:01.931113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.856 [2024-11-29 14:04:01.931299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.856 [2024-11-29 14:04:01.931323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.856 [2024-11-29 14:04:01.931338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.856 [2024-11-29 14:04:01.933653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:01.942974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:01.943272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.943383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.943420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:01.943438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:01.943620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:01.943796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:01.943819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:01.943834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:01.946082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:01.955563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:01.955891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.956091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.956117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:01.956133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:01.956293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:01.956515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:01.956536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:01.956550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:01.958854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:01.968123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:01.968470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.968602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.968647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:01.968663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:01.968809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:01.968951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:01.968974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:01.968989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:01.971384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:01.980580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:01.980941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.981067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.981095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:01.981113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:01.981278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:01.981420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:01.981452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:01.981469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:01.983750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:01.993166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:01.993537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.993673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:01.993699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:01.993714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:01.993887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:01.994056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:01.994079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:01.994094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:01.996215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:02.005767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:02.006059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.006199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.006228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:02.006246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:02.006403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:02.006591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:02.006615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:02.006630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:02.008878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:02.018312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:02.018636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.018797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.018848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:02.018866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:02.019048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:02.019199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:02.019223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:02.019244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:02.021592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:02.030746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:02.031064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.031229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.031258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:02.031275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:02.031471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:02.031623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:02.031646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:02.031661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:02.033852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:02.043160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:02.043483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.043638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.043684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.857 [2024-11-29 14:04:02.043702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.857 [2024-11-29 14:04:02.043884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.857 [2024-11-29 14:04:02.044053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.857 [2024-11-29 14:04:02.044076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.857 [2024-11-29 14:04:02.044092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.857 [2024-11-29 14:04:02.046526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.857 [2024-11-29 14:04:02.055732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.857 [2024-11-29 14:04:02.056008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.857 [2024-11-29 14:04:02.056146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.056176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.056193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.056375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.056520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.056543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.056558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.058839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.068288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.068627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.068819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.068860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.068878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.069096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.069282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.069305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.069321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.071648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.080803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.081107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.081256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.081285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.081302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.081497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.081667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.081690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.081705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.084096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.093528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.093884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.094049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.094094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.094112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.094241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.094420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.094445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.094460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.096832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.105996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.106349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.106480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.106507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.106522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.106654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.106855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.106879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.106894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.109125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.118586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.118846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.119012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.119040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.119058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.119240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.119474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.119499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.119514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.121796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.858 [2024-11-29 14:04:02.131082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.858 [2024-11-29 14:04:02.131445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.131640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.858 [2024-11-29 14:04:02.131669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:21.858 [2024-11-29 14:04:02.131687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:21.858 [2024-11-29 14:04:02.131851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:21.858 [2024-11-29 14:04:02.132020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.858 [2024-11-29 14:04:02.132044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.858 [2024-11-29 14:04:02.132059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.858 [2024-11-29 14:04:02.134463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.117 [2024-11-29 14:04:02.143497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.117 [2024-11-29 14:04:02.143845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.143986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.144032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.117 [2024-11-29 14:04:02.144050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.117 [2024-11-29 14:04:02.144215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.117 [2024-11-29 14:04:02.144413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.117 [2024-11-29 14:04:02.144439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.117 [2024-11-29 14:04:02.144463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.117 [2024-11-29 14:04:02.146930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.117 [2024-11-29 14:04:02.156065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.117 [2024-11-29 14:04:02.156402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.156605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.156654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.117 [2024-11-29 14:04:02.156672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.117 [2024-11-29 14:04:02.156872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.117 [2024-11-29 14:04:02.157024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.117 [2024-11-29 14:04:02.157047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.117 [2024-11-29 14:04:02.157062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.117 [2024-11-29 14:04:02.159383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.117 [2024-11-29 14:04:02.168628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.117 [2024-11-29 14:04:02.168976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.169103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.169132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.117 [2024-11-29 14:04:02.169150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.117 [2024-11-29 14:04:02.169314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.117 [2024-11-29 14:04:02.169496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.117 [2024-11-29 14:04:02.169520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.117 [2024-11-29 14:04:02.169535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.117 [2024-11-29 14:04:02.171906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.117 [2024-11-29 14:04:02.181204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.117 [2024-11-29 14:04:02.181503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.181620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.181650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.117 [2024-11-29 14:04:02.181667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.117 [2024-11-29 14:04:02.181840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.117 [2024-11-29 14:04:02.182010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.117 [2024-11-29 14:04:02.182034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.117 [2024-11-29 14:04:02.182049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.117 [2024-11-29 14:04:02.184283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.117 [2024-11-29 14:04:02.193721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.117 [2024-11-29 14:04:02.194052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.117 [2024-11-29 14:04:02.194224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.194242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.194438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.194589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.194613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.194628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.196838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.206167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.206501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.206627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.206653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.206670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.206822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.207045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.207069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.207084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.209170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.218743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.219046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.219181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.219206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.219227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.219371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.219569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.219593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.219609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.221998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.231265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.231557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.231723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.231751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.231769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.231934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.232084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.232108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.232123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.234526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.243728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.244155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.244312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.244342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.244359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.244499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.244686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.244709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.244724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.247121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.256148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.256487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.256609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.256635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.256651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.256773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.256962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.256986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.257001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.259210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.268883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.269221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.269331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.269359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.269377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.269532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.269666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.269690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.269705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.272096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.281528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.281932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.282117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.282142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.282158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.282355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.282549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.282574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.282590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.285064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.294027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.294331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.294440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.294482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.294498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.294614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.118 [2024-11-29 14:04:02.294793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.118 [2024-11-29 14:04:02.294817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.118 [2024-11-29 14:04:02.294832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.118 [2024-11-29 14:04:02.297128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.118 [2024-11-29 14:04:02.306336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.118 [2024-11-29 14:04:02.306664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.306777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.118 [2024-11-29 14:04:02.306803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.118 [2024-11-29 14:04:02.306818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.118 [2024-11-29 14:04:02.306967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.307140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.307160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.307172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.309291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.318543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.318896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.319022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.319048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.319064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.319257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.319477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.319499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.319513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.321580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.330890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.331119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.331250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.331276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.331292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.331451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.331601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.331627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.331641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.333752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.343073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.343479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.343609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.343634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.343650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.343782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.343956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.343975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.343988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.346146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.355123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.355398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.355549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.355575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.355591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.355706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.355807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.355827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.355854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.357890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.367321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.367645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.367751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.367776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.367792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.367940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.368085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.368105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.368122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.370057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.379514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.379886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.380014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.380039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.380055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.380201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.380343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.380363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.380390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.382354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.119 [2024-11-29 14:04:02.391876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.119 [2024-11-29 14:04:02.392148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.392321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.119 [2024-11-29 14:04:02.392346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.119 [2024-11-29 14:04:02.392362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.119 [2024-11-29 14:04:02.392502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.119 [2024-11-29 14:04:02.392664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.119 [2024-11-29 14:04:02.392699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.119 [2024-11-29 14:04:02.392712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.119 [2024-11-29 14:04:02.394887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.404444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.404726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.404876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.404902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.404918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.405018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.405223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.405243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.405255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.407209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.416551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.416894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.417018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.417044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.417060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.417241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.417424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.417445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.417458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.419486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.428855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.429130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.429261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.429286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.429302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.429408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.429592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.429613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.429625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.431595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.440896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.441229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.441332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.441360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.441376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.441500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.441696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.441715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.441728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.443615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.452941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.453326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.453457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.453483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.453499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.453648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.453807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.453827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.453839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.455856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.464999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.465344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.465473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.465500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.465517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.465633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.465812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.465832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.465844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.467891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.477224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.477591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.477700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.477726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.379 [2024-11-29 14:04:02.477742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.379 [2024-11-29 14:04:02.477923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.379 [2024-11-29 14:04:02.478099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.379 [2024-11-29 14:04:02.478119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.379 [2024-11-29 14:04:02.478133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.379 [2024-11-29 14:04:02.480107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.379 [2024-11-29 14:04:02.489450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.379 [2024-11-29 14:04:02.489691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.489817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.379 [2024-11-29 14:04:02.489842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.489857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.490023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.490188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.490208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.490221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.492364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.501402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.501721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.501880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.501905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.501921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.502037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.502215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.502235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.502247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.504239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.513583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.513884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.514045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.514071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.514086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.514218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.514404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.514438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.514451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.516440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.525783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.526168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.526300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.526326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.526342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.526546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.526701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.526720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.526733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.528890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.537956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.538277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.538409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.538436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.538452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.538600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.538805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.538824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.538837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.540783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.550091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.550509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.550643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.550670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.550685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.550864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.550989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.551008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.551020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.552947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.562332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.562725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.562881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.562907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.562927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.563093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.563252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.563271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.563283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.565188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.574334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.574694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.574799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.574824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.574840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.574988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.575135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.575154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.575166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.577073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.586578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.586965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.587148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.587174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.587189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.587337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.380 [2024-11-29 14:04:02.587505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.380 [2024-11-29 14:04:02.587525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.380 [2024-11-29 14:04:02.587538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.380 [2024-11-29 14:04:02.589499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.380 [2024-11-29 14:04:02.598805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.380 [2024-11-29 14:04:02.599068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.599234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.380 [2024-11-29 14:04:02.599259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.380 [2024-11-29 14:04:02.599274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.380 [2024-11-29 14:04:02.599470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.381 [2024-11-29 14:04:02.599634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.381 [2024-11-29 14:04:02.599654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.381 [2024-11-29 14:04:02.599667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.381 [2024-11-29 14:04:02.601614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.381 [2024-11-29 14:04:02.611003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.381 [2024-11-29 14:04:02.611325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.611470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.611497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.381 [2024-11-29 14:04:02.611513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.381 [2024-11-29 14:04:02.611692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.381 [2024-11-29 14:04:02.611850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.381 [2024-11-29 14:04:02.611869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.381 [2024-11-29 14:04:02.611882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.381 [2024-11-29 14:04:02.613826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.381 [2024-11-29 14:04:02.622901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.381 [2024-11-29 14:04:02.623167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.623296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.623321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.381 [2024-11-29 14:04:02.623336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.381 [2024-11-29 14:04:02.623480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.381 [2024-11-29 14:04:02.623676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.381 [2024-11-29 14:04:02.623710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.381 [2024-11-29 14:04:02.623723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.381 [2024-11-29 14:04:02.625650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.381 [2024-11-29 14:04:02.634957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.381 [2024-11-29 14:04:02.635253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.635409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.635436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.381 [2024-11-29 14:04:02.635452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.381 [2024-11-29 14:04:02.635648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.381 [2024-11-29 14:04:02.635839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.381 [2024-11-29 14:04:02.635858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.381 [2024-11-29 14:04:02.635871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.381 [2024-11-29 14:04:02.637888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.381 [2024-11-29 14:04:02.647204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.381 [2024-11-29 14:04:02.647538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.647667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.381 [2024-11-29 14:04:02.647692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.381 [2024-11-29 14:04:02.647708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.381 [2024-11-29 14:04:02.647856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.381 [2024-11-29 14:04:02.647988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.381 [2024-11-29 14:04:02.648007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.381 [2024-11-29 14:04:02.648019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.381 [2024-11-29 14:04:02.649938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.641 [2024-11-29 14:04:02.659805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.641 [2024-11-29 14:04:02.660141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.660269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.660296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.641 [2024-11-29 14:04:02.660311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.641 [2024-11-29 14:04:02.660486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.641 [2024-11-29 14:04:02.660637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.641 [2024-11-29 14:04:02.660657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.641 [2024-11-29 14:04:02.660686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.641 [2024-11-29 14:04:02.662704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.641 [2024-11-29 14:04:02.671904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.641 [2024-11-29 14:04:02.672191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.672369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.672402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.641 [2024-11-29 14:04:02.672420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.641 [2024-11-29 14:04:02.672568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.641 [2024-11-29 14:04:02.672744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.641 [2024-11-29 14:04:02.672768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.641 [2024-11-29 14:04:02.672782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.641 [2024-11-29 14:04:02.674696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.641 [2024-11-29 14:04:02.684220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.641 [2024-11-29 14:04:02.684583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.684695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.684722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.641 [2024-11-29 14:04:02.684737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.641 [2024-11-29 14:04:02.684883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.641 [2024-11-29 14:04:02.685027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.641 [2024-11-29 14:04:02.685046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.641 [2024-11-29 14:04:02.685058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.641 [2024-11-29 14:04:02.687045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.641 [2024-11-29 14:04:02.696220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.641 [2024-11-29 14:04:02.696558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.696686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.641 [2024-11-29 14:04:02.696712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.641 [2024-11-29 14:04:02.696728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.641 [2024-11-29 14:04:02.696892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.641 [2024-11-29 14:04:02.697023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.641 [2024-11-29 14:04:02.697057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.641 [2024-11-29 14:04:02.697070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.641 [2024-11-29 14:04:02.698860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.641 [2024-11-29 14:04:02.708333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.708621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.708773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.708799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.708814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.708929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.709112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.709132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.709149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.711110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.720429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.720758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.720881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.720907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.720923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.721087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.721231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.721251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.721264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.723259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.732784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.733104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.733234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.733260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.733277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.733436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.733599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.733620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.733634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.735776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.744956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.745204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.745436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.745463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.745479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.745595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.745808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.745828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.745841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.747953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.757252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.757554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.757654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.757679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.757695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.757875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.758082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.758101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.758114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.759940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.769423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.769719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.769877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.769903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.769918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.770066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.770242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.770261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.770274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.772162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.781708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.782093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.782222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.782249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.782265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.782480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.782640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.782660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.782673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.784672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.794100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.794425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.794568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.794593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.794610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.794775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.794951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.794970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.794983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.796808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.806370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.806668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.806795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.806820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.642 [2024-11-29 14:04:02.806836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.642 [2024-11-29 14:04:02.807016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.642 [2024-11-29 14:04:02.807158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.642 [2024-11-29 14:04:02.807178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.642 [2024-11-29 14:04:02.807190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.642 [2024-11-29 14:04:02.809152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.642 [2024-11-29 14:04:02.818561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.642 [2024-11-29 14:04:02.818993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.819129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.642 [2024-11-29 14:04:02.819155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.819171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.819320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.819491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.819511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.819524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.821364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.830862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.831159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.831257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.831281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.831296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.831479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.831640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.831660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.831688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.833483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.842862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.843152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.843289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.843314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.843329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.843487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.843696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.843716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.843728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.845575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.855189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.855527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.855656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.855683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.855699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.855879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.856035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.856055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.856067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.858088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.867281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.867652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.867817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.867842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.867858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.868032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.868160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.868179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.868192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.870141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.879463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.879840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.879963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.879988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.880004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.880197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.880323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.880342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.880354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.882303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.891595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.891922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.892047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.892072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.892088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.892220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.892338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.892372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.892384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.894288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.903756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.904032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.904165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.904190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.904211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.904344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.904502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.904524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.904537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.906485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.643 [2024-11-29 14:04:02.915986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.643 [2024-11-29 14:04:02.916270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.916406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.643 [2024-11-29 14:04:02.916434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.643 [2024-11-29 14:04:02.916449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.643 [2024-11-29 14:04:02.916566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.643 [2024-11-29 14:04:02.916669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.643 [2024-11-29 14:04:02.916705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.643 [2024-11-29 14:04:02.916718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.643 [2024-11-29 14:04:02.919001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.903 [2024-11-29 14:04:02.928404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.903 [2024-11-29 14:04:02.928660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.928886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.928911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.903 [2024-11-29 14:04:02.928927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.903 [2024-11-29 14:04:02.929123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.903 [2024-11-29 14:04:02.929278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.903 [2024-11-29 14:04:02.929297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.903 [2024-11-29 14:04:02.929310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.903 [2024-11-29 14:04:02.931413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.903 [2024-11-29 14:04:02.940553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.903 [2024-11-29 14:04:02.940880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.940982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.941007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.903 [2024-11-29 14:04:02.941023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.903 [2024-11-29 14:04:02.941145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.903 [2024-11-29 14:04:02.941327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.903 [2024-11-29 14:04:02.941346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.903 [2024-11-29 14:04:02.941358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.903 [2024-11-29 14:04:02.943566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.903 [2024-11-29 14:04:02.952610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.903 [2024-11-29 14:04:02.952914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.953052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.953078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.903 [2024-11-29 14:04:02.953095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.903 [2024-11-29 14:04:02.953290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.903 [2024-11-29 14:04:02.953464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.903 [2024-11-29 14:04:02.953487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.903 [2024-11-29 14:04:02.953500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.903 [2024-11-29 14:04:02.955358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.903 [2024-11-29 14:04:02.964876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.903 [2024-11-29 14:04:02.965150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.965295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.965321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.903 [2024-11-29 14:04:02.965337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.903 [2024-11-29 14:04:02.965510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.903 [2024-11-29 14:04:02.965733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.903 [2024-11-29 14:04:02.965753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.903 [2024-11-29 14:04:02.965766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.903 [2024-11-29 14:04:02.967763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.903 [2024-11-29 14:04:02.976932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.903 [2024-11-29 14:04:02.977162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.977355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.903 [2024-11-29 14:04:02.977381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.903 [2024-11-29 14:04:02.977406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.903 [2024-11-29 14:04:02.977588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:02.977798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:02.977818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:02.977831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:02.979874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:02.989341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:02.989639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:02.989770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:02.989797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:02.989814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:02.990029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:02.990217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:02.990237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:02.990250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:02.992517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.001714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.002030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.002137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.002163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.002179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.002441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.002637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.002658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.002671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.004649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.014001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.014330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.014499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.014526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.014542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.014721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.014878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.014897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.014909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.016778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.026283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.026645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.026772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.026797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.026813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.026990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.027144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.027163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.027175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.029207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.038302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.038574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.038708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.038735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.038750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.038898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.039065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.039084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.039096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.041052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.050614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.050917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.051080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.051106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.051122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.051317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.051465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.051485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.051503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.053371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.062817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.063129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.063286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.063311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.063327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.063484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.063612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.063632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.063644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.065513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.075045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.075400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.075525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.075551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.075567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.075730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.075915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.075934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.075946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.904 [2024-11-29 14:04:03.078007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.904 [2024-11-29 14:04:03.087189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.904 [2024-11-29 14:04:03.087526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.087656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.904 [2024-11-29 14:04:03.087682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.904 [2024-11-29 14:04:03.087698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.904 [2024-11-29 14:04:03.087831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.904 [2024-11-29 14:04:03.088017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.904 [2024-11-29 14:04:03.088036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.904 [2024-11-29 14:04:03.088052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.090043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.099363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.099710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.099864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.099890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.099906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.100067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.100208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.100226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.100238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.102103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.111426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.111766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.111896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.111922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.111938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.112117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.112286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.112305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.112317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.114249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.123540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.123855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.124035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.124060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.124076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.124283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.124447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.124468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.124481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.126610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.135763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.136153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.136268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.136293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.136309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.136512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.136645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.136666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.136694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.138645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.147881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.148199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.148332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.148358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.148373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.148500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.148633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.148653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.148666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.150619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.160075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.160355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.160479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.160505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.160521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.160685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.160847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.160865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.160877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.162771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 [2024-11-29 14:04:03.172117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.905 [2024-11-29 14:04:03.172357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.172543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.905 [2024-11-29 14:04:03.172570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:22.905 [2024-11-29 14:04:03.172585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:22.905 [2024-11-29 14:04:03.172750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:22.905 [2024-11-29 14:04:03.172904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.905 [2024-11-29 14:04:03.172923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.905 [2024-11-29 14:04:03.172935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.905 [2024-11-29 14:04:03.174850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.905 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2428322 Killed "${NVMF_APP[@]}" "$@" 00:30:22.905 14:04:03 -- host/bdevperf.sh@36 -- # tgt_init 00:30:22.905 14:04:03 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:22.905 14:04:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:22.905 14:04:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:22.905 14:04:03 -- common/autotest_common.sh@10 -- # set +x 00:30:23.165 [2024-11-29 14:04:03.184359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.165 [2024-11-29 14:04:03.184668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.165 [2024-11-29 14:04:03.184821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.165 [2024-11-29 14:04:03.184847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.165 [2024-11-29 14:04:03.184863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.165 [2024-11-29 14:04:03.185068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.165 [2024-11-29 14:04:03.185247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.165 [2024-11-29 14:04:03.185267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.165 [2024-11-29 14:04:03.185279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.165 [2024-11-29 14:04:03.187211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.165 14:04:03 -- nvmf/common.sh@469 -- # nvmfpid=2429435 00:30:23.165 14:04:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:23.165 14:04:03 -- nvmf/common.sh@470 -- # waitforlisten 2429435 00:30:23.165 14:04:03 -- common/autotest_common.sh@829 -- # '[' -z 2429435 ']' 00:30:23.165 14:04:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:23.165 14:04:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:23.166 14:04:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:23.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:23.166 14:04:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:23.166 14:04:03 -- common/autotest_common.sh@10 -- # set +x 00:30:23.166 [2024-11-29 14:04:03.196813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.197071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.197188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.197218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.197234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.197406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.197567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.197587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.197600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.199570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.209111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.209416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.209567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.209593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.209609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.209739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.209924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.209943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.209955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.211926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.221288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.221641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.221774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.221800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.221815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.221995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.222149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.222168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.222180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.224292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.233435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.233662] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:23.166 [2024-11-29 14:04:03.233739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.233751] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:23.166 [2024-11-29 14:04:03.233869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.233894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.233910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.234042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.234242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.234260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.234272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.236220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.245804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.246160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.246309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.246335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.246352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.246526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.246747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.246767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.246779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.248800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.258391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.258663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.258837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.258866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.258883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.259012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.259217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.259241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.259256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.261628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 EAL: No free 2048 kB hugepages reported on node 1 00:30:23.166 [2024-11-29 14:04:03.271001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.271386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.271575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.271605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.271622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.271841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.272028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.272052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.272067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.274575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.283590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.283873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.284000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.284026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.284042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.284204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.284399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.166 [2024-11-29 14:04:03.284419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.166 [2024-11-29 14:04:03.284432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.166 [2024-11-29 14:04:03.286529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.166 [2024-11-29 14:04:03.296137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.166 [2024-11-29 14:04:03.296501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.296638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.166 [2024-11-29 14:04:03.296664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.166 [2024-11-29 14:04:03.296680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.166 [2024-11-29 14:04:03.296858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.166 [2024-11-29 14:04:03.297089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.297108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.297121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.299337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.304952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:23.167 [2024-11-29 14:04:03.308776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.309073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.309245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.309271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.309288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.309416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.309581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.309602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.309616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.311781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.321299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.321800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.321954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.321983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.322005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.322160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.322316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.322340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.322359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.324749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.333805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.334083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.334229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.334254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.334271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.334461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.334610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.334630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.334644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.336752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.346294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.346598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.346714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.346739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.346764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.346882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.347015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.347035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.347049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.349266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.358848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.359249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.359416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.359460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.359478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.359615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.359805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.359825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.359842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.362022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.371384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.371747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.371856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.371883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.371901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.372034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.372211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.372231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.372244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.374549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.383949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.384257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.384413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.384456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.384473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.384665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.384848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.384867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.384880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.387076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.395525] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:23.167 [2024-11-29 14:04:03.395644] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:23.167 [2024-11-29 14:04:03.395662] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:23.167 [2024-11-29 14:04:03.395678] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:23.167 [2024-11-29 14:04:03.395766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:23.167 [2024-11-29 14:04:03.395825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:23.167 [2024-11-29 14:04:03.395828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:23.167 [2024-11-29 14:04:03.396399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.396728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.396862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.396888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.167 [2024-11-29 14:04:03.396904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.167 [2024-11-29 14:04:03.397038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.167 [2024-11-29 14:04:03.397217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.167 [2024-11-29 14:04:03.397237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.167 [2024-11-29 14:04:03.397250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.167 [2024-11-29 14:04:03.399496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.167 [2024-11-29 14:04:03.408627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.167 [2024-11-29 14:04:03.409080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.409229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.167 [2024-11-29 14:04:03.409256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.168 [2024-11-29 14:04:03.409276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.168 [2024-11-29 14:04:03.409427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.168 [2024-11-29 14:04:03.409615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.168 [2024-11-29 14:04:03.409638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.168 [2024-11-29 14:04:03.409655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.168 [2024-11-29 14:04:03.411600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.168 [2024-11-29 14:04:03.420871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.168 [2024-11-29 14:04:03.421331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.168 [2024-11-29 14:04:03.421459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.168 [2024-11-29 14:04:03.421487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.168 [2024-11-29 14:04:03.421508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.168 [2024-11-29 14:04:03.421667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.168 [2024-11-29 14:04:03.421898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.168 [2024-11-29 14:04:03.421919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.168 [2024-11-29 14:04:03.421937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.168 [2024-11-29 14:04:03.424154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.168 [2024-11-29 14:04:03.432989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.168 [2024-11-29 14:04:03.433426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.168 [2024-11-29 14:04:03.433597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.168 [2024-11-29 14:04:03.433622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.168 [2024-11-29 14:04:03.433642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.168 [2024-11-29 14:04:03.433842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.168 [2024-11-29 14:04:03.434009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.168 [2024-11-29 14:04:03.434030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.168 [2024-11-29 14:04:03.434047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.168 [2024-11-29 14:04:03.436176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.427 [2024-11-29 14:04:03.445223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.427 [2024-11-29 14:04:03.445615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.427 [2024-11-29 14:04:03.445773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.427 [2024-11-29 14:04:03.445799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.427 [2024-11-29 14:04:03.445819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.427 [2024-11-29 14:04:03.445995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.427 [2024-11-29 14:04:03.446168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.427 [2024-11-29 14:04:03.446190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.427 [2024-11-29 14:04:03.446208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.427 [2024-11-29 14:04:03.448301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.427 [2024-11-29 14:04:03.457658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.427 [2024-11-29 14:04:03.458013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.427 [2024-11-29 14:04:03.458152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.458178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.458197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.458385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.458517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.458539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.458555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.460595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.469875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.470337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.470528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.470555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.470574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.470710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.470896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.470917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.470936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.473113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.482306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.482585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.482701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.482726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.482743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.482910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.483135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.483155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.483168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.485224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.494610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.494928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.495077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.495104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.495120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.495269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.495446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.495482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.495495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.497494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.506970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.507275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.507380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.507413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.507430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.507547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.507716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.507751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.507766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.509908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.519295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.519552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.519654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.519679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.519695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.519876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.520040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.520060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.520073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.522128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.531599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.531930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.532087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.532117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.532134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.532363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.532519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.532540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.532553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.534557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.543895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.544166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.544271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.544297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.544313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.544487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.544657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.544695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.544708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.546746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.556044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.556318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.556425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.556451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.428 [2024-11-29 14:04:03.556467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.428 [2024-11-29 14:04:03.556583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.428 [2024-11-29 14:04:03.556750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.428 [2024-11-29 14:04:03.556785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.428 [2024-11-29 14:04:03.556798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.428 [2024-11-29 14:04:03.558752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.428 [2024-11-29 14:04:03.568383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.428 [2024-11-29 14:04:03.568685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.568838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.428 [2024-11-29 14:04:03.568864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.568885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.569034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.569198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.569218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.569230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.571360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.580610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.581013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.581140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.581165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.581181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.581376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.581533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.581553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.581567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.583651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.592836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.593150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.593302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.593328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.593343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.593468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.593635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.593655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.593669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.595612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.605006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.605316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.605457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.605484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.605500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.605638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.605818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.605838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.605851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.607872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.617291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.617533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.617663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.617688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.617704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.617885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.618064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.618084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.618096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.620090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.629495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.629766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.629917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.629943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.629959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.630107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.630284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.630304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.630317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.632564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.641739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.642036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.642190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.642215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.642231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.642380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.642563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.642585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.642598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.644576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.654027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.654408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.654510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.654536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.654552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.654733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.654911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.429 [2024-11-29 14:04:03.654931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.429 [2024-11-29 14:04:03.654943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.429 [2024-11-29 14:04:03.657015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.429 [2024-11-29 14:04:03.666291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.429 [2024-11-29 14:04:03.666625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.666757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.429 [2024-11-29 14:04:03.666782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.429 [2024-11-29 14:04:03.666798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.429 [2024-11-29 14:04:03.666929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.429 [2024-11-29 14:04:03.667108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.430 [2024-11-29 14:04:03.667128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.430 [2024-11-29 14:04:03.667141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.430 [2024-11-29 14:04:03.669058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.430 [2024-11-29 14:04:03.678565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.430 [2024-11-29 14:04:03.678913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.679071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.679096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.430 [2024-11-29 14:04:03.679112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.430 [2024-11-29 14:04:03.679261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.430 [2024-11-29 14:04:03.679435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.430 [2024-11-29 14:04:03.679462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.430 [2024-11-29 14:04:03.679476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.430 [2024-11-29 14:04:03.681421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.430 [2024-11-29 14:04:03.690911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.430 [2024-11-29 14:04:03.691189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.691325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.691350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.430 [2024-11-29 14:04:03.691366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.430 [2024-11-29 14:04:03.691523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.430 [2024-11-29 14:04:03.691719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.430 [2024-11-29 14:04:03.691739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.430 [2024-11-29 14:04:03.691753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.430 [2024-11-29 14:04:03.693896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.430 [2024-11-29 14:04:03.703281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.430 [2024-11-29 14:04:03.703590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.703724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.430 [2024-11-29 14:04:03.703750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.430 [2024-11-29 14:04:03.703766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.430 [2024-11-29 14:04:03.703962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.430 [2024-11-29 14:04:03.704115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.430 [2024-11-29 14:04:03.704135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.430 [2024-11-29 14:04:03.704149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.430 [2024-11-29 14:04:03.706339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.688 [2024-11-29 14:04:03.715639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.688 [2024-11-29 14:04:03.715951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.716058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.716085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.688 [2024-11-29 14:04:03.716101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.688 [2024-11-29 14:04:03.716249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.688 [2024-11-29 14:04:03.716515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.688 [2024-11-29 14:04:03.716537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.688 [2024-11-29 14:04:03.716556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.688 [2024-11-29 14:04:03.718559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.688 [2024-11-29 14:04:03.727858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.688 [2024-11-29 14:04:03.728139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.728268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.728294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.688 [2024-11-29 14:04:03.728309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.688 [2024-11-29 14:04:03.728467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.688 [2024-11-29 14:04:03.728660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.688 [2024-11-29 14:04:03.728680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.688 [2024-11-29 14:04:03.728693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.688 [2024-11-29 14:04:03.730758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.688 [2024-11-29 14:04:03.740362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.688 [2024-11-29 14:04:03.740706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.740834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.740861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.688 [2024-11-29 14:04:03.740878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.688 [2024-11-29 14:04:03.741027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.688 [2024-11-29 14:04:03.741191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.688 [2024-11-29 14:04:03.741211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.688 [2024-11-29 14:04:03.741224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.688 [2024-11-29 14:04:03.743321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.688 [2024-11-29 14:04:03.752820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.688 [2024-11-29 14:04:03.753136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.753242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.688 [2024-11-29 14:04:03.753269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.688 [2024-11-29 14:04:03.753286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.688 [2024-11-29 14:04:03.753480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.688 [2024-11-29 14:04:03.753663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.688 [2024-11-29 14:04:03.753684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.753697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.755669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.765314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.765635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.765758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.765784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.765800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.765964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.766109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.766130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.766142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.768185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.777416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.777717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.777846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.777872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.777888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.778052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.778228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.778248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.778261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.780329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.789697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.790046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.790150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.790176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.790192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.790412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.790513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.790534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.790547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.792630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.802030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.802294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.802464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.802492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.802508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.802657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.802850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.802870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.802883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.804887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.814226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.814528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.814661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.814688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.814704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.814868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.815045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.815064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.815077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.817208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.826357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.826676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.826829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.826855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.826871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.827067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.827257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.827277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.827290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.829582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.838483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.838824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.838954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.838980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.838996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.839145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.839353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.839388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.839411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.841421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.850720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.851049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.851179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.851204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.851220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.851456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.851635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.851656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.851669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.853661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.862861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.689 [2024-11-29 14:04:03.863219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.863318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.689 [2024-11-29 14:04:03.863346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.689 [2024-11-29 14:04:03.863362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.689 [2024-11-29 14:04:03.863486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.689 [2024-11-29 14:04:03.863683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.689 [2024-11-29 14:04:03.863703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.689 [2024-11-29 14:04:03.863716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.689 [2024-11-29 14:04:03.865683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.689 [2024-11-29 14:04:03.875062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.875341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.875469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.875500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.875518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.875682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.875859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.875879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.875891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.878110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.887310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.887618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.887724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.887749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.887766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.887930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.888107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.888128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.888140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.890211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.899538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.899931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.900079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.900105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.900121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.900270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.900439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.900460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.900473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.902573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.911877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.912150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.912244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.912272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.912293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.912451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.912673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.912709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.912723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.914654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.924203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.924500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.924625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.924651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.924667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.924815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.924976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.924996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.925008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.927031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.936493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.936835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.936961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.936988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.937004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.937168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.937345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.937365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.937378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.939388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.948786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.949091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.949190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.949216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.949232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.949386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.949561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.949582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.949596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.951714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.690 [2024-11-29 14:04:03.960974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.690 [2024-11-29 14:04:03.961264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.961362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.690 [2024-11-29 14:04:03.961389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.690 [2024-11-29 14:04:03.961414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.690 [2024-11-29 14:04:03.961563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.690 [2024-11-29 14:04:03.961696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.690 [2024-11-29 14:04:03.961717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.690 [2024-11-29 14:04:03.961747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.690 [2024-11-29 14:04:03.963724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:03.973328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:03.973615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.973719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.973744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:03.973760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:03.973924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:03.974107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:03.974128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:03.974142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:03.976189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:03.985644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:03.985913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.986038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.986064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:03.986079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:03.986260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:03.986501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:03.986523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:03.986536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:03.988623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:03.997970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:03.998307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.998410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:03.998437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:03.998454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:03.998587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:03.998766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:03.998787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:03.998800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:04.000875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:04.010333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:04.010730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.010825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.010852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:04.010868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:04.011032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:04.011208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:04.011228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:04.011241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:04.013312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:04.022670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:04.023034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.023125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.023151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:04.023167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:04.023364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:04.023514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:04.023544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:04.023559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:04.025620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:04.035210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:04.035503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.035601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.035627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:04.035643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.950 [2024-11-29 14:04:04.035791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.950 [2024-11-29 14:04:04.035941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.950 [2024-11-29 14:04:04.035976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.950 [2024-11-29 14:04:04.035990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.950 [2024-11-29 14:04:04.038111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.950 [2024-11-29 14:04:04.047377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.950 [2024-11-29 14:04:04.047663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.047786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.950 [2024-11-29 14:04:04.047811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.950 [2024-11-29 14:04:04.047827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.048007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.048170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.048190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.048203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.050124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.059482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.059827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.059929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.059954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.059969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.060117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.060313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.060333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.060351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.062282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.071709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.072062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.072191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.072217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.072233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.072349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.072527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.072549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.072562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.074665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.083830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.084070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.084204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.084229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.084244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.084417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.084569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.084591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.084604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.086739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.096091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.096351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.096488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.096515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.096531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.096663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.096848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.096868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.096881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.098910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.108412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.108723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.108851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.108880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.108896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.109045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.109209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.109229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.109243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.111326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.120947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.121262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.121388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.121422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.121439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.121619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.121782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.121802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.121815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.123844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.133202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.133527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.133681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.951 [2024-11-29 14:04:04.133707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.951 [2024-11-29 14:04:04.133724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.951 [2024-11-29 14:04:04.133873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.951 [2024-11-29 14:04:04.134037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.951 [2024-11-29 14:04:04.134058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.951 [2024-11-29 14:04:04.134070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.951 [2024-11-29 14:04:04.136062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.951 [2024-11-29 14:04:04.145449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.951 [2024-11-29 14:04:04.145695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.145799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.145824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.145840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.145988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.146153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.146173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.146186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.148274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.157745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.158068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.158194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.158220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.158236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.158426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.158623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.158645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.158658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.160780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.169966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.170296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.170425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.170452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.170468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.170616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.170796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.170816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.170829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.172930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.182128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.182430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.182528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.182553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.182569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.182765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.182913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.182933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.182946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.184883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.194615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.194951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.195053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.195078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.195095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.195291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.195480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.195502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.195515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.197682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.207244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.207552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.207679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.207705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.207721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.207902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.208035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.208070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.208084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.210219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.952 [2024-11-29 14:04:04.219590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.952 [2024-11-29 14:04:04.219915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.220016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.952 [2024-11-29 14:04:04.220046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:23.952 [2024-11-29 14:04:04.220063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:23.952 [2024-11-29 14:04:04.220211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:23.952 [2024-11-29 14:04:04.220376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.952 [2024-11-29 14:04:04.220405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.952 [2024-11-29 14:04:04.220436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.952 [2024-11-29 14:04:04.222507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.211 [2024-11-29 14:04:04.231812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.211 [2024-11-29 14:04:04.232069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.211 [2024-11-29 14:04:04.232218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.211 [2024-11-29 14:04:04.232243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.211 [2024-11-29 14:04:04.232259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.211 [2024-11-29 14:04:04.232391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.211 [2024-11-29 14:04:04.232571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.211 [2024-11-29 14:04:04.232592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.211 [2024-11-29 14:04:04.232606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.211 [2024-11-29 14:04:04.234633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.211 [2024-11-29 14:04:04.244140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.211 [2024-11-29 14:04:04.244430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.211 [2024-11-29 14:04:04.244562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.211 [2024-11-29 14:04:04.244587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.211 [2024-11-29 14:04:04.244603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.211 [2024-11-29 14:04:04.244736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.211 [2024-11-29 14:04:04.244902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.211 [2024-11-29 14:04:04.244922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.244936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.247007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 14:04:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:24.212 14:04:04 -- common/autotest_common.sh@862 -- # return 0 00:30:24.212 14:04:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:24.212 14:04:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:24.212 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.212 [2024-11-29 14:04:04.256537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.256836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.256935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.256960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.256975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.257141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.257291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.257312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.257327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.259519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 [2024-11-29 14:04:04.269035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.269515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.269542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.269560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.269724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.269892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.269914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.269929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.272131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 14:04:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:24.212 14:04:04 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:24.212 14:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.212 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.212 [2024-11-29 14:04:04.278003] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:24.212 [2024-11-29 14:04:04.281240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.281467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.281596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.281621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.281637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.281818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.282013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.282033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.282045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 14:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.212 14:04:04 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:24.212 14:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.212 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.212 [2024-11-29 14:04:04.284187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 [2024-11-29 14:04:04.293447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.293724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.293875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.293900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.293915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.294064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.294255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.294275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.294287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.296666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 [2024-11-29 14:04:04.305639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.305910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.306042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.306068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.306084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.306249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.306408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.306429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.306443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.308276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 [2024-11-29 14:04:04.317859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.212 [2024-11-29 14:04:04.318330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.318477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.212 [2024-11-29 14:04:04.318506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.212 [2024-11-29 14:04:04.318526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.212 [2024-11-29 14:04:04.318732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.212 [2024-11-29 14:04:04.318912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.212 [2024-11-29 14:04:04.318933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.212 [2024-11-29 14:04:04.318960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.212 [2024-11-29 14:04:04.320881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.212 Malloc0 00:30:24.212 14:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.213 14:04:04 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:24.213 14:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.213 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.213 [2024-11-29 14:04:04.330150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.213 [2024-11-29 14:04:04.330464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.213 14:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.213 [2024-11-29 14:04:04.330593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:24.213 [2024-11-29 14:04:04.330618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1136870 with addr=10.0.0.2, port=4420 00:30:24.213 [2024-11-29 14:04:04.330635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1136870 is same with the state(5) to be set 00:30:24.213 14:04:04 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:24.213 14:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.213 [2024-11-29 14:04:04.330799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1136870 (9): Bad file descriptor 00:30:24.213 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.213 [2024-11-29 14:04:04.330951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:24.213 [2024-11-29 14:04:04.330988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:24.213 [2024-11-29 14:04:04.331002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:24.213 [2024-11-29 14:04:04.333080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:24.213 14:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.213 14:04:04 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:24.213 14:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:24.213 14:04:04 -- common/autotest_common.sh@10 -- # set +x 00:30:24.213 [2024-11-29 14:04:04.342414] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:24.213 [2024-11-29 14:04:04.342464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:24.213 14:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:24.213 14:04:04 -- host/bdevperf.sh@38 -- # wait 2428629 00:30:24.470 [2024-11-29 14:04:04.498573] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:32.581 00:30:32.581 Latency(us) 00:30:32.581 [2024-11-29T13:04:12.863Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:32.581 [2024-11-29T13:04:12.863Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:32.581 Verification LBA range: start 0x0 length 0x4000 00:30:32.582 Nvme1n1 : 15.01 9157.89 35.77 17188.94 0.00 4843.80 879.88 19709.35 00:30:32.582 [2024-11-29T13:04:12.864Z] =================================================================================================================== 00:30:32.582 [2024-11-29T13:04:12.864Z] Total : 9157.89 35.77 17188.94 0.00 4843.80 879.88 19709.35 00:30:32.582 14:04:12 -- host/bdevperf.sh@39 -- # sync 00:30:32.582 14:04:12 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:32.582 14:04:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.582 14:04:12 -- common/autotest_common.sh@10 -- # set +x 00:30:32.582 14:04:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.582 14:04:12 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:32.582 14:04:12 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:32.582 14:04:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:32.582 14:04:12 -- nvmf/common.sh@116 -- # sync 00:30:32.582 14:04:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:32.582 14:04:12 -- nvmf/common.sh@119 -- # set +e 00:30:32.582 14:04:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:32.582 14:04:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:32.582 rmmod nvme_tcp 00:30:32.582 rmmod nvme_fabrics 00:30:32.582 rmmod nvme_keyring 00:30:32.582 14:04:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:32.582 14:04:12 -- nvmf/common.sh@123 -- # set -e 00:30:32.582 14:04:12 -- nvmf/common.sh@124 -- # return 0 00:30:32.582 14:04:12 -- nvmf/common.sh@477 -- # '[' -n 2429435 ']' 00:30:32.582 14:04:12 -- nvmf/common.sh@478 -- # killprocess 2429435 00:30:32.582 14:04:12 -- common/autotest_common.sh@936 -- # '[' -z 2429435 ']' 00:30:32.582 14:04:12 -- common/autotest_common.sh@940 -- # kill -0 2429435 00:30:32.582 14:04:12 -- common/autotest_common.sh@941 -- # uname 00:30:32.582 14:04:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:32.582 14:04:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2429435 00:30:32.840 14:04:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:32.840 14:04:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:32.840 14:04:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2429435' 00:30:32.840 killing process with pid 2429435 00:30:32.840 14:04:12 -- common/autotest_common.sh@955 -- # kill 2429435 00:30:32.840 14:04:12 -- common/autotest_common.sh@960 -- # wait 2429435 00:30:33.099 14:04:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:33.099 14:04:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:33.099 14:04:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:33.099 14:04:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:33.099 14:04:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:33.099 14:04:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:33.099 14:04:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:33.099 14:04:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:35.006 14:04:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:35.006 00:30:35.006 real 0m23.052s 00:30:35.007 user 1m1.221s 00:30:35.007 sys 0m4.626s 00:30:35.007 14:04:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:35.007 14:04:15 -- common/autotest_common.sh@10 -- # set +x 00:30:35.007 ************************************ 00:30:35.007 END TEST nvmf_bdevperf 00:30:35.007 ************************************ 00:30:35.007 14:04:15 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:35.007 14:04:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:35.007 14:04:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:35.007 14:04:15 -- common/autotest_common.sh@10 -- # set +x 00:30:35.007 ************************************ 00:30:35.007 START TEST nvmf_target_disconnect 00:30:35.007 ************************************ 00:30:35.007 14:04:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:35.007 * Looking for test storage... 00:30:35.268 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:35.268 14:04:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:35.268 14:04:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:35.268 14:04:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:35.268 14:04:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:35.268 14:04:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:35.268 14:04:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:35.268 14:04:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:35.268 14:04:15 -- scripts/common.sh@335 -- # IFS=.-: 00:30:35.268 14:04:15 -- scripts/common.sh@335 -- # read -ra ver1 00:30:35.268 14:04:15 -- scripts/common.sh@336 -- # IFS=.-: 00:30:35.268 14:04:15 -- scripts/common.sh@336 -- # read -ra ver2 00:30:35.268 14:04:15 -- scripts/common.sh@337 -- # local 'op=<' 00:30:35.268 14:04:15 -- scripts/common.sh@339 -- # ver1_l=2 00:30:35.268 14:04:15 -- scripts/common.sh@340 -- # ver2_l=1 00:30:35.268 14:04:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:35.268 14:04:15 -- scripts/common.sh@343 -- # case "$op" in 00:30:35.268 14:04:15 -- scripts/common.sh@344 -- # : 1 00:30:35.268 14:04:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:35.268 14:04:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:35.268 14:04:15 -- scripts/common.sh@364 -- # decimal 1 00:30:35.268 14:04:15 -- scripts/common.sh@352 -- # local d=1 00:30:35.268 14:04:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:35.268 14:04:15 -- scripts/common.sh@354 -- # echo 1 00:30:35.268 14:04:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:35.268 14:04:15 -- scripts/common.sh@365 -- # decimal 2 00:30:35.268 14:04:15 -- scripts/common.sh@352 -- # local d=2 00:30:35.268 14:04:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:35.268 14:04:15 -- scripts/common.sh@354 -- # echo 2 00:30:35.268 14:04:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:35.268 14:04:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:35.268 14:04:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:35.268 14:04:15 -- scripts/common.sh@367 -- # return 0 00:30:35.268 14:04:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:35.268 14:04:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:35.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.268 --rc genhtml_branch_coverage=1 00:30:35.268 --rc genhtml_function_coverage=1 00:30:35.268 --rc genhtml_legend=1 00:30:35.268 --rc geninfo_all_blocks=1 00:30:35.268 --rc geninfo_unexecuted_blocks=1 00:30:35.268 00:30:35.268 ' 00:30:35.268 14:04:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:35.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.268 --rc genhtml_branch_coverage=1 00:30:35.268 --rc genhtml_function_coverage=1 00:30:35.268 --rc genhtml_legend=1 00:30:35.268 --rc geninfo_all_blocks=1 00:30:35.268 --rc geninfo_unexecuted_blocks=1 00:30:35.268 00:30:35.269 ' 00:30:35.269 14:04:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:35.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.269 --rc genhtml_branch_coverage=1 00:30:35.269 --rc genhtml_function_coverage=1 00:30:35.269 --rc genhtml_legend=1 00:30:35.269 --rc geninfo_all_blocks=1 00:30:35.269 --rc geninfo_unexecuted_blocks=1 00:30:35.269 00:30:35.269 ' 00:30:35.269 14:04:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:35.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.269 --rc genhtml_branch_coverage=1 00:30:35.269 --rc genhtml_function_coverage=1 00:30:35.269 --rc genhtml_legend=1 00:30:35.269 --rc geninfo_all_blocks=1 00:30:35.269 --rc geninfo_unexecuted_blocks=1 00:30:35.269 00:30:35.269 ' 00:30:35.269 14:04:15 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:35.269 14:04:15 -- nvmf/common.sh@7 -- # uname -s 00:30:35.269 14:04:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:35.269 14:04:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:35.269 14:04:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:35.269 14:04:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:35.269 14:04:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:35.269 14:04:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:35.269 14:04:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:35.269 14:04:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:35.269 14:04:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:35.269 14:04:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:35.269 14:04:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:35.269 14:04:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:35.269 14:04:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:35.269 14:04:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:35.269 14:04:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:35.269 14:04:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:35.269 14:04:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:35.269 14:04:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:35.269 14:04:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:35.269 14:04:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.269 14:04:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.269 14:04:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.269 14:04:15 -- paths/export.sh@5 -- # export PATH 00:30:35.269 14:04:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.269 14:04:15 -- nvmf/common.sh@46 -- # : 0 00:30:35.269 14:04:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:35.269 14:04:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:35.269 14:04:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:35.269 14:04:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:35.269 14:04:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:35.269 14:04:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:35.269 14:04:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:35.269 14:04:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:35.269 14:04:15 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:35.269 14:04:15 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:35.269 14:04:15 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:35.269 14:04:15 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:35.269 14:04:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:35.269 14:04:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:35.269 14:04:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:35.269 14:04:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:35.269 14:04:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:35.269 14:04:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:35.269 14:04:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:35.269 14:04:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:35.269 14:04:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:35.269 14:04:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:35.269 14:04:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:35.269 14:04:15 -- common/autotest_common.sh@10 -- # set +x 00:30:37.172 14:04:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:37.172 14:04:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:37.172 14:04:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:37.172 14:04:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:37.172 14:04:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:37.172 14:04:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:37.172 14:04:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:37.172 14:04:17 -- nvmf/common.sh@294 -- # net_devs=() 00:30:37.172 14:04:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:37.172 14:04:17 -- nvmf/common.sh@295 -- # e810=() 00:30:37.172 14:04:17 -- nvmf/common.sh@295 -- # local -ga e810 00:30:37.172 14:04:17 -- nvmf/common.sh@296 -- # x722=() 00:30:37.172 14:04:17 -- nvmf/common.sh@296 -- # local -ga x722 00:30:37.172 14:04:17 -- nvmf/common.sh@297 -- # mlx=() 00:30:37.172 14:04:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:37.172 14:04:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:37.172 14:04:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:37.172 14:04:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:37.172 14:04:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:37.172 14:04:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:37.172 14:04:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:37.172 14:04:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:37.173 14:04:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:37.173 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:37.173 14:04:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:37.173 14:04:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:37.173 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:37.173 14:04:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:37.173 14:04:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:37.173 14:04:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:37.173 14:04:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:37.173 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:37.173 14:04:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:37.173 14:04:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:37.173 14:04:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:37.173 14:04:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:37.173 14:04:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:37.173 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:37.173 14:04:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:37.173 14:04:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:37.173 14:04:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:37.173 14:04:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:37.173 14:04:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:37.173 14:04:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:37.173 14:04:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:37.173 14:04:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:37.173 14:04:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:37.173 14:04:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:37.173 14:04:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:37.173 14:04:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:37.173 14:04:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:37.173 14:04:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:37.173 14:04:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:37.173 14:04:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:37.173 14:04:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:37.432 14:04:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:37.432 14:04:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:37.432 14:04:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:37.432 14:04:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:37.432 14:04:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:37.432 14:04:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:37.432 14:04:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:37.432 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:37.432 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:30:37.432 00:30:37.432 --- 10.0.0.2 ping statistics --- 00:30:37.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:37.432 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:30:37.432 14:04:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:37.432 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:37.432 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:30:37.432 00:30:37.432 --- 10.0.0.1 ping statistics --- 00:30:37.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:37.432 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:30:37.432 14:04:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:37.432 14:04:17 -- nvmf/common.sh@410 -- # return 0 00:30:37.432 14:04:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:37.432 14:04:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:37.432 14:04:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:37.432 14:04:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:37.432 14:04:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:37.432 14:04:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:37.432 14:04:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:37.432 14:04:17 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:37.432 14:04:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:37.432 14:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:37.432 14:04:17 -- common/autotest_common.sh@10 -- # set +x 00:30:37.432 ************************************ 00:30:37.432 START TEST nvmf_target_disconnect_tc1 00:30:37.432 ************************************ 00:30:37.432 14:04:17 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:37.432 14:04:17 -- host/target_disconnect.sh@32 -- # set +e 00:30:37.432 14:04:17 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:37.432 EAL: No free 2048 kB hugepages reported on node 1 00:30:37.432 [2024-11-29 14:04:17.640894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.432 [2024-11-29 14:04:17.641114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.432 [2024-11-29 14:04:17.641144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23f0df0 with addr=10.0.0.2, port=4420 00:30:37.432 [2024-11-29 14:04:17.641195] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:37.432 [2024-11-29 14:04:17.641220] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:37.432 [2024-11-29 14:04:17.641234] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:37.432 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:37.432 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:37.432 Initializing NVMe Controllers 00:30:37.432 14:04:17 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:37.432 14:04:17 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:37.432 14:04:17 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:37.432 14:04:17 -- common/autotest_common.sh@1142 -- # return 0 00:30:37.432 14:04:17 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:37.432 14:04:17 -- host/target_disconnect.sh@41 -- # set -e 00:30:37.432 00:30:37.432 real 0m0.097s 00:30:37.432 user 0m0.040s 00:30:37.432 sys 0m0.056s 00:30:37.432 14:04:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:37.432 14:04:17 -- common/autotest_common.sh@10 -- # set +x 00:30:37.432 ************************************ 00:30:37.432 END TEST nvmf_target_disconnect_tc1 00:30:37.432 ************************************ 00:30:37.432 14:04:17 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:37.432 14:04:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:37.432 14:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:37.432 14:04:17 -- common/autotest_common.sh@10 -- # set +x 00:30:37.432 ************************************ 00:30:37.432 START TEST nvmf_target_disconnect_tc2 00:30:37.432 ************************************ 00:30:37.432 14:04:17 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:37.432 14:04:17 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:37.432 14:04:17 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:37.432 14:04:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:37.432 14:04:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:37.432 14:04:17 -- common/autotest_common.sh@10 -- # set +x 00:30:37.432 14:04:17 -- nvmf/common.sh@469 -- # nvmfpid=2432518 00:30:37.432 14:04:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:37.432 14:04:17 -- nvmf/common.sh@470 -- # waitforlisten 2432518 00:30:37.432 14:04:17 -- common/autotest_common.sh@829 -- # '[' -z 2432518 ']' 00:30:37.432 14:04:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:37.432 14:04:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:37.432 14:04:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:37.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:37.432 14:04:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:37.432 14:04:17 -- common/autotest_common.sh@10 -- # set +x 00:30:37.690 [2024-11-29 14:04:17.724889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:37.690 [2024-11-29 14:04:17.724963] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:37.690 EAL: No free 2048 kB hugepages reported on node 1 00:30:37.690 [2024-11-29 14:04:17.793253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:37.690 [2024-11-29 14:04:17.878822] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:37.690 [2024-11-29 14:04:17.878962] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:37.690 [2024-11-29 14:04:17.878979] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:37.690 [2024-11-29 14:04:17.878990] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:37.690 [2024-11-29 14:04:17.879080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:37.690 [2024-11-29 14:04:17.879146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:37.690 [2024-11-29 14:04:17.879207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:37.690 [2024-11-29 14:04:17.879209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:38.623 14:04:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:38.623 14:04:18 -- common/autotest_common.sh@862 -- # return 0 00:30:38.623 14:04:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:38.623 14:04:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:38.623 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.623 14:04:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:38.623 14:04:18 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:38.623 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.623 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.623 Malloc0 00:30:38.623 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.623 14:04:18 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:38.623 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.623 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.623 [2024-11-29 14:04:18.741174] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:38.623 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.623 14:04:18 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:38.623 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.623 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.623 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.623 14:04:18 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:38.623 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.623 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.623 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.624 14:04:18 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:38.624 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.624 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.624 [2024-11-29 14:04:18.769478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:38.624 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.624 14:04:18 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:38.624 14:04:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.624 14:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:38.624 14:04:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.624 14:04:18 -- host/target_disconnect.sh@50 -- # reconnectpid=2432675 00:30:38.624 14:04:18 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:38.624 14:04:18 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:38.624 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.566 14:04:20 -- host/target_disconnect.sh@53 -- # kill -9 2432518 00:30:40.566 14:04:20 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 [2024-11-29 14:04:20.795300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 [2024-11-29 14:04:20.795657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Read completed with error (sct=0, sc=8) 00:30:40.566 starting I/O failed 00:30:40.566 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Write completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 Read completed with error (sct=0, sc=8) 00:30:40.567 starting I/O failed 00:30:40.567 [2024-11-29 14:04:20.795977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:40.567 [2024-11-29 14:04:20.796185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.796493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.796724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.796881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.797039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.797444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.797673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.797827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.797949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.798329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.798626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.798808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.798914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.799353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.799585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.799739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.799867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.800177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.800512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.800779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.800894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.801005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.801269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.801511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.801809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.801936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.802049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.802187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.802216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.802324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.802473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.802500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.567 qpair failed and we were unable to recover it. 00:30:40.567 [2024-11-29 14:04:20.802595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.567 [2024-11-29 14:04:20.802706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.802734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.802873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.803193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.803485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.803759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.803936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.804117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.804463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.804697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.804849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Read completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 Write completed with error (sct=0, sc=8) 00:30:40.568 starting I/O failed 00:30:40.568 [2024-11-29 14:04:20.805190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:40.568 [2024-11-29 14:04:20.805391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.805547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.805577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.805676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.805790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.805817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.805955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.806257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.806504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.806736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.806921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.807053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.807355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.807641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.807791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.807938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.808164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.808438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.568 [2024-11-29 14:04:20.808710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.568 [2024-11-29 14:04:20.808837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.568 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.808962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.809206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.809500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.809756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.809904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.809999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.810315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.810563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.810829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.810977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.811097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.811309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.811572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.811784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.811958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.812099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.812336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.812597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.812744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.812910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.813273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.813553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.813797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.813974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.814062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.814359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.814588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.814712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.814884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.815235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.815463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.815785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.815924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.816018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.816292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.569 [2024-11-29 14:04:20.816545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.569 [2024-11-29 14:04:20.816686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.569 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.816818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.816947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.816990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.817146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.817482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.817705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.817856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.817974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.818266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.818567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.818727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.818874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.819182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.819474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.819708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.819827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.819998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.820328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.820555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.820860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.820981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.821105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.821381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.821644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.821810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.821916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.822243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.822510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.822810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.822961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.823112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.823230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.823257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.823346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.823435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.823462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.570 qpair failed and we were unable to recover it. 00:30:40.570 [2024-11-29 14:04:20.823558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.570 [2024-11-29 14:04:20.823651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.823677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.823774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.823861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.823888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.824043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.824265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.824504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.824750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.824899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.824988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.825231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.825519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.825734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.825861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.825985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.826272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.826589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.826829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.826954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.827054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.827351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.827630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.827793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.827949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.828069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.871 [2024-11-29 14:04:20.828094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.871 qpair failed and we were unable to recover it. 00:30:40.871 [2024-11-29 14:04:20.828184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.828460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.828707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.828829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.828924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.829227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.829449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.829693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.829843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.829965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.830247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.830503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.830753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.830867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.830982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.831249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.831529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.831769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.831916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.832045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.832289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.832550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.832841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.832955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.833080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.833326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.833571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.833847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.833997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.834103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.834463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.834758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.834935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.835059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.835302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.835584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.835763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.872 qpair failed and we were unable to recover it. 00:30:40.872 [2024-11-29 14:04:20.835938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.872 [2024-11-29 14:04:20.836077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.836240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.836545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.836820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.836992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.837115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.837439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.837679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.837844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.837980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.838249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.838598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.838780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.838924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.839241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.839607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.839868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.839980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.840160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.840426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.840693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.840818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.840945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.841196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.841467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.841768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.841894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.841990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.842295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.842626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.842829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.842976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.843307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.843565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.843816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.843929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.844060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.844230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.844259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.873 qpair failed and we were unable to recover it. 00:30:40.873 [2024-11-29 14:04:20.844404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.873 [2024-11-29 14:04:20.844555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.844582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.844733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.844917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.844943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.845094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.845438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.845726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.845855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.846003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.846246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.846595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.846900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.846992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.847109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.847450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.847700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.847881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.848025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.848349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.848599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.848871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.848990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.849148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.849423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.849676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.849840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.849985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.850353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.850664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.850818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.850973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.851270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.851573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.851726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.851853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.852191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.852548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.852821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.874 [2024-11-29 14:04:20.852929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.874 qpair failed and we were unable to recover it. 00:30:40.874 [2024-11-29 14:04:20.853078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.853328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.853579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.853752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.853908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.854191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.854445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.854710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.854881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.854996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.855286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.855544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.855772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.855943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.856031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.856294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.856558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.856830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.856957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.857073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.857307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.857579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.857857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.857978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.858121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.858363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.858639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.858781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.858907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.859170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.875 [2024-11-29 14:04:20.859466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.875 [2024-11-29 14:04:20.859590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.875 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.859713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.859863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.859889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.859984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.860258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.860518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.860784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.860959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.861082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.861343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.861625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.861887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.861979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.862126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.862401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.862673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.862824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.862911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.863218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.863451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.863693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.863848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.863967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.864172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.864470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.864808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.864969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.865156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.865466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.865728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.865851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.865949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.866229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.866545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.866816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.866989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.867115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.867274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.867300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-29 14:04:20.867448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.867587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.876 [2024-11-29 14:04:20.867618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.867760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.867900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.867929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.868098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.868436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.868676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.868851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.868979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.869282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.869558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.869896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.869993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.870147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.870407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.870689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.870808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.870936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.871275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.871531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.871872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.871992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.872180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.872466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.872733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.872880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.873010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.873261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.873549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.873730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.873865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.874220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.874500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.874821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.874973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.875159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.875495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.875843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.875989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.876022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-29 14:04:20.876144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.876262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.877 [2024-11-29 14:04:20.876289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.876420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.876573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.876598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.876702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.876802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.876830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.876946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.877245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.877615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.877774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.877893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.878207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.878492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.878729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.878838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.878928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.879185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.879463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.879737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.879884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.880015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.880361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.880646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.880803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.880927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.881160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.881516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.881804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.881953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.882048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.882289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.882572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.882869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.882996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.883177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.883453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.883779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.883939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.884028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.884121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.884148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-29 14:04:20.884304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.884447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.878 [2024-11-29 14:04:20.884474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.884565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.884653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.884691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.884784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.884901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.884927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.885015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.885275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.885606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.885810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.885958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.886293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.886546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.886785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.886937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.887088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.887337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.887645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.887808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.887945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.888252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.888481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.888777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.888899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.889012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.889241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.889582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.889876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.889998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.890146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.890440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.890754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.890940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.891074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.891382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.891694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.891867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.891991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.892228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.879 [2024-11-29 14:04:20.892487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.879 [2024-11-29 14:04:20.892647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.879 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.892795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.892911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.892937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.893062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.893376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.893702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.893816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.893909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.894259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.894564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.894835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.894985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.895109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.895427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.895753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.895901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.896026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.896255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.896535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.896757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.896900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.897039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.897351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.897597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.897757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.897884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.898251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.898625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.898773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.898927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.899159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.899457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.899788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.899967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.880 qpair failed and we were unable to recover it. 00:30:40.880 [2024-11-29 14:04:20.900097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.900198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.880 [2024-11-29 14:04:20.900225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.900366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.900478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.900507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.900667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.900818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.900844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.900995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.901238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.901544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.901762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.901879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.902009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.902303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.902612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.902759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.902878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.903172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.903426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.903753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.903950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.904075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.904427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.904704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.904855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.904980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.905215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.905485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.905689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.905834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.905984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.906246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.906554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.906826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.906974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.907151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.907443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.907752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.907905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.908064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.908167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.881 [2024-11-29 14:04:20.908195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.881 qpair failed and we were unable to recover it. 00:30:40.881 [2024-11-29 14:04:20.908298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.908437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.908467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.908607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.908729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.908755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.908896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.909150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.909482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.909761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.909873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.910026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.910334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.910554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.910817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.910987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.911130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.911390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.911681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.911876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.912049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.912368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.912670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.912845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.912976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.913245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.913528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.913820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.913972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.914065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.914348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.914674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.914860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.914974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.915245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.915542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.915812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.915960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.916105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.916230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.916259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.916387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.916492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.882 [2024-11-29 14:04:20.916518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.882 qpair failed and we were unable to recover it. 00:30:40.882 [2024-11-29 14:04:20.916681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.916780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.916806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.916911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.917205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.917470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.917762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.917972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.918076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.918407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.918717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.918850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.918990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.919314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.919574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.919700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.919873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.920186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.920497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.920785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.920946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.921098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.921401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.921694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.921876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.922047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.922383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.922754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.922952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.923132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.923375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.923648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.923789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.923976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.924222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.924522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.924830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.924950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.925078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.925160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.883 [2024-11-29 14:04:20.925191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.883 qpair failed and we were unable to recover it. 00:30:40.883 [2024-11-29 14:04:20.925285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.925409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.925437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.925606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.925817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.925871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.926007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.926318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.926599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.926774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.926908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.927207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.927443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.927695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.927833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.927980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.928282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.928562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.928729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.928867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.929224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.929563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.929769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.929891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.930196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.930514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.930794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.930973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.931117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.931455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.931710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.931883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.931999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.932277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.932561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.932822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.932991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.933153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.933303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.933330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.933463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.933560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.933586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.884 qpair failed and we were unable to recover it. 00:30:40.884 [2024-11-29 14:04:20.933768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.884 [2024-11-29 14:04:20.933918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.933945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.934069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.934315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.934665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.934855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.934946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.935252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.935568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.935835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.935966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.936138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.936410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.936738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.936870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.936988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.937246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.937614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.937780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.937921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.938249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.938513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.938839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.938988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.939154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.939417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.939677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.939793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.939966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.940262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.940550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.940828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.940972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.941093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.941187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.941213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.941364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.941528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.941555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.885 qpair failed and we were unable to recover it. 00:30:40.885 [2024-11-29 14:04:20.941685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.885 [2024-11-29 14:04:20.941836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.941862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.941976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.942308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.942613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.942786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.942934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.943219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.943516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.943821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.943965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.944090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.944403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.944629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.944766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.944939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.945227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.945588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.945888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.945981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.946125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.946433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.946705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.946867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.946984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.947255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.947567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.947740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.947916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.948240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.948446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.948720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.948912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.949016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.949315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.949568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.949723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.949860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.950028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.950054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.886 qpair failed and we were unable to recover it. 00:30:40.886 [2024-11-29 14:04:20.950155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.886 [2024-11-29 14:04:20.950280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.950308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.950480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.950646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.950675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.950836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.950976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.951149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.951426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.951733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.951918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.952073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.952405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.952758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.952948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.953065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.953365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.953627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.953771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.953891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.954145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.954437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.954754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.954882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.955054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.955374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.955724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.955877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.956065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.956342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.956631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.956774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.956902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.957215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.957496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.957801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.957962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.958059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.958334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.958628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.887 [2024-11-29 14:04:20.958747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.887 qpair failed and we were unable to recover it. 00:30:40.887 [2024-11-29 14:04:20.958853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.959127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.959380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.959610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.959795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.959919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.960217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.960560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.960876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.960999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.961201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.961505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.961795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.961940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.962058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.962377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.962694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.962842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.962959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.963274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.963554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.963823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.963989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.964165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.964436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.964699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.964856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.964988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.965295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.965598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.965871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.965991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.966195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.966438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.966680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.966850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.888 [2024-11-29 14:04:20.966995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.967114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.888 [2024-11-29 14:04:20.967140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.888 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.967291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.967424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.967460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.967599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.967735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.967764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.967916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.968184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.968511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.968842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.968953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.969088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.969417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.969743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.969893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.970034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.970290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.970618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.970768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.970893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.971225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.971534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.971790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.971905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.972021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.972309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.972553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.972841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.972979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.973133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.973380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.973595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.973768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.973883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.974177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.889 [2024-11-29 14:04:20.974527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.889 [2024-11-29 14:04:20.974692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.889 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.974845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.974943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.974970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.975159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.975442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.975722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.975870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.975989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.976310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.976573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.976747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.976885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.977138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.977418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.977701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.977829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.977933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.978249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.978583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.978719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.978862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.979216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.979532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.979835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.979977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.980103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.980401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.980690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.980828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.980955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.981249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.981557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.981825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.981967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.982066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.982431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.982704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.982886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.890 [2024-11-29 14:04:20.983045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.983175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.890 [2024-11-29 14:04:20.983201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.890 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.983325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.983426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.983453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.983556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.983644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.983670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.983847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.983993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.984191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.984489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.984820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.984961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.985172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.985437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.985684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.985886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.986777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.986936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.986965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.987079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.987408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.987724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.987882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.988034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.988325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.988682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.988836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.988962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.989289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.989596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.989768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.989901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.990148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.990415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.990744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.990939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.991073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.991380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.991705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.991874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.991971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.992096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.992123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.992216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.992333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.992364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.891 qpair failed and we were unable to recover it. 00:30:40.891 [2024-11-29 14:04:20.992517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.891 [2024-11-29 14:04:20.992652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.992679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.992841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.992981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.993010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.993193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.993371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.993410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.993554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.993679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.993708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.993884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.994190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.994443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.994718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.994838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.994944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.995237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.995554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.995800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.995951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.996103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.996411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.996663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.996830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.997016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.997337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.997650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.997810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.997937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.998265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.998579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.998736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.998863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.999228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.999542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:20.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:20.999986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:21.000158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:21.000422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:21.000711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.000827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:21.001015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.001162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.001188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.892 qpair failed and we were unable to recover it. 00:30:40.892 [2024-11-29 14:04:21.001340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.892 [2024-11-29 14:04:21.001521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.001548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.001870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.002323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.002588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.002855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.002977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.003163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.003458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.003725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.003866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.004046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.004296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.004570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.004724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.004874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.005186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.005526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.005828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.005994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.006095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.006350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.006657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.006844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.007033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.007306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.007573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.007727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.007880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.008158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.008387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.008672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.008834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.008993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.009241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.009557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.009843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.009965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.893 qpair failed and we were unable to recover it. 00:30:40.893 [2024-11-29 14:04:21.010135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.893 [2024-11-29 14:04:21.010302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.010331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.010498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.010651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.010680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.010900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.011200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.011494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.011741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.011894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.012041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.012348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.012646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.012797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.012945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.013275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.013589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.013779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.013942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.014205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.014521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.014850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.014998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.015144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.015400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.015688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.015865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.015970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.016311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.016619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.016867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.016990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.017149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.017493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.017837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.017998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.894 [2024-11-29 14:04:21.018028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.894 qpair failed and we were unable to recover it. 00:30:40.894 [2024-11-29 14:04:21.018174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.018430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.018742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.018915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.019042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.019325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.019600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.019772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.019893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.020177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.020540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.020741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.020911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.021178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.021516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.021790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.021934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.022061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.022372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.022665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.022818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.022942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.023218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.023436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.023713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.023843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.024011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.024300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.024581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.024714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.024869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.025168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.025459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.025812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.025959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.026087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.026183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.026213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.026340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.026468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.895 [2024-11-29 14:04:21.026496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.895 qpair failed and we were unable to recover it. 00:30:40.895 [2024-11-29 14:04:21.026622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.026757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.026786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.026936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.027191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.027476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.027858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.027988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.028189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.028465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.028734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.028885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.028972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.029219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.029503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.029654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.029887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.030256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.030538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.030799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.030951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.031101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.031303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.031333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.031484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.031682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.031709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.031867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.032200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.032493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.032772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.032923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.033031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.033286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.033576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.033847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.033979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.034160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.034476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.034748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.034863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.034990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.035110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.035137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.896 qpair failed and we were unable to recover it. 00:30:40.896 [2024-11-29 14:04:21.035266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.896 [2024-11-29 14:04:21.035443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.035473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.035640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.035770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.035799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.035942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.036292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.036609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.036796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.036940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.037198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.037464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.037779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.037904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.038025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.038347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.038598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.038866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.038984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.039129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.039413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.039758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.039934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.040108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.040411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.040725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.040852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.041029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.041245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.041541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.041805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.041992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.042108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.042318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.042680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.042869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.043025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.043267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.043552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.043744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.897 qpair failed and we were unable to recover it. 00:30:40.897 [2024-11-29 14:04:21.043867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.897 [2024-11-29 14:04:21.044001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.044152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.044466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.044779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.044945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.045109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.045363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.045701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.045891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.046020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.046331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.046605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.046765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.046937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.047215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.047429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.047706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.047882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.048011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.048353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.048726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.048905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.049018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.049281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.049609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.049795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.049910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.050276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.050663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.050835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.050939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.051265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.051531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.898 qpair failed and we were unable to recover it. 00:30:40.898 [2024-11-29 14:04:21.051840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.898 [2024-11-29 14:04:21.051931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.051960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.052164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.052514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.052808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.052962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.053061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.053366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.053654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.053832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.053959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.054224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.054537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.054754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.054905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.055207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.055511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.055817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.055972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.056118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.056427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.056714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.056843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.056942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.057191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.057522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.057826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.057968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.058132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.058442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.058711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.058919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.059043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.059315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.059733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.059873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.060015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.060045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.060191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.060319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.060346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.899 qpair failed and we were unable to recover it. 00:30:40.899 [2024-11-29 14:04:21.060480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.899 [2024-11-29 14:04:21.060641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.060670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.060778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.060982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.061166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.061460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.061796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.061948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.062072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.062319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.062569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.062821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.063000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.063339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.063608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.063773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.063910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.064201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.064472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.064675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.064881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.065214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.065586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.065786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.065942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.066254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.066592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.066748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.066917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.067215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.067517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.067792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.067943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.068083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.068383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.068696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.068824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.068976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.069073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.069099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.069222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.069317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.069348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.900 qpair failed and we were unable to recover it. 00:30:40.900 [2024-11-29 14:04:21.069507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.900 [2024-11-29 14:04:21.069606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.069634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.069776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.069905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.069935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.070083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.070338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.070620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.070869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.070976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.071065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.071297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.071566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.071802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.071977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.072107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.072378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.072705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.072932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.073065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.073425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.073761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.073916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.074044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.074374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.074687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.074841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.074970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.075186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.075511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.075837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.075950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.076074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.076384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.076657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.076857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.077011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.077286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.901 [2024-11-29 14:04:21.077538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.901 [2024-11-29 14:04:21.077688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.901 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.077837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.077977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.078159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.078441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.078677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.078866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.079004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.079288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.079577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.079871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.079992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.080085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.080459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.080787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.080958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.081109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.081454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.081752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.081905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.082051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.082405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.082743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.082971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.083105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.083420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.083666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.083788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.083880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.084246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.084626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.084787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.084962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.085217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.085460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.085688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.085884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.086090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.086223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.086253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.902 [2024-11-29 14:04:21.086408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.086558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.902 [2024-11-29 14:04:21.086586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.902 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.086695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.086792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.086822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.086952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.087279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.087594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.087768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.087896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.088185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.088545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.088796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.088965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.089113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.089387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.089652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.089804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.089957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.090246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.090499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.090749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.090905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.091026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.091261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.091539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.091807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.091974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.092102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.092375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.092663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.092841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.093002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.093287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.093575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.093773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.093935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.094076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.903 [2024-11-29 14:04:21.094106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.903 qpair failed and we were unable to recover it. 00:30:40.903 [2024-11-29 14:04:21.094240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.094372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.094410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.094618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.094767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.094794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.094952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.095228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.095501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.095822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.095974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.096153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.096401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.096768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.096934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.097081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.097478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.097754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.097951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.098051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.098328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.098626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.098778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.098901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.099213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.099561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.099716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.099903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.100168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.100444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.100701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.100826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.100935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.101222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.101501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.101779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.904 [2024-11-29 14:04:21.101898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.904 qpair failed and we were unable to recover it. 00:30:40.904 [2024-11-29 14:04:21.102040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.102375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.102687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.102848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.103029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.103321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.103612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.103786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.103911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.104216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.104543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.104870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.104992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.105142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.105401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.105670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.105814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.105909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.106196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.106522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.106650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.106812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.107152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.107446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.107687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.107830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.107993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.108287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.108605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.108787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.108960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.109272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.109515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.109777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.109983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.110117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.110237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.110263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.110426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.110555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.905 [2024-11-29 14:04:21.110584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.905 qpair failed and we were unable to recover it. 00:30:40.905 [2024-11-29 14:04:21.110744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.110958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.111148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.111453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.111719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.111847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.111994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.112297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.112592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.112733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.112889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.113143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.113476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.113636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.113762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.114990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.115188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.115439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.115667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.115789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.115925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.116165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.116448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.116723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.116847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.116935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.117267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.117537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.117829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.117996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.118166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.118445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.118717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.118902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.119049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.119386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.119644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.119751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.906 qpair failed and we were unable to recover it. 00:30:40.906 [2024-11-29 14:04:21.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.120001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.906 [2024-11-29 14:04:21.120030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.120178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.120490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.120758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.120890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.120985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.121259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.121614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.121878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.121979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.122109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.122423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.122726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.122877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.122997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.123208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.123539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.123825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.123973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.124122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.124414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.124692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.124885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.125462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.125621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.125649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.125769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.125877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.125903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.126052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.126376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.126771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.126891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.127047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.127316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.127619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.127818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.127978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.128283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.128592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.128765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.907 [2024-11-29 14:04:21.128903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.129095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.907 [2024-11-29 14:04:21.129124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.907 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.129293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.129440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.129467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.129589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.129711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.129737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.129875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.129978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.130181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.130476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.130775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.130913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.131062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.131354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:40.908 [2024-11-29 14:04:21.131673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.908 [2024-11-29 14:04:21.131835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:40.908 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.131961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.132234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.132493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.132776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.132936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.133033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.133287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.133568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.133857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.133989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.134160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.134483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.134762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.134919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.135052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.135297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.135621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.135774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.135969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.136258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.136536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.136712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.136866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.137007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.137047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.137197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.137307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.137334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.188 qpair failed and we were unable to recover it. 00:30:41.188 [2024-11-29 14:04:21.137455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.188 [2024-11-29 14:04:21.137606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.137634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.137822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.137961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.137998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.138155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.138437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.138710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.138865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.138963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.139265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.139563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.139752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.139882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.140242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.140588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.140746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.140888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8be980 is same with the state(5) to be set 00:30:41.189 [2024-11-29 14:04:21.141076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.141441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.141723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.141888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.142045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.142370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.142615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.142831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.142991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.143292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.143661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.143856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.144014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.144275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.144556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.144809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.144936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.145059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.145334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.145552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.145816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.145978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.146125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.146214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.189 [2024-11-29 14:04:21.146240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.189 qpair failed and we were unable to recover it. 00:30:41.189 [2024-11-29 14:04:21.146354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.146591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.146866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.146987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.147145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.147424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.147669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.147812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.147946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.148204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.148470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.148728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.148926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.149074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.149314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.149559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.149725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.149934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.150310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.150612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.150773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.150923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.151190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.151471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.151774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.151893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.152026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.152357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.152587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.152755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.152920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.153224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.153527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.153839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.153964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.154005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.154169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.155113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.155148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.190 [2024-11-29 14:04:21.155293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.155474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.190 [2024-11-29 14:04:21.155501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.190 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.155639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.155776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.155818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.155954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.156275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.156592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.156769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.157246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.157531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.157806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.157973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.158079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.159257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.159586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.159797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.159938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.160212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.160517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.160809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.160971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.161117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.161293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.161334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.161493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.161653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.161694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.161854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.161978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.162115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.162420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.162746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.162868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.163012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.163242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.163470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.163749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.163902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.164025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.164285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.164558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.191 qpair failed and we were unable to recover it. 00:30:41.191 [2024-11-29 14:04:21.164771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.191 [2024-11-29 14:04:21.164928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.165040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.165294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.165557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.165708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.165858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.166142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.166425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.166670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.166786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.166918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.167192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.167438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.167698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.167844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.167945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.168255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.168525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.168763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.168911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.169041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.169250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.169494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.169778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.169909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.170067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.170325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.170577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.170792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.170948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.171052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.171173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.171204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.192 qpair failed and we were unable to recover it. 00:30:41.192 [2024-11-29 14:04:21.171332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.192 [2024-11-29 14:04:21.171440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.171468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.171562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.171670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.171698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.171852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.171985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.172141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.172422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.172669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.172894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.172994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.173147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.173414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.173705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.173884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.174010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.174287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.174549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.174772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.174937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.175043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.175324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.175612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.175769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.175926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.176243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.176509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.176790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.176916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.177041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.177297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.177564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.177828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.177978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.178106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.178352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.178582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.193 [2024-11-29 14:04:21.178821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.193 [2024-11-29 14:04:21.178977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.193 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.179096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.179347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.179580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.179767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.179918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.180178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.180454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.180780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.180951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.181055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.181323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.181586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.181838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.181965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.182123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.182366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.182621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.182868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.182989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.183140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.183423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.183754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.183906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.184040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.184306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.184555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.184779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.184933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.185060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.185312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.185538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.185818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.185970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.186097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.186227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.186254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.186382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.186480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.186508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.194 qpair failed and we were unable to recover it. 00:30:41.194 [2024-11-29 14:04:21.186614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.194 [2024-11-29 14:04:21.186743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.186770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.186878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.187155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.187441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.187822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.187987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.188113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.188443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.188666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.188788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.188910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.189187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.189441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.189663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.189845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.189965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.190250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.190490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.190748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.190904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.191003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.191281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.191526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.191790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.191939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.192063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.192331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.192560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.192860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.192990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.193173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.193416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.193690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.193844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.193994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.194121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.194152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.194250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.194371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.195 [2024-11-29 14:04:21.194404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.195 qpair failed and we were unable to recover it. 00:30:41.195 [2024-11-29 14:04:21.194525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.194666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.194696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.194818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.194970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.195133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.195407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.195664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.195826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.195936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.196208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.196471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.196747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.196902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.197040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.197306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.197576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.197824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.197991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.198142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.198362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.198599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.198767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.198902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.199168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.199445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.199693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.199881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.199992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.200217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.200523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.200802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.200968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.201137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.201472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.201772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.201897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.202000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.202165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.202195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.202337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.202445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.196 [2024-11-29 14:04:21.202472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.196 qpair failed and we were unable to recover it. 00:30:41.196 [2024-11-29 14:04:21.202573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.202670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.202696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.202818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.202907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.202933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.203032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.203301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.203553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.203845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.203981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.204125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.204364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.204629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.204837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.204969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.205279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.205544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.205778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.205945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.206079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.206382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.206642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.206766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.206884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.207170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.207468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.207761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.207905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.208017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.208288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.208574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.208818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.208949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.209086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.209212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.209241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.197 qpair failed and we were unable to recover it. 00:30:41.197 [2024-11-29 14:04:21.209389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.209547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.197 [2024-11-29 14:04:21.209574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.209688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.209825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.209853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.209995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.210294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.210856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.210985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.211120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.211414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.211650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.211767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.211893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.212225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.212500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.212771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.212965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.213102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.213360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.213630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.213753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.213862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.214162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.214523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.214749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.214866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.215016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.215263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.215598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.215756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.215878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.216230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.216496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.216761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.216954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.217084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.217360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.198 qpair failed and we were unable to recover it. 00:30:41.198 [2024-11-29 14:04:21.217646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.198 [2024-11-29 14:04:21.217806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.217948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.218229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.218455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.218704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.218862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.218981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.219258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.219582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.219735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.219893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.220151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.220408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.220664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.220816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.220926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.221222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.221540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.221783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.221908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.222032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.222312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.222551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.222800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.222952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.223052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.223371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.223649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.223788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.223937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.224150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.224388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.224618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.224779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.224932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.225212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.199 qpair failed and we were unable to recover it. 00:30:41.199 [2024-11-29 14:04:21.225487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.199 [2024-11-29 14:04:21.225636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.225779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.225927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.225954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.226047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.226300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.226551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.226777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.226971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.227089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.227352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.227637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.227758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.227883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.228158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.228386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.228627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.228893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.228999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.229179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.229439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.229646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.229877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.229996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.230124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.230336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.230585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.230835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.230952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.231095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.231336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.231607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.231861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.231987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.232152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.232435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.232653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.200 qpair failed and we were unable to recover it. 00:30:41.200 [2024-11-29 14:04:21.232874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.200 [2024-11-29 14:04:21.232990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.233105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.233460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.233754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.233930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.234057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.234306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.234602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.234810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.234962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.235289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.235636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.235820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.235961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.236273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.236581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.236807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.236959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.237134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.237441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.237725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.237894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.238072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.238415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.238658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.238828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.239001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.239417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.239651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.239769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.239894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.240147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.240415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.240667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.201 [2024-11-29 14:04:21.240869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.201 qpair failed and we were unable to recover it. 00:30:41.201 [2024-11-29 14:04:21.240955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.241250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.241493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.241792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.241991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.242136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.242430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.242644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.242807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.242935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.243208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.243503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.243762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.243907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.244047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.244356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.244608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.244787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.244927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.245202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.245443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.245698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.245905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.246007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.246325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.246563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.246806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.246950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.247090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.247399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.247738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.247934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.248049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.248304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.202 [2024-11-29 14:04:21.248530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.202 [2024-11-29 14:04:21.248668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.202 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.248793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.248881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.248908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.249052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.249370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.249622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.249781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.249962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.250233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.250503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.250815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.250982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.251159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.251443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.251676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.251884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.252012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.252287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.252553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.252809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.252925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.253078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.253334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.253593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.253750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.253913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.254233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.254532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.254803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.254925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.255031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.255414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.255643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.255803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.255896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.256183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.256442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.203 qpair failed and we were unable to recover it. 00:30:41.203 [2024-11-29 14:04:21.256650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.203 [2024-11-29 14:04:21.256786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.256816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.256994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.257265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.257518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.257753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.257903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.258057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.258295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.258615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.258776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.258930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.259229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.259523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.259794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.259938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.260038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.260262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.260545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.260662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.260854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.261160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.261480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.261712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.261865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.261961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.262273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.262539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.262801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.262954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.263107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.263378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.263633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.263809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.263927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.264176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.264451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.204 qpair failed and we were unable to recover it. 00:30:41.204 [2024-11-29 14:04:21.264661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.204 [2024-11-29 14:04:21.264781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.264806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.264929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.265207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.265453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.265718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.265904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.266020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.266329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.266579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.266827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.266980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.267113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.267345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.267626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.267901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.267995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.268125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.268411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.268698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.268822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.268960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.269278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.269566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.269827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.269945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.270046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.270296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.270545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.270826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.270991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.271167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.271482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.271744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.271892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.272015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.272164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.272189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.272335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.272480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.205 [2024-11-29 14:04:21.272506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.205 qpair failed and we were unable to recover it. 00:30:41.205 [2024-11-29 14:04:21.272613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.272765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.272793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.272964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.273268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.273526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.273821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.273996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.274123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.274441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.274746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.274896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.275024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.275285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.275588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.275848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.275977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.276111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.276417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.276718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.276855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.276954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.277258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.277540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.277718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.277863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.278163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.278454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.278677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.278879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.279145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.279447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.279784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.279977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.280120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.280217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.206 [2024-11-29 14:04:21.280243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.206 qpair failed and we were unable to recover it. 00:30:41.206 [2024-11-29 14:04:21.280444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.280573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.280603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.280769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.280919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.280946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.281072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.281358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.281714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.281944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.282073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.282352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.282666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.282871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.283002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.283330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.283611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.283848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.283974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.284110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.284363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.284608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.284828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.284979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.285132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.285434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.285676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.285830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.285963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.286273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.286567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.286850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.286976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.287091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.287334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.287557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.287830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.287987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.288086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.288208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.288240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.207 [2024-11-29 14:04:21.288406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.288510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.207 [2024-11-29 14:04:21.288538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.207 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.288682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.288774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.288799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.288923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.289225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.289515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.289790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.289907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.290036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.290341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.290715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.290921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.291067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.291285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.291534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.291833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.291990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.292113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.292404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.292739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.292922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.293022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.293314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.293672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.293917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.294010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.294236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.294528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.294804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.294964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.295087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.295404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.295681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.295838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.295963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.296211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.296502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.208 [2024-11-29 14:04:21.296814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-29 14:04:21.296968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.208 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.297096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.297369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.297670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.297889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.298047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.298363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.298736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.298938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.299092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.299360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.299643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.299798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.299954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.300224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.300508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.300786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.300965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.301118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.301238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.301264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.301415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.301598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.301626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.301822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.302197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.302499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.302868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.302974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.303147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.303471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.303824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.303996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.304115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.304445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.304793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.304937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.305066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.305401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.305737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.305912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.209 qpair failed and we were unable to recover it. 00:30:41.209 [2024-11-29 14:04:21.306016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-29 14:04:21.306149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.306175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.306294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.306455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.306482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.306635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.306786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.306812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.306917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.307194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.307505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.307701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.307842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.308163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.308470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.308813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.308968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.309091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.309345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.309665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.309899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.310000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.310315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.310594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.310745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.310903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.311207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.311448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.311795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.311964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.312091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.312380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.312701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.312862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.312989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.313254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.313586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.313789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.313919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.314194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.210 qpair failed and we were unable to recover it. 00:30:41.210 [2024-11-29 14:04:21.314526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-29 14:04:21.314678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.314822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.314978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.315135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.315385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.315740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.315933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.316061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.316340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.316620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.316795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.316944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.317234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.317555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.317841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.317990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.318149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.318498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.318845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.318997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.319130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.319381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.319759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.319899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.320020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.320269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.320628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.320793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.320945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.321195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.321467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.321719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.321848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.321979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.322107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-29 14:04:21.322134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.211 qpair failed and we were unable to recover it. 00:30:41.211 [2024-11-29 14:04:21.322257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.322553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.322821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.322931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.323084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.323294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.323551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.323832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.323977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.324140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.324447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.324783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.324926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.325031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.325346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.325655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.325782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.325909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.326190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.326548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.326795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.326908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.327041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.327289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.327619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.327883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.327973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.328159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.328411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.328761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.328979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.329105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.329378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.329671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.329818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.329916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.330067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.330093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.212 qpair failed and we were unable to recover it. 00:30:41.212 [2024-11-29 14:04:21.330229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.212 [2024-11-29 14:04:21.330377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.330422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.330605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.330746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.330771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.330897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.330996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.331127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.331381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.331730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.331909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.332035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.332304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.332544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.332759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.332910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.333070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.333364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.333674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.333843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.334006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.334288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.334539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.334818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.334967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.335092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.335359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.335616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.335767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.335929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.336204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.336483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.336775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.336958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.337109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.337386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.337633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.337811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.338031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.338058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.338187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.338311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.338337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.213 qpair failed and we were unable to recover it. 00:30:41.213 [2024-11-29 14:04:21.338467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.213 [2024-11-29 14:04:21.338614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.338657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.338776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.338939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.338964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.339073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.339329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.339634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.339810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.339917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.340170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.340480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.340794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.340967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.341067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.341304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.341558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.341796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.341939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.342063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.342366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.342685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.342807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.342935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.343189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.343472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.343721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.343894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.343989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.344287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.344583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.344754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.344907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.345180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.345507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.345702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.345866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.346140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.214 [2024-11-29 14:04:21.346387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.214 [2024-11-29 14:04:21.346619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.214 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.346807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.346926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.346959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.347108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.347409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.347689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.347870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.347995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.348274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.348536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.348841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.348986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.349136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.349389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.349660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.349784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.349914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.350191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.350475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.350767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.350929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.351053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.351327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.351573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.351775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.351904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.352150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.352443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.352690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.215 [2024-11-29 14:04:21.352838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.215 qpair failed and we were unable to recover it. 00:30:41.215 [2024-11-29 14:04:21.352957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.353196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.353467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.353787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.353932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.354064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.354344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.354630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.354780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.354930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.355250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.355532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.355765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.355922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.356153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.356402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.356724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.356872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.357035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.357349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.357639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.357786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.357885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.358180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.358426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.358770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.358941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.359065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.359309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.359629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.359802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.359948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.360226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.360513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.360859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.360976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.361001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.216 [2024-11-29 14:04:21.361122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.361224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.216 [2024-11-29 14:04:21.361251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.216 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.361404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.361552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.361577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.361679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.361792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.361822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.361947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.362239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.362548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.362803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.362939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.363098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.363364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.363705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.363864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.364041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.364317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.364547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.364764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.364886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.365035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.365345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.365660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.365820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.365947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.366242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.366562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.366847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.366967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.367092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.367374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.367706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.367930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.368057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.368355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.368649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.368856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.217 qpair failed and we were unable to recover it. 00:30:41.217 [2024-11-29 14:04:21.368955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.217 [2024-11-29 14:04:21.369043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.369201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.369464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.369782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.369932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.370089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.370366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.370690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.370845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.370968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.371243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.371496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.371799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.371914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.372042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.372316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.372552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.372837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.372960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.373085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.373388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.373710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.373828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.373984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.374256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.374543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.374825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.374952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.375059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.375338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.375619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.375752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.375907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.376152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.376448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.218 [2024-11-29 14:04:21.376626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.218 qpair failed and we were unable to recover it. 00:30:41.218 [2024-11-29 14:04:21.376759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.376911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.376937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.377075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.377347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.377628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.377818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.377945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.378217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.378549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.378852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.378977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.379125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.379378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.379656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.379820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.379927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.380179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.380500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.380791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.380970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.381098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.381374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.381718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.381873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.382001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.382299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.382609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.382838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.382986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.383147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.383405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.383635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.383786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.219 qpair failed and we were unable to recover it. 00:30:41.219 [2024-11-29 14:04:21.383907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.219 [2024-11-29 14:04:21.384002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.384128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.384414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.384689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.384805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.384898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.385175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.385430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.385723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.385915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.386012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.386284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.386613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.386787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.386914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.387234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.387517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.387764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.387966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.388114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.388401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.388731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.388888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.388991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.389301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.389564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.389869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.389986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.390116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.390373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.390675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.390797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.390888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.391040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.220 [2024-11-29 14:04:21.391065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.220 qpair failed and we were unable to recover it. 00:30:41.220 [2024-11-29 14:04:21.391222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.391357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.391388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.391501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.391680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.391708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.391950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.392248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.392529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.392785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.392931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.393057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.393336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.393654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.393822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.393915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.394185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.394481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.394760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.394916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.395075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.395298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.395591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.395756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.395882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.396167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.396494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.396749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.396894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.397027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.397355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.397625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.397754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.397912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.398222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.398489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.398827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.398992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.221 [2024-11-29 14:04:21.399037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.221 qpair failed and we were unable to recover it. 00:30:41.221 [2024-11-29 14:04:21.399169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.399422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.399737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.399955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.400115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.400422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.400757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.400899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.401051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.401293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.401570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.401753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.401879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.402171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.402498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.402800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.402975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.403077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.403335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.403623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.403772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.403896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.404164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.404502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.404757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.404956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.405116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.405406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.405685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.405880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.406004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.406222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.406462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.406717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.406864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.406992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.407118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.407144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.222 [2024-11-29 14:04:21.407242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.407368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.222 [2024-11-29 14:04:21.407404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.222 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.407555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.407753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.407797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.408071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.408375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.408782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.408913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.409039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.409284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.409613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.409807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.409935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.410150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.410424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.410663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.410817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.410965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.411243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.411490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.411703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.411853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.412203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.412418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.412730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.412924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.413043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.413369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.413726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.413967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.414121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.414406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.414742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.414965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.415369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.415727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.415892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.416016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.416138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.416163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.223 qpair failed and we were unable to recover it. 00:30:41.223 [2024-11-29 14:04:21.416316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.223 [2024-11-29 14:04:21.416443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.416470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.416597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.416729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.416756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.416910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.417234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.417574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.417815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.418005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.418212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.418441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.418694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.418837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.418967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.419241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.419533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.419840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.419980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.420130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.420386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.420683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.420856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.420978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.421275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.421608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.421814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.421941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.422222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.422458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.422709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.422829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.423003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.423251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.423505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.423780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.423926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.424054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.424152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.424181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.424282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.424407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.224 [2024-11-29 14:04:21.424435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-29 14:04:21.424538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.424657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.424701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.424829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.424977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.425127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.425425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.425749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.425890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.426018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.426314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.426563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.426836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.426992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.427148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.427467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.427821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.427942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.428048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.428294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.428622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.428903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.428999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.429172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.429451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.429761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.429951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.430107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.430253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.430278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.430448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.430643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.430686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.430835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.430999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.431146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.431404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.431621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.431799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-29 14:04:21.431934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.432060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.225 [2024-11-29 14:04:21.432088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.432185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.432441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.432692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.432836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.432987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.433294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.433550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.433828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.433948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.434077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.434375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.434691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.434883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.434980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.435307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.435632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.435836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.435992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.436274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.436526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.436830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.436975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.437089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.437358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.437642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.437814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.437922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.438161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.438463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.438749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.438921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.439053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.439353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.439668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.439925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.440054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.440178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.226 [2024-11-29 14:04:21.440202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-29 14:04:21.440356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.440479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.440524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.440662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.440829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.440872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.440963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.441254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.441569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.441755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.441902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.442199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.442491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.442726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.442846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.442950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.443223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.443442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.443753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.443907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.444063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.444328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.444661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.444841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.444940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.445215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.445465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.445735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.445881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.446032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.446334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.227 [2024-11-29 14:04:21.446655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.227 [2024-11-29 14:04:21.446823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.227 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.446949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.447257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.447486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.447802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.447949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.448075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.448330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.448606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.507 [2024-11-29 14:04:21.448724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.507 qpair failed and we were unable to recover it. 00:30:41.507 [2024-11-29 14:04:21.448853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.448952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.448978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.449085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.449356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.449605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.449751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.449880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.450209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.450540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.450691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.450821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.451167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.451416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.451662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.451804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.451953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.452170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.452453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.452729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.452889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.453050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.453352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.453667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.453939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.454045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.454325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.454586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.454845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.454993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.455122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.455349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.455620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.455794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.455926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.456152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.456404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.456724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.456871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.508 [2024-11-29 14:04:21.457076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.457228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.508 [2024-11-29 14:04:21.457255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.508 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.457407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.457555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.457598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.457742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.457915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.457941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.458061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.458350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.458688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.458831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.458941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.459239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.459639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.459787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.459931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.460220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.460518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.460846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.460984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.461172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.461473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.461852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.461994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.462183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.462471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.462783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.462971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.463150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.463481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.463749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.463890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.464043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.464378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.464715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.464879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.465011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.465267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.465575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.465751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.465905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.466106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.466135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.509 qpair failed and we were unable to recover it. 00:30:41.509 [2024-11-29 14:04:21.466274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.509 [2024-11-29 14:04:21.466406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.466432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.466527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.466646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.466674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.466794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.466894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.466923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.467085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.467407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.467616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.467759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.467875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.468172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.468433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.468692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.468885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.469026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.469327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.469662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.469836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.470005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.470303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.470623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.470882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.470974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.471158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.471493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.471735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.471878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.472009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.472339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.472616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.472787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.472927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.473200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.473453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.473750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.473899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.474096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.474233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.474261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.510 [2024-11-29 14:04:21.474367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.474510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.510 [2024-11-29 14:04:21.474536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.510 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.474646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.474785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.474813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.474996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.475343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.475618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.475819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.475925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.476243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.476549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.476721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.476881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.477138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.477409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.477710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.477875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.477975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.478246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.478521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.478830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.478964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.479104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.479406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.479645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.479860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.480047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.480352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.480646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.480833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.480999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.481296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.481546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.481837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.481976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.482098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.482388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.482643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.482770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.511 qpair failed and we were unable to recover it. 00:30:41.511 [2024-11-29 14:04:21.482910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.511 [2024-11-29 14:04:21.483011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.483173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.483437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.483681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.483831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.483958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.484283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.484565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.484788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.484930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.485081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.485414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.485655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.485831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.485967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.486326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.486589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.486834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.486975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.487093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.487387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.487815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.488284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.488602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.488874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.488996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.489022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.512 [2024-11-29 14:04:21.489197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.489366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.512 [2024-11-29 14:04:21.489415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.512 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.489570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.489700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.489725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.489818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.489910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.489935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.490035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.490285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.490596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.490862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.490987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.491100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.491343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.491579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.491844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.491978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.492153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.492448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.492737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.492899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.493043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.493349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.493585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.493863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.493985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.494157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.494406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.494884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.494983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.495134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.495425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.495672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.495806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.495946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.496265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.496593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.496740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.513 [2024-11-29 14:04:21.496903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.497032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.513 [2024-11-29 14:04:21.497060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.513 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.497251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.497529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.497800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.497965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.498104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.498388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.498627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.498750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.498889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.499153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.499434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.499697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.499851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.499977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.500219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.500468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.500809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.500971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.501137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.501449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.501667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.501870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.502010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.502343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.502590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.502870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.502989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.503152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.503407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.503780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.503969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.504091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.504457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.504730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.504896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.505011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.505167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.505192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.514 qpair failed and we were unable to recover it. 00:30:41.514 [2024-11-29 14:04:21.505322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.514 [2024-11-29 14:04:21.505413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.505439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.505533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.505656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.505681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.505809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.505930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.505955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.506046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.506310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.506550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.506769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.506909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.507037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.507312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.507545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.507797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.507980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.508080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.508229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.508255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.508425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.508553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.508579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.508802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.508963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.509155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.509390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.509649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.509799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.509933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.510180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.510411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.510658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.510805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.510973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.511264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.511557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.511817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.511957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.512128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.512431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.512680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.512810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.515 qpair failed and we were unable to recover it. 00:30:41.515 [2024-11-29 14:04:21.512984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.513112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.515 [2024-11-29 14:04:21.513137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.513258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.513382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.513415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.513565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.513697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.513725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.513863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.513999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.514172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.514497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.514776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.514948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.515058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.515351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.515700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.515817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.515940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.516195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.516458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.516707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.516824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.516925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.517152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.517404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.517607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.517761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.517891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.518125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.518357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.518640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.518788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.518940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.519250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.519582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.519786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.519954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.520044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.516 [2024-11-29 14:04:21.520069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.516 qpair failed and we were unable to recover it. 00:30:41.516 [2024-11-29 14:04:21.520189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.520501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.520776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.520925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.521022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.521270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.521548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.521700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.521852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.522179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.522427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.522767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.522933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.523078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.523423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.523676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.523789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.523914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.524250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.524627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.524787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.524935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.525254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.525583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.525741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.525891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.526240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.526507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.526823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.526970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.527062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.527658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.527833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.527958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.528276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.517 [2024-11-29 14:04:21.528551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.517 [2024-11-29 14:04:21.528727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.517 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.528826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.528950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.528974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.529074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.529340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.529595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.529767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.529911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.530213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.530556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.530786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.530901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.531003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.531273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.531508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.531780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.531973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.532117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.532421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.532669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.532866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.532998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.533280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.533583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.533839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.533989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.534171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.534431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.534708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.534847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.534969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.535229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.535573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.535810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.535949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.536089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.536206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.536232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.536384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.536485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.536510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.518 qpair failed and we were unable to recover it. 00:30:41.518 [2024-11-29 14:04:21.536624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.518 [2024-11-29 14:04:21.536717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.536743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.536838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.536981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.537184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.537425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.537725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.537868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.537962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.538207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.538502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.538720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.538842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.538944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.539254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.539615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.539777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.539936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.540176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.540414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.540650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.540790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.540961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.541254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.541534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.541806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.541944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.542048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.542299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.542582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.542764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.542881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.543173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.543456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.543789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.543930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.544050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.544184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.544213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.519 qpair failed and we were unable to recover it. 00:30:41.519 [2024-11-29 14:04:21.544332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.544462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.519 [2024-11-29 14:04:21.544487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.544585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.544713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.544738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.544837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.544930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.544955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.545082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.545352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.545570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.545836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.545971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.546146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.546482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.546785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.546960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.547111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.547353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.547609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.547732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.547884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.548138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.548433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.548777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.548897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.549020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.549355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.549668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.549820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.549970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.550201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.550498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.550792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.550933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.551076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.551434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.551720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.551885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.551986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.552077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.552102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.552194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.552314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.520 [2024-11-29 14:04:21.552339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.520 qpair failed and we were unable to recover it. 00:30:41.520 [2024-11-29 14:04:21.552447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.552615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.552640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.552789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.552900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.552941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.553027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.553264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.553556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.553862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.553974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.554063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.554376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.554647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.554847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.554944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.555209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.555412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.555678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.555857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.555987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.556233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.556581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.556840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.556986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.557084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.557340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.557654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.557894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.557986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.558114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.558376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.558659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.558783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.558916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.559037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.559063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.521 qpair failed and we were unable to recover it. 00:30:41.521 [2024-11-29 14:04:21.559165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.559253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.521 [2024-11-29 14:04:21.559278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.559437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.559538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.559563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.559694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.559792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.559817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.559905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.560180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.560507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.560763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.560914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.561015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.561311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.561588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.561869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.561993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.562114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.562412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.562677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.562852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.562973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.563216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.563444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.563722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.563862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.563961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.564248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.564473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.564721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.564870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.564990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.565256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.565512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.565759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.565898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.565999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.566295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.566511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.522 [2024-11-29 14:04:21.566654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.522 qpair failed and we were unable to recover it. 00:30:41.522 [2024-11-29 14:04:21.566805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.566928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.566953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.567056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.567368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.567666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.567813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.567909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.568116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.568351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.568621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.568891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.568981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.569131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.569340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.569559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.569745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.569869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.570145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.570408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.570652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.570896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.570992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.571099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.571366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.571678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.571800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.571949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.572221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.572510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.572753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.572874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.572970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.573214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.573470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.573747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.573890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.523 qpair failed and we were unable to recover it. 00:30:41.523 [2024-11-29 14:04:21.574016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.574108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.523 [2024-11-29 14:04:21.574133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.574265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.574508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.574743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.574902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.575027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.575270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.575551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.575795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.575933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.576055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.576382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.576643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.576814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.576916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.577144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.577412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.577691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.577810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.577933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.578207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.578484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.578706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.578854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.578940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.579190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.579465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.579767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.579918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.580046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.580319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.580527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.580758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.580931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.581083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.581176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.581203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.581323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.581419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.581446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.524 qpair failed and we were unable to recover it. 00:30:41.524 [2024-11-29 14:04:21.581569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.524 [2024-11-29 14:04:21.581671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.581698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.581794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.581879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.581905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.582034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.582301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.582543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.582776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.582924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.583026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.583299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.583567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.583814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.583964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.584062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.584268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.584543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.584801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.584949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.585049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.585363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.585623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.585734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.585887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.586263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.586538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.586812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.586986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.587116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.587378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.587684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.587834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.587986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.588259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.588532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.588811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.588919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.525 qpair failed and we were unable to recover it. 00:30:41.525 [2024-11-29 14:04:21.589044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.525 [2024-11-29 14:04:21.589163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.589188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.589337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.589461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.589489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.589624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.589746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.589771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.589892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.590162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.590434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.590750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.590924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.591025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.591274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.591554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.591795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.591948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.592049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.592254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.592549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.592782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.592906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.593039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.593288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.593598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.593871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.593996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.594145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.594391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.594621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.594829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.594953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.595085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.595346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.526 qpair failed and we were unable to recover it. 00:30:41.526 [2024-11-29 14:04:21.595579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.526 [2024-11-29 14:04:21.595718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.595834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.595929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.595956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.596057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.596280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.596590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.596827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.596951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.597083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.597351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.597629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.597770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.597892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.598160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.598406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.598655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.598807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.598934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.599165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.599487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.599707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.599858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.600002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.600276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.600567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.600873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.600991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.601145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.601390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.601638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.601808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.601889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.602160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.602428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.602666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.602780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.527 [2024-11-29 14:04:21.602930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.603022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.527 [2024-11-29 14:04:21.603046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.527 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.603164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.603418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.603664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.603809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.603935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.604230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.604476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.604787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.604936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.605086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.605347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.605617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.605818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.605970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.606069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.606310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.606569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.606817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.606990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.607135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.607379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.607596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.607826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.607976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.608105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.608341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.608624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.608867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.608991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.609114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.609416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.609669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.609818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.609941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.610149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.528 [2024-11-29 14:04:21.610365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.528 [2024-11-29 14:04:21.610525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.528 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.610654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.610748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.610773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.610901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.610995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.611114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.611316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.611582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.611863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.611986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.612132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.612339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.612545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.612819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.612960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.613063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.613304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.613547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.613818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.613961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.614085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.614335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.614584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.614835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.614996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.615150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.615416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.615654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.615761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.615887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.616154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.616445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.616695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.616815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.616949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.617195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.617483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.529 qpair failed and we were unable to recover it. 00:30:41.529 [2024-11-29 14:04:21.617746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.529 [2024-11-29 14:04:21.617894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.617919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.618049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.618294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.618541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.618763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.618931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.619036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.619280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.619586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.619843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.619953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.620082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.620331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.620577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.620843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.620985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.621110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.621372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.621648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.621784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.621932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.622205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.622425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.622703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.622855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.622984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.623219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.623472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.623737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.623908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.624004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.624255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.530 [2024-11-29 14:04:21.624539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.530 [2024-11-29 14:04:21.624687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.530 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.624789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.624876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.624901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.625053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.625372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.625605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.625847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.625963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.626089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.626375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.626654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.626803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.626935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.627195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.627447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.627688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.627840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.627924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.628191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.628490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.628812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.628979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.629129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.629427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.629732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.629880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.629979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.630313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.630541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.630805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.630912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.631042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.631356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.631653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.631796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.631916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.632191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.531 qpair failed and we were unable to recover it. 00:30:41.531 [2024-11-29 14:04:21.632455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.531 [2024-11-29 14:04:21.632599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.632725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.632877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.632902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.633006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.633240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.633540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.633793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.633967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.634089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.634405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.634640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.634783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.634912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.635165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.635414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.635710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.635879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.636011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.636263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.636546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.636769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.636950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.637082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.637328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.637607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.637871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.637989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.638082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.638389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.638675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.638813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.638936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.639220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.639488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.639794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.639916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.640068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.640179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.640207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.532 qpair failed and we were unable to recover it. 00:30:41.532 [2024-11-29 14:04:21.640331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.532 [2024-11-29 14:04:21.640448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.640475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.640569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.640695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.640720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.640814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.640911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.640938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.641064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.641304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.641564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.641837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.641962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.642110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.642380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.642605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.642865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.642994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.643118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.643365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.643606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.643757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.643878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.644146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.644370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.644619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.644866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.644983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.645108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.645403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.645647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.645763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.645884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.646130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.646409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.646654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.646772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.646892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.647171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.647413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.533 qpair failed and we were unable to recover it. 00:30:41.533 [2024-11-29 14:04:21.647734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.533 [2024-11-29 14:04:21.647824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.647850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.647953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.648253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.648546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.648782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.648937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.649018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.649317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.649565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.649707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.649842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.650127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.650401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.650669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.650889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.650981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.651136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.651438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.651747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.651888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.652015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.652285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.652609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.652849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.652988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.653114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.653365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.653644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.653789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.653886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.654191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.654538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.654755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.654900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.655021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.655139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.655164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.655316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.655421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.534 [2024-11-29 14:04:21.655448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.534 qpair failed and we were unable to recover it. 00:30:41.534 [2024-11-29 14:04:21.655571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.655696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.655721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.655852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.655974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.655999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.656096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.656332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.656566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.656788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.656936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.657063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.657300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.657581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.657822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.657962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.658090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.658340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.658613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.658854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.658976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.659123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.659385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.659704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.659849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.659968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.660236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.660485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.660729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.660841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.660938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.661150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.661390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.661659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.535 [2024-11-29 14:04:21.661893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.661982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.535 [2024-11-29 14:04:21.662007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.535 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.662111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.662379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.662654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.662806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.662919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.663205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.663450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.663685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.663797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.663920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.664188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.664423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.664693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.664840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.664942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.665213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.665437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.665697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.665872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.665994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.666282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.666624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.666772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.666917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.667155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.667418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.667658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.667799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.667951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.668203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.668509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.668724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.668872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.669010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.669135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.669162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.669281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.669404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.669429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.536 qpair failed and we were unable to recover it. 00:30:41.536 [2024-11-29 14:04:21.669549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.536 [2024-11-29 14:04:21.669691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.669719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.669854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.669978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.670004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.670103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.670840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.670875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.671014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.671278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.671523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.671770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.671916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.672041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.672293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.672529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.672831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.672980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.673129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.673410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.673689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.673803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.673952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.674242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.674491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.674706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.674857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.674953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.675207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.675548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.675834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.675976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.676134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.676431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.676707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.676877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.676997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.677204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.677509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.677810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.677965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.537 qpair failed and we were unable to recover it. 00:30:41.537 [2024-11-29 14:04:21.678120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.537 [2024-11-29 14:04:21.678278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.678303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.678405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.678494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.678520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.678636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.678763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.678791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.678970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.679284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.679588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.679827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.679952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.680057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.680310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.680649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.680792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.680915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.681213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.681555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.681707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.681868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.682139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.682462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.682721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.682865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.682986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.683221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.683478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.683727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.683892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.683993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.684211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.684514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.684802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.684919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.685018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.685304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.685575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.538 [2024-11-29 14:04:21.685747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.538 qpair failed and we were unable to recover it. 00:30:41.538 [2024-11-29 14:04:21.685855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.685991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.686159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.686453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.686709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.686869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.687037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.687286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.687532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.687780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.687952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.688097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.688380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.688662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.688825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.688970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.689231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.689460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.689698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.689851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.690040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.690410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.690695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.690834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.691000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.691285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.691604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.691832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.691947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.692098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.692255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.692281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.692374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.696584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.696625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.696751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.696882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.696908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.539 [2024-11-29 14:04:21.697032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.697150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.539 [2024-11-29 14:04:21.697186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.539 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.697292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.697476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.697505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.697657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.697804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.697832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.697965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.698295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.698569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.698837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.698952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.699048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.699259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.699519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.699824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.699942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.700072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.700293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.700573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.700817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.700945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.701081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.701359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.701683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.701851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.701987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.702248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.702508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.702849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.702973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.703120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.703339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.703622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.703820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.540 qpair failed and we were unable to recover it. 00:30:41.540 [2024-11-29 14:04:21.703965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.540 [2024-11-29 14:04:21.704086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.704201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.704517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.704741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.704882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.705015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.705355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.705628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.705775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.705947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.706245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.706547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.706816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.706960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.707095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.707363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.707626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.707797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.707958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.708223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.708479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.708833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.708978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.709153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.709407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.709691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.709840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.709992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.710257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.710603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.710876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.710997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.711176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.711504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.711773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.711923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.541 qpair failed and we were unable to recover it. 00:30:41.541 [2024-11-29 14:04:21.712117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.712262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.541 [2024-11-29 14:04:21.712290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.712409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.712530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.712557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.712670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.712767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.712794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.712915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.713254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.713563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.713806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.713956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.714054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.714404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.714679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.714797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.714905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.715147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.715409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.715692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.715868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.716007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.716277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.716595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.716782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.716902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.717207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.717511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.717791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.717925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.718054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.718322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.718651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.718884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.718983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.719008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.542 qpair failed and we were unable to recover it. 00:30:41.542 [2024-11-29 14:04:21.719126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.719297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.542 [2024-11-29 14:04:21.719326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.719488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.719605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.719631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.719757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.719878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.719905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.720033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.720343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.720626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.720865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.720981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.721074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.721318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.721588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.721808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.721956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.722049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.722316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.722643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.722761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.722884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.723220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.723429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.723744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.723862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.723991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.724538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.724847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.724992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.725113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.725408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.725728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.725884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.725974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.726246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.726518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.543 qpair failed and we were unable to recover it. 00:30:41.543 [2024-11-29 14:04:21.726736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.543 [2024-11-29 14:04:21.726868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.727002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.727226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.727548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.727799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.727969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.728123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.728409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.728678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.728853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.729041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.729281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.729621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.729854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.729968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.730085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.730320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.730634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.730789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.730917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.731155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.731458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.731719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.731866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.731982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.732261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.544 [2024-11-29 14:04:21.732519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.544 [2024-11-29 14:04:21.732665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.544 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.732784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.732908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.732934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.733062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.733365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.733667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.733855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.733988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.734254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.734513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.734763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.734937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.735094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.735407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.735681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.735832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.735954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.736187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.736428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.736678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.736860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.736991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.737263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.737521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.737785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.737942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.738055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.738336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.738590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.738739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.738867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.739239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.739826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.739968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.740062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.740320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.740563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.740742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.545 [2024-11-29 14:04:21.740879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.741024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.545 [2024-11-29 14:04:21.741050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.545 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.741139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.741371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.741687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.741849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.741984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.742272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.742535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.742812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.742927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.743058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.743329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.743613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.743723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.743876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.744131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.744391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.744686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.744872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.744963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.745204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.745536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.745867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.745992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.746090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.746423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.746690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.746843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.746968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.747221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.747561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.747713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.747867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.748191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.748505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.546 qpair failed and we were unable to recover it. 00:30:41.546 [2024-11-29 14:04:21.748759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.546 [2024-11-29 14:04:21.748855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.748881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.749005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.749267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.749547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.749814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.749947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.750127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.750412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.750700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.750888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.751057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.751353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.751619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.751789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.751953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.752257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.752571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.752840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.752955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.753052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.753300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.753586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.753744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.753898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.754225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.754506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.754756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.754877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.755009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.755272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.755574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.755803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.755972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.756090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.756359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.756674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.756832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.756983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.757131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.757157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.757280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.757404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.757435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.547 qpair failed and we were unable to recover it. 00:30:41.547 [2024-11-29 14:04:21.757548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.547 [2024-11-29 14:04:21.757706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.757732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.757882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.757976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.758092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.758368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.758712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.758860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.758987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.759200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.759516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.759795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.759910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.760000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.760309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.760556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.760821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.760997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.761147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.761449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.761704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.761825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.761986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.762248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.762534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.762808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.762949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.763090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.763329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.763597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.763823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.763951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.764051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.764348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.764645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.764783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.764937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.765220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.548 [2024-11-29 14:04:21.765509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.548 [2024-11-29 14:04:21.765626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.548 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.765768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.765893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.765922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.766039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.766296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.766590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.766794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.766922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.767224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.767562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.767881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.767974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.768129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.768341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.768595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.768837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.768989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.769085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.769423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.769628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.769844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.769987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.770094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.770212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.770242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.830 qpair failed and we were unable to recover it. 00:30:41.830 [2024-11-29 14:04:21.770363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.770510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.830 [2024-11-29 14:04:21.770535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.770684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.770768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.770793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.770920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.771132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.771415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.771626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.771760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.771912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.772195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.772439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.772685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.772850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.772939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.773247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.773556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.773759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.773880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.773981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.774244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.774479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.774759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.774899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.775020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.775234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.775548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.775829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.775984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.776109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.776361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.776657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.776829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.776954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.777184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.777402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.777642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.831 [2024-11-29 14:04:21.777814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.831 qpair failed and we were unable to recover it. 00:30:41.831 [2024-11-29 14:04:21.777958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.778208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.778455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.778738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.778900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.778994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.779236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.779532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.779838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.779948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.780044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.780315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.780641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.780855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.780976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.781106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.781325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.781605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.781845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.781991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.782109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.782405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.782742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.782912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.783041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.783356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.783683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.783874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.784025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.784314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.784625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.784794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.784936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.785155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.785402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.832 qpair failed and we were unable to recover it. 00:30:41.832 [2024-11-29 14:04:21.785611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.832 [2024-11-29 14:04:21.785743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.785768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.785868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.786144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.786477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.786763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.786908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.787007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.787288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.787558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.787827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.787973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.788090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.788343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.788629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.788785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.788875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.789162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.789499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.789756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.789931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.790020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.790312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.790632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.790872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.790993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.791169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.791461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.791694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.791877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.792009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.792275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.792550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.792818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.792926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.793046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.793199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.793224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.793344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.793511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.833 [2024-11-29 14:04:21.793537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.833 qpair failed and we were unable to recover it. 00:30:41.833 [2024-11-29 14:04:21.793663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.793811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.793836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.793928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.794221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.794466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.794792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.794915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.795006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.795279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.795554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.795821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.795990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.796111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.796387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.796757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.796981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.797488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.797761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.797985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.798159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.798287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.798316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.798438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.798659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.798698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.798849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.799247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.799505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.799693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.799823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.800178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.800606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.800778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.800915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.801234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.834 qpair failed and we were unable to recover it. 00:30:41.834 [2024-11-29 14:04:21.801505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.834 [2024-11-29 14:04:21.801662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.801832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.801942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.801970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.802112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.802384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.802677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.802834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.802973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.803296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.803590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.803784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.803924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.804157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.804408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.804776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.804987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.805092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.805206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.805231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.805381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.805546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.805576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.805850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.806227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.806441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.806823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.806971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.807092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.807323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.807624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.807837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.807964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.808287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.808624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.808855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.809023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.809269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.809523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.809764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.809898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.810035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.810060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.835 qpair failed and we were unable to recover it. 00:30:41.835 [2024-11-29 14:04:21.810216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.835 [2024-11-29 14:04:21.810333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.810357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.810505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.810689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.810717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.810836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.810980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.811122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.811383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.811780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.811933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.812074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.812366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.812679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.812841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.812984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.813228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.813501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.813772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.813914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.814021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.814291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.814570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.814846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.814997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.815088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.815362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.815634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.815902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.815990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.816109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.816417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.816654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.816866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.816987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.817119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.817349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.817618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.817763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.836 qpair failed and we were unable to recover it. 00:30:41.836 [2024-11-29 14:04:21.817865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.818011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.836 [2024-11-29 14:04:21.818037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.818156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.818484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.818784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.818951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.819045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.819315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.819555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.819820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.819967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.820117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.820405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.820715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.820861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.820957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.821195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.821473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.821695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.821836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.821985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.822241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.822513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.822746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.822916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.823013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.823278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.823542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.823807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.823955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.824040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.824340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.824640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.824762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.824893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.825018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.825043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.825148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.825314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.825342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.837 qpair failed and we were unable to recover it. 00:30:41.837 [2024-11-29 14:04:21.825481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.837 [2024-11-29 14:04:21.825582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.825607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.825730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.825872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.825897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.826022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.826359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.826610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.826759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.826914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.827225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.827498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.827806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.827977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.828127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.828436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.828681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.828800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.828924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.829192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.829470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.829738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.829943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.830065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.830389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.830734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.830906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.830996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.831204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.831448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.831666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.831808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.831960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.832221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.832468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.832780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.832927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.838 [2024-11-29 14:04:21.833026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.833174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.838 [2024-11-29 14:04:21.833199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.838 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.833351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.833451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.833478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.833627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.833747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.833772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.833919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.834180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.834485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.834700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.834810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.834957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.835264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.835608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.835879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.835996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.836126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.836410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.836699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.836815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.836973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.837229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.837520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.837734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.837909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.838031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.838245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.838502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.838827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.838992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.839086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.839401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.839701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.839855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.839 [2024-11-29 14:04:21.839974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.840074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.839 [2024-11-29 14:04:21.840099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.839 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.840198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.840498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.840710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.840823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.840926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.841158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.841390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.841727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.841879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.842006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.842267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.842571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.842806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.842929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.843052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.843320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.843622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.843746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.843872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.844178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.844518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.844782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.844954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.845110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.845384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.845652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.845876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.845995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.846144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.846416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.846661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.846807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.846932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.847163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.840 [2024-11-29 14:04:21.847421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.840 [2024-11-29 14:04:21.847568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.840 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.847723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.847864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.847888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.848010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.848296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.848552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.848805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.848923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.849078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.849404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.849678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.849895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.849980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.850127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.850455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.850669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.850792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.850882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.851182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.851474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.851747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.851882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.852032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.852298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.852613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.852758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.852880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.853156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.853399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.853667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.853781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.853907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.854200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.854484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.854764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.854908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.855057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.855201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.841 [2024-11-29 14:04:21.855230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.841 qpair failed and we were unable to recover it. 00:30:41.841 [2024-11-29 14:04:21.855362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.855544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.855570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.855667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.855788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.855813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.855942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.856194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.856506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.856731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.856846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.856944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.857276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.857563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.857780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.857899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.858025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.858267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.858484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.858775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.858925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.859046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.859279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.859536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.859767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.859917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.860040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.860312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.860555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.860789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.860936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.861096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.861472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.861726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.861906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.862033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.862310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.862574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.842 [2024-11-29 14:04:21.862688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.842 qpair failed and we were unable to recover it. 00:30:41.842 [2024-11-29 14:04:21.862782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.862925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.862950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.863076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.863460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.863682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.863826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.863946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.864235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.864500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.864748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.864867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.864994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.865286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.865587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.865855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.865999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.866159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.866427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.866665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.866833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.866932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.867251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.867646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.867895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.867985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.868160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.868415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.868713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.868860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.868947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.869242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.869524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.869763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.869886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.870013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.870131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.870156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.870285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.870375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.843 [2024-11-29 14:04:21.870407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.843 qpair failed and we were unable to recover it. 00:30:41.843 [2024-11-29 14:04:21.870531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.870617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.870641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.870768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.870914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.870939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.871076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.871373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.871663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.871805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.871956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.872186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.872514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.872779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.872948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.873044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.873338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.873590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.873858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.873978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.874079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.874400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.874693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.874835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.874923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.875189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.875401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.875670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.875790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.875950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.876185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.876460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.876763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.876908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.844 qpair failed and we were unable to recover it. 00:30:41.844 [2024-11-29 14:04:21.877005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.877096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.844 [2024-11-29 14:04:21.877122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.877243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.877550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.877824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.877969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.878064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.878432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.878723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.878865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.879001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.879231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.879471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.879715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.879892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.880025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.880282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.880566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.880813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.880922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.881071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.881322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.881566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.881840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.881985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.882100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.882240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.882267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.882378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.882480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.845 [2024-11-29 14:04:21.882505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.845 qpair failed and we were unable to recover it. 00:30:41.845 [2024-11-29 14:04:21.882630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.882775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.882800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.882936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.883227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.883490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.883727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.883868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.884022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.884290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.884526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.884745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.884896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.885019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.885289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.885559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.885821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.885944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.886075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.886344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.886657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.886802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.886954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.887171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.887435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.846 [2024-11-29 14:04:21.887724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.846 [2024-11-29 14:04:21.887848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.846 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.887975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.888253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.888533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.888770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.888940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.889091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.889434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.889695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.889846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.889969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.890185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.890497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.890746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.890919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.891052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.891333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.891635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.891781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.891873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.892167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.892432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.892668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.892787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.892883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.893006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.847 [2024-11-29 14:04:21.893032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.847 qpair failed and we were unable to recover it. 00:30:41.847 [2024-11-29 14:04:21.893153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.893432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.893707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.893822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.893971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.894179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.894415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.894625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.894740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.894861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.895180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.895489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.895762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.895938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.896065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.896385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.896656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.896814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.896964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.897227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.897486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.897734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.897849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.897963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.898061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.898086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.848 qpair failed and we were unable to recover it. 00:30:41.848 [2024-11-29 14:04:21.898211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.898298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.848 [2024-11-29 14:04:21.898323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.898449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.898571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.898600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.898722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.898814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.898839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.898963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.899205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.899438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.899686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.899811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.899936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.900196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.900443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.900691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.900834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.900933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.901174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.901483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.901784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.901923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.902019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.902232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.902474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.902680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.902834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.902928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.903015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.903040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.849 qpair failed and we were unable to recover it. 00:30:41.849 [2024-11-29 14:04:21.903189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.849 [2024-11-29 14:04:21.903302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.903344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.903469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.903592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.903618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.903724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.903820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.903844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.903939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.904211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.904498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.904749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.904891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.904984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.905266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.905567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.905827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.905977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.906134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.906380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.906674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.906817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.906979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.907135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.907160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.850 qpair failed and we were unable to recover it. 00:30:41.850 [2024-11-29 14:04:21.907274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.850 [2024-11-29 14:04:21.907399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.907423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.907546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.907674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.907699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.907803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.907889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.907913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.908037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.908321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.908561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.908857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.908982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.909136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.909480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.909727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.909901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.910003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.910270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.910545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.910776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.910893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.910985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.911219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.911488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.911742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.911884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.912034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.912154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.912180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.912333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.912484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.851 [2024-11-29 14:04:21.912510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.851 qpair failed and we were unable to recover it. 00:30:41.851 [2024-11-29 14:04:21.912637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.912796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.912821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.912969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.913205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.913551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.913762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.913876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.914023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.914310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.914586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.914848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.914995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.915144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.915479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.915776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.915898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.916049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.916350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.916595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.916818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.916970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.917116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.917450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.917726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.917873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.852 [2024-11-29 14:04:21.917967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.918057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.852 [2024-11-29 14:04:21.918083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.852 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.918205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.918513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.918758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.918904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.919050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.919317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.919632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.919755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.919879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.920212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.920465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.920673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.920813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.920969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.921209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.921492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.921732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.921875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.921993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.922235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.922540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.922812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.922963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.853 qpair failed and we were unable to recover it. 00:30:41.853 [2024-11-29 14:04:21.923081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.853 [2024-11-29 14:04:21.923200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.923228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.923400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.923539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.923564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.923663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.923781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.923805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.923927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.924163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.924455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.924728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.924870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.925030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.925296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.925524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.925773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.925911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.926003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.926258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.926550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.926824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.926944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.927067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.927450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.927716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.927833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.927976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.928245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.928553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.928834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.928992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.929097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.929413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.929671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.929821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.929925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.930017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.854 [2024-11-29 14:04:21.930043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.854 qpair failed and we were unable to recover it. 00:30:41.854 [2024-11-29 14:04:21.930169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.930438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.930685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.930800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.930897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.931134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.931465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.931736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.931880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.931978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.932215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.932487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.932708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.932850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.932952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.933209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.933448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.933727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.933900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.934018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.934289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.934508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.934781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.934931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.935055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.935356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.935701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.935813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.935906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.936195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.936596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.855 qpair failed and we were unable to recover it. 00:30:41.855 [2024-11-29 14:04:21.936894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.855 [2024-11-29 14:04:21.936993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.937177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.937418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.937725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.937893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.937995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.938223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.938443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.938716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.938863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.938992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.939263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.939563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.939808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.939948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.940043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.940260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.940478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.940727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.940871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.941024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.941337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.941584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.941829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.941942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.942040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.942287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.942561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.942810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.942956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.856 qpair failed and we were unable to recover it. 00:30:41.856 [2024-11-29 14:04:21.943050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.943177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.856 [2024-11-29 14:04:21.943202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.943342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.943484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.943509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.943670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.943766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.943790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.943907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.943994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.944119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.944398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.944716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.944865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.944994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.945222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.945496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.945744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.945901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.946052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.946274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.946524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.946767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.946916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.947017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.947250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.947530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.947793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.947966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.948093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.948404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.948682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.948849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.949004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.949247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.949494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.949733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.949906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.950056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.950344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.857 [2024-11-29 14:04:21.950637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.857 [2024-11-29 14:04:21.950794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.857 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.950888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.951132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.951433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.951713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.951855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.951971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.952198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.952564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.952832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.952977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.953138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.953431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.953691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.953845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.953938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.954248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.954492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.954767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.954946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.955044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.955369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.955664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.955872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.955993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.956123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.956444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.956745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.956860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.957007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.957239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.858 qpair failed and we were unable to recover it. 00:30:41.858 [2024-11-29 14:04:21.957504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.858 [2024-11-29 14:04:21.957645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.957740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.957837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.957861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.957989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.958219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.958531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.958806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.958920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.959045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.959289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.959516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.959804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.959928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.960082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.960381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.960671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.960828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.960932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.961215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.961572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.961866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.961987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.962083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.962330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.962568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.962832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.962948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.963070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.963338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.963616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.963736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.963858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.964167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.964467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.964734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.964845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.859 qpair failed and we were unable to recover it. 00:30:41.859 [2024-11-29 14:04:21.964969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.965083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.859 [2024-11-29 14:04:21.965108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.965209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.965441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.965740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.965889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.966042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.966327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.966555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.966824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.966976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.967119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.967389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.967642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.967782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.967909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.968148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.968461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.968707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.968857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.968983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.969261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.969510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.969783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.969926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.970088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.970429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.970677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.970849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.970977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.971188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.971425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.860 [2024-11-29 14:04:21.971697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.860 [2024-11-29 14:04:21.971881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.860 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.972031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.972276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.972565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.972868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.972990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.973105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.973402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.973713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.973860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.973960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.974262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.974547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.974783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.974935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.975038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.975286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.975568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.975852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.975994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.976112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.976402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.976641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.976888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.976985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.977138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.977439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.977701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.977823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.977970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.978094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.978118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.978229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.978383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.978418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.861 qpair failed and we were unable to recover it. 00:30:41.861 [2024-11-29 14:04:21.978537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.861 [2024-11-29 14:04:21.978629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.978653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.978777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.978872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.978895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.979004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.979324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.979545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.979723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.979878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.980117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.980446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.980698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.980871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.980969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.981241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.981519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.981733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.981879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.982034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.982313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.982568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.982816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.982961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.983060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.983322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.983616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.983761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.983857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.984151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.984424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.984668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.984837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.984919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.985180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.985449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.985696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.985839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.862 qpair failed and we were unable to recover it. 00:30:41.862 [2024-11-29 14:04:21.985989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.862 [2024-11-29 14:04:21.986078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.986225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.986541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.986759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.986873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.987004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.987260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.987553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.987777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.987920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.988041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.988250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.988540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.988832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.988979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.989101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.989385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.989682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.989832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.989931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.990176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.990450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.990750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.990891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.991042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.991278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.863 [2024-11-29 14:04:21.991552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.863 [2024-11-29 14:04:21.991709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.863 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.991803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.991950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.991974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.992069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.992313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.992556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.992792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.992909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.993013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.993252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.993557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.993856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.993983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.994099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.994399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.994646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.994820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.994909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.995182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.995495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.995747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.995896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.996048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.996371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.996672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.996783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.997153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.997424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.997703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.997822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.997953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.998252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.998565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.998833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.998982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.999006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.999124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.999272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.999296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.864 qpair failed and we were unable to recover it. 00:30:41.864 [2024-11-29 14:04:21.999424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.864 [2024-11-29 14:04:21.999541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:21.999566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:21.999721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:21.999875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:21.999900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.000000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.000293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.000555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.000824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.000933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.001016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.001252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.001510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.001769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.001940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.002086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.002435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.002691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.002845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.002937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.003212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.003465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.003730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.003880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.004048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.004420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.004776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.004930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.005098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.005375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.005791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.005942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.006109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.006385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.006692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.006864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.007018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.007140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.007165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.007296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.007416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.007466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.865 qpair failed and we were unable to recover it. 00:30:41.865 [2024-11-29 14:04:22.007598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.865 [2024-11-29 14:04:22.007753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.007782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.008005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.008354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.008683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.008934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.009147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.009284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.009309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.009448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.009970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.010195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.010460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.010779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.010936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.011048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.011376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.011687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.011875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.012080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.012374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.012683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.012862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.013001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.013298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.013613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.013808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.013936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.014198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.014448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.014774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.014937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.015060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.015308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.015571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.015816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.015950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.016104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.016191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.016217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.016317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.016417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.016461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.866 qpair failed and we were unable to recover it. 00:30:41.866 [2024-11-29 14:04:22.016679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.866 [2024-11-29 14:04:22.016837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.016865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.017038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.017307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.017647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.017813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.017951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.018211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.018464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.018762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.018967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.019082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.019341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.019628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.019778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.019939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.020206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.020464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.020778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.020995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.021103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.021413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.021716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.021842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.021978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.022255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.022522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.022775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.022932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.023103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.023373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.023731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.023898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.024119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.024421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.024763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.024978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.867 [2024-11-29 14:04:22.025134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.025263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.867 [2024-11-29 14:04:22.025287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.867 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.025419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.025536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.025563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.025733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.026230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.026489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.026739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.026989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.027108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.027417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.027739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.027894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.028017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.028285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.028570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.028737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.028883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.029179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.029420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.029654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.029834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.029922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.030268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.030598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.030721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.030866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.031173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.031436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.031631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.031787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.031912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.032179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.032529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.868 qpair failed and we were unable to recover it. 00:30:41.868 [2024-11-29 14:04:22.032800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.868 [2024-11-29 14:04:22.032888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.032912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.033040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.033315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.033598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.033724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.033853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.034147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.034494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.034765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.034908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.035003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.035276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.035554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.035816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.035963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.036081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.036399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.036767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.036883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.037030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.037303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.037538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.037768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.037939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.038080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.038383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.038758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.038928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.039044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.039313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.039629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.039907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.039998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.040140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.040380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.040584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.869 qpair failed and we were unable to recover it. 00:30:41.869 [2024-11-29 14:04:22.040825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.869 [2024-11-29 14:04:22.040951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.040980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.041098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.041419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.041652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.041824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.041938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.042214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.042490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.042706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.042817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.042941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.043141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.043409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.043621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.043884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.043998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.044114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.044469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.044783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.044928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.045044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.045309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.045577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.045787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.045903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.045996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.046262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.046563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.046813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.046933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.047055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.047375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.047629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.047783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.047899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.048044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.048069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.870 qpair failed and we were unable to recover it. 00:30:41.870 [2024-11-29 14:04:22.048239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.870 [2024-11-29 14:04:22.048347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.048374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.048553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.048639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.048664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.048812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.048909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.048934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.049047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.049359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.049754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.049963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.050116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.050374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.050673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.050819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.050934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.051206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.051451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.051681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.051798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.051951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.052194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.052488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.052752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.052911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.053101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.053425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.053664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.053817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.053909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.054182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.054420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.054719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.054861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.054993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.055297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.055585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.055859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.055991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.056016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.871 [2024-11-29 14:04:22.056118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.056261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.871 [2024-11-29 14:04:22.056286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.871 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.056371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.056613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.056865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.056974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.057109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.057419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.057654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.057837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.057971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.058215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.058481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.058731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.058854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.058978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.059206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.059510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.059722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.059840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.059968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.060267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.060569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.060826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.060971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.061119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.061343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.061601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.061737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.061862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.062134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.062491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.062745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.062889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.872 qpair failed and we were unable to recover it. 00:30:41.872 [2024-11-29 14:04:22.062981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.872 [2024-11-29 14:04:22.063104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.063281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.063499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.063739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.063855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.063982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.064223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.064539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.064703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.064897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.065290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.065576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.065854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.065998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.066117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.066426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.066676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.066792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.066922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.067151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.067385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.067686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.067835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.067961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.068218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.068561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.068842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.068978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.069163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.069467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.069708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.069843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.069996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.070280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.070522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.070737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.873 [2024-11-29 14:04:22.070885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.873 qpair failed and we were unable to recover it. 00:30:41.873 [2024-11-29 14:04:22.071006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.071325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.071591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.071704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.071859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.072175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.072419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.072659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.072804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.072956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.073235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.073597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.073870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.073988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.074121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.074408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.074671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.074784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.074913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.075230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.075529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.075790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.075903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.076050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.076267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.076566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.076837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.076963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.077047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.077338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.077624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.077835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.077984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.078164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.078406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.874 qpair failed and we were unable to recover it. 00:30:41.874 [2024-11-29 14:04:22.078610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.874 [2024-11-29 14:04:22.078759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.078884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.079167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.079488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.079789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.079909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.080011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.080307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.080624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.080889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.080995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.081115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.081381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.081660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.081773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.081890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.082122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.082342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.082587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.082876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.082998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.083147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.083482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.083723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.083867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.083995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.084223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.084429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.084673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.084824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.084910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.085188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.085504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.085768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.085884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.085972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.086115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.086139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.875 qpair failed and we were unable to recover it. 00:30:41.875 [2024-11-29 14:04:22.086283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.086411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.875 [2024-11-29 14:04:22.086436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.086554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.086670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.086695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.086794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.086885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.086910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.087035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.087248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.087490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.087797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.087912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:41.876 qpair failed and we were unable to recover it. 00:30:41.876 [2024-11-29 14:04:22.088040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.876 [2024-11-29 14:04:22.088132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.088172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.089024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.089400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.089692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.089834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.089962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.090204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.090439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.158 [2024-11-29 14:04:22.090555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.158 qpair failed and we were unable to recover it. 00:30:42.158 [2024-11-29 14:04:22.090679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.090828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.090853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.091006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.091261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.091590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.091820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.091968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.092065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.092283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.092552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.092785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.092929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.093025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.093268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.093564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.093811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.093955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.094104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.094375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.094706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.094875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.094967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.095192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.095477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.095713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.095859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.095949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.096228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.096556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.096778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.096890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.096983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.097251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.097498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.097715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.097887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.098020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.098164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.159 [2024-11-29 14:04:22.098190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.159 qpair failed and we were unable to recover it. 00:30:42.159 [2024-11-29 14:04:22.098362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.098511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.098537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.098667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.098801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.098828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.098991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.099325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.099663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.099772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.099865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.100118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.100329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.100603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.100871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.100991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.101080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.101340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.101637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.101778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.101900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.102191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.102453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.102733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.102851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.102946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.103205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.103541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.103712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.103858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.104154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.104455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.104695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.104801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.104888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.105211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.105496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.105777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.105894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.160 [2024-11-29 14:04:22.106019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.106105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.160 [2024-11-29 14:04:22.106130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.160 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.106254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.106371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.106402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.106564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.106709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.106735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.106883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.106992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.107182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.107462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.107676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.107891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.107977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.108126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.108417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.108720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.108841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.108937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.109216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.109540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.109793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.109981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.110156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.110447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.110718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.110831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.110996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.111261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.111557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.111804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.111918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.112044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.112261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.112526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.112803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.112911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.113039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.113315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.113591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.161 [2024-11-29 14:04:22.113873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.161 [2024-11-29 14:04:22.113995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.161 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.114150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.114386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.114655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.114800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.114921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.115192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.115445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.115752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.115868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.115987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.116226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.116474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.116739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.116895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.117021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.117372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.117659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.117860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.117975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.118066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.118329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.118607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.118878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.118982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.119123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.119371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.119650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.119823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.119954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.120293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.120606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.120765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.120859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.121151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.121428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.162 qpair failed and we were unable to recover it. 00:30:42.162 [2024-11-29 14:04:22.121670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.162 [2024-11-29 14:04:22.121807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.121907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.121994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.122113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.122317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.122618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.122724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.122872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.123165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.123402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.123657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.123801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.123895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.124223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.124442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.124673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.124784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.124903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.125154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.125422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.125655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.125824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.125977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.126072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.126097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.126235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.126475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.163 [2024-11-29 14:04:22.126501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.163 qpair failed and we were unable to recover it. 00:30:42.163 [2024-11-29 14:04:22.126651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.126742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.126768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.126994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.127322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.127596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.127795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.127948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.128246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.128543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.128764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.128869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.129157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.129399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.129655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.129775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.129879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.130184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.130482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.130828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.130978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.131158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.131405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.131700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.131903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.132065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.132369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.132695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.132862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.132985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.133303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.133532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.133809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.133957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.134115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.134250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.134275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.134429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.134581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.134605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.134772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.134955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.135020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.164 [2024-11-29 14:04:22.135142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.135239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.164 [2024-11-29 14:04:22.135264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.164 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.135383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.135502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.135527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.135636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.135754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.135779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.135905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.136154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.136403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.136671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.136801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.136900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.137141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.137420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.137692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.137840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.137971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.138247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.138627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.138944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.139098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.139298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.139325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.139475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.139656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.139684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.139847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.139999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.140170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.140502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.140831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.140985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.141086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.141341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.141641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.141833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.141962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.142291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.142537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.142742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.142866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.143248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.143524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.143696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.165 qpair failed and we were unable to recover it. 00:30:42.165 [2024-11-29 14:04:22.143850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.165 [2024-11-29 14:04:22.144003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.144156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.144369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.144679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.144825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.144917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.145223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.145478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.145729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.145850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.145977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.146245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.146513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.146771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.146934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.147086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.147389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.147723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.147902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.148003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.148327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.148537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.148730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.148878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.149143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.149506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.149721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.149923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.150096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.150183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.150326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.150494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.150545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.150749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.150986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.151046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.151219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.151342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.151366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.151511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.151650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.151678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.151864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.152134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.152185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.152328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.152463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.152489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.166 qpair failed and we were unable to recover it. 00:30:42.166 [2024-11-29 14:04:22.152635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.166 [2024-11-29 14:04:22.152825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.152878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.153006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.153294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.153692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.153917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.154039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.154283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.154549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.154838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.154978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.155131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.155254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.155279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.155430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.155619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.155647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.155904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.156209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.156478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.156795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.156964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.157342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.157693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.157853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.158035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.158347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.158815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.158993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.159130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.159478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.159722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.159860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.159994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.160290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.160624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.160846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.160966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.161236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.161500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.161712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.161877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.162049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.162096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.167 qpair failed and we were unable to recover it. 00:30:42.167 [2024-11-29 14:04:22.162243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.162400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.167 [2024-11-29 14:04:22.162425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.162565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.162662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.162689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.162849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.162995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.163116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.163357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.163690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.163946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.164080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.164376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.164685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.164951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.165073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.165310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.165584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.165802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.165951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.166070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.166329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.166630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.166780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.166898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.167132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.167420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.167641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.167873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.167990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.168136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.168413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.168708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.168851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.168946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.169092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.169117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.169271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.169400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.169426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.168 qpair failed and we were unable to recover it. 00:30:42.168 [2024-11-29 14:04:22.169550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.168 [2024-11-29 14:04:22.169694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.169719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.169823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.169944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.169970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.170056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.170296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.170570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.170833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.170981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.171077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.171289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.171540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.171762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.171906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.171999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.172210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.172486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.172755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.172876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.172997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.173240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.173538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.173714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.173911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.174275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.174623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.174833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.174969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.175069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.175303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.175603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.175846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.175959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.176085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.176310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.176561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.176792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.176909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.169 qpair failed and we were unable to recover it. 00:30:42.169 [2024-11-29 14:04:22.177006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.169 [2024-11-29 14:04:22.177125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.177337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.177603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.177872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.177997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.178149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.178401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.178668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.178789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.178885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.179145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.179498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.179801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.179950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.180087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.180419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.180747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.180874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.181023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.181258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.181597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.181868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.181990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.182175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.182461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.182741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.182881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.182971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.183237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.183509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.183749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.183923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.184020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.184260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.184473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.184753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.184899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.170 qpair failed and we were unable to recover it. 00:30:42.170 [2024-11-29 14:04:22.184994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.170 [2024-11-29 14:04:22.185141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.185166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.185289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.185443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.185469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.185620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.185768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.185792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.185921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.186155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.186420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.186640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.186783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.186908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.187222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.187556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.187823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.187947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.188043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.188316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.188533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.188770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.188884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.189008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.189275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.189593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.189855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.189994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.190084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.190353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.190592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.190861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.190984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.191107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.191299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.191592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.191765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.191888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.192191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.192438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.171 qpair failed and we were unable to recover it. 00:30:42.171 [2024-11-29 14:04:22.192698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.171 [2024-11-29 14:04:22.192813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.192838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.192958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.193261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.193591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.193825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.193968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.194065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.194391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.194603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.194754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.194888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.195159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.195436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.195640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.195790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.195912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.196144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.196505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.196789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.196960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.197158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.197493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.197763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.197913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.198033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.198333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.198602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.198843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.198990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.199090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.199349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.199619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.199774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.172 qpair failed and we were unable to recover it. 00:30:42.172 [2024-11-29 14:04:22.199897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.200018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.172 [2024-11-29 14:04:22.200042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.200172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.200453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.200724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.200895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.200989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.201258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.201525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.201764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.201884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.202003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.202275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.202584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.202792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.202962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.203087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.203356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.203636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.203788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.203910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.204206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.204584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.204850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.204957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.205049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.205330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.205579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.205843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.205987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.206137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.206373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.206643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.206796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.206920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.207183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.207473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.173 qpair failed and we were unable to recover it. 00:30:42.173 [2024-11-29 14:04:22.207777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.173 [2024-11-29 14:04:22.207939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.208060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.208414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.208735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.208910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.208997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.209230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.209523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.209823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.209945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.210092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.210479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.210725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.210896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.211019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.211283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.211527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.211826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.211953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.212048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.212319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.212642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.212771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.212907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.213321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.213644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.213789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.213911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.214166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.214447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.214725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.214874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.215030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.215281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.215545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.215847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.215979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.216004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.174 [2024-11-29 14:04:22.216124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.216263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.174 [2024-11-29 14:04:22.216304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.174 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.216425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.216522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.216549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.216709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.216800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.216824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.216941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.217239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.217517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.217767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.217878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.218025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.218285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.218608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.218809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.218977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.219070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.219290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.219558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.219845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.219992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.220078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.220377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.220647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.220787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.220939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.221210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.221536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.221835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.221984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.222138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.222487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.222746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.222866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.222967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.223212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.223516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.223759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.223908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.175 [2024-11-29 14:04:22.223997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.224097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.175 [2024-11-29 14:04:22.224123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.175 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.224241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.224515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.224750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.224858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.224962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.225254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.225588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.225878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.225980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.226138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.226422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.226694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.226873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.226961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.227213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.227481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.227800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.227990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.228159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.228563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.228776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.228928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.229032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.229362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.229602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.229865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.229977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.230062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.230348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.230615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.230834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.230979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.231155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.231427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.231643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.176 qpair failed and we were unable to recover it. 00:30:42.176 [2024-11-29 14:04:22.231909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.176 [2024-11-29 14:04:22.231999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.232114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.232390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.232623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.232761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.233158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.233415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.233717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.233835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.233955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.234216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.234491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.234707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.234890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.234987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.235222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.235480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.235713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.235887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.236046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.236331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.236583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.236807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.236929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.237061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.237327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.237629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.237857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.237999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.238130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.238266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.238293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.238438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.238552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.238577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.177 qpair failed and we were unable to recover it. 00:30:42.177 [2024-11-29 14:04:22.238682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.177 [2024-11-29 14:04:22.238794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.238819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.238941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.239185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.239439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.239748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.239890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.240023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.240284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.240543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.240775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.240903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.240987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.241274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.241515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.241762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.241934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.242060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.242317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.242560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.242795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.242968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.243062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.243308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.243568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.243806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.243955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.244105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.244366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.244594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.244873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.244996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.245207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.245463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.245712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.245857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.245952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.246070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.246095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.178 qpair failed and we were unable to recover it. 00:30:42.178 [2024-11-29 14:04:22.246215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.178 [2024-11-29 14:04:22.246331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.246356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.246450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.246549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.246575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.246693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.246838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.246862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.246979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.247260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.247623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.247769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.247894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.248186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.248462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.248790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.248929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.249030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.249298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.249613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.249763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.249893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.250119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.250397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.250644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.250798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.250916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.251188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.251491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.251777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.251959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.252055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.252321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.252599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.252767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.252899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.253153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.253442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.253659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.253834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.253999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.254118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.254143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.179 qpair failed and we were unable to recover it. 00:30:42.179 [2024-11-29 14:04:22.254292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.179 [2024-11-29 14:04:22.254446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.254473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.254573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.254720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.254745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.254844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.254960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.254985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.255114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.255398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.255655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.255803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.255898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.256238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.256543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.256815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.256933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.257026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.257275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.257547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.257818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.257962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.258070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.258343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.258626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.258755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.258887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.259157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.259440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.259690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.259857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.259944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.260230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.260494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.260972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.261099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.261440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.261735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.261912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.262008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.262098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.262123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.180 qpair failed and we were unable to recover it. 00:30:42.180 [2024-11-29 14:04:22.262240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.180 [2024-11-29 14:04:22.262323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.262348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.262496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.262592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.262619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.262730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.262834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.262859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.262982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.263276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.263523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.263807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.263925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.264027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.264309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.264550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.264692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.264852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.265130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.265369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.265582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.265727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.265882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.266175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.266497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.266808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.266990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.267149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.267451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.267691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.267839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.267941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.268189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.268461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.268733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.268878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.268995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.269119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.269144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-29 14:04:22.269295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.269465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.181 [2024-11-29 14:04:22.269491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.269613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.269744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.269769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.269885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.269981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.270135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.270379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.270600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.270745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.270893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.271135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.271431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.271723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.271838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.271960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.272266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.272576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.272847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.272970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.273099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.273446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.273663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.273875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.273988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.274075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.274345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.274618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.274860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.274992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.275142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.275463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.275750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.275889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.275991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.276224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.276482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.276768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.276922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-29 14:04:22.277075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.277168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.182 [2024-11-29 14:04:22.277192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.277322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.277446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.277472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.277599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.277689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.277714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.277840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.277988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.278145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.278492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.278785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.278945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.279065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.279357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.279651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.279837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.279956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.280190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.280443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.280684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.280800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.280921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.281215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.281533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.281804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.281993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.282123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.282418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.282662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.282808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.282925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.283189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.283436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.283688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.283845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.283944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.284260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.284530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.284826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.284980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-29 14:04:22.285069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.285218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.183 [2024-11-29 14:04:22.285246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.285438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.285557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.285583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.285709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.285820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.285845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.285965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.286232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.286489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.286770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.286954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.287103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.287350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.287637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.287810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.287939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.288238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.288592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.288837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.288978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.289107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.289419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.289720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.289881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.289985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.290320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.290595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.290843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.290991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.291137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.291464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.291749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.291894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.292018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.292275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.292553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.292774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.292915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.293013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.293144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.293168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.184 [2024-11-29 14:04:22.293266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.293413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.184 [2024-11-29 14:04:22.293442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.184 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.293539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.293665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.293691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.293817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.293971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.293995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.294086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.294451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.294717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.294843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.294948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.295209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.295478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.295760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.295904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.296029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.296288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.296555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.296851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.296972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.297065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.297361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.297643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.297763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.297897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.298153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.298471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.298763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.298907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.299041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.299328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.299549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.299836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.299957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.300057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.300179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.300204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.300328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.300438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.300464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.301421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.301576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.301603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.301755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.301868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.301893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.185 [2024-11-29 14:04:22.302017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.302108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.185 [2024-11-29 14:04:22.302133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.185 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.302255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.302503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.302766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.302907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.303026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.303322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.303570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.303874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.303996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.304153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.304460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.304696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.304816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.304968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.305254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.305548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.305954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.306112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.306401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.306713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.306913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.307115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.307368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.307650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.307871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.307990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.308138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.308516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.308774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.308951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.309079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.309207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.309232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.186 qpair failed and we were unable to recover it. 00:30:42.186 [2024-11-29 14:04:22.309326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.186 [2024-11-29 14:04:22.309447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.309473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.309598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.309729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.309754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.309883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.310161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.310465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.310747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.310867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.310994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.311321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.311583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.311729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.311853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.312173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.312551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.312709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.312882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.313309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.313670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.313819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.313983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.314191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.314503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.314755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.314933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.315057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.315406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.315756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.315871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.316007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.316269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.316515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.316774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.316951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.317108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.317428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.317750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.317871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.187 qpair failed and we were unable to recover it. 00:30:42.187 [2024-11-29 14:04:22.317992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.187 [2024-11-29 14:04:22.318092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.318214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.318555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.318823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.318937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.319040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.319309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.319604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.319781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.319888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.320152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.320390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.320655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.320778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.320915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.321193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.321531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.321779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.321916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.322011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.322326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.322629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.322808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.322903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.323177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.323448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.323704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.323829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.323951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.324242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.324504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.324743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.324892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.325031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.325261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.325591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.325736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.188 qpair failed and we were unable to recover it. 00:30:42.188 [2024-11-29 14:04:22.325878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.188 [2024-11-29 14:04:22.326004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.326166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.326486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.326785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.326939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.327100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.327432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.327730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.327846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.327939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.328178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.328449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.328716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.328835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.328969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.329216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.329521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.329799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.329954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.330061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.330388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.330728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.330882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.331035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.331289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.331604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.331768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.331929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.332212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.332487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.332814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.332960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.333067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.333298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.333544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.333823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.333989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.189 [2024-11-29 14:04:22.334016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.189 qpair failed and we were unable to recover it. 00:30:42.189 [2024-11-29 14:04:22.334139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.334391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.334637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.334752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.334872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.335182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.335511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.335775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.335977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.336131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.336427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.336710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.336909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.337078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.337428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.337691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.337850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.338048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.338357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.338638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.338747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.338866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.339182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.339493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.339790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.339933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.340061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.340380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.340620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.340787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.340909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.341049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.341076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.341256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.341400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.341444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.190 qpair failed and we were unable to recover it. 00:30:42.190 [2024-11-29 14:04:22.341571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.190 [2024-11-29 14:04:22.341690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.341733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.341853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.341953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.341980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.342083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.342426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.342679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.342880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.343000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.343306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.343624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.343760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.343887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.344198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.344458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.344691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.344889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.345041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.345336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.345599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.345808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.345966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.346282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.346591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.346732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.346872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.347154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.347488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.347712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.347903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.348005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.348307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.348575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.348823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.348998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.349099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.349423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.191 [2024-11-29 14:04:22.349782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.191 [2024-11-29 14:04:22.349962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.191 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.350141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.350301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.350328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.351115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.351484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.351789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.351949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.352062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.352420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.352642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.352829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.352975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.353294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.353583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.353724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.353892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.354210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.354509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.354788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.354956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.355088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.355433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.355757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.355969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.356101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.356383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.356650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.356865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.356978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.357297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.357593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.357847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.357994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.358164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.358450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.358697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.358834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.358943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.359099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.359127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.192 qpair failed and we were unable to recover it. 00:30:42.192 [2024-11-29 14:04:22.359265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.359442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.192 [2024-11-29 14:04:22.359469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.359560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.359642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.359667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.359789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.359947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.359976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.360114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.360376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.360650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.360839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.360945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.361265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.361546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.361712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.361872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.362129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.362430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.362828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.362951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.363116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.363397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.363673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.363836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.364006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.364277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.364605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.364827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.364994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.365182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.365427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.365716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.365901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.366064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.366332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.366597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.366750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.366888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.367215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.367510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.193 qpair failed and we were unable to recover it. 00:30:42.193 [2024-11-29 14:04:22.367845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.193 [2024-11-29 14:04:22.367951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.367979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.368112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.368379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.368678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.368849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.369010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.369318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.369572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.369785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.369925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.370216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.370538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.370692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.370855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.371148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.371416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.371678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.371821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.371964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.372291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.372551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.372851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.372977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.373151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.373462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.373798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.373946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.374069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.374346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.374620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.374853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.374987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.375165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.375478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.375769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.375930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.376075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.376226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.194 [2024-11-29 14:04:22.376253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.194 qpair failed and we were unable to recover it. 00:30:42.194 [2024-11-29 14:04:22.376386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.376512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.376537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.376665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.376794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.376818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.376915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.377168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.377506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.377807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.377964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.378145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.378428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.378740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.378856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.378973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.379285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.379541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.379795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.379939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.380052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.380331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.380576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.380772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.380911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.381215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.381519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.381828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.381991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.382134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.382450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.382708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.382874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.383039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.383364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.195 qpair failed and we were unable to recover it. 00:30:42.195 [2024-11-29 14:04:22.383664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.195 [2024-11-29 14:04:22.383809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.383946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.384225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.384484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.384728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.384929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.385061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.385302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.385628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.385888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.385979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.386155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.386487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.386781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.386933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.387081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.387314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.387553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.387851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.387972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.388191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.388438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.388677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.388854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.388996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.389264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.389586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.389769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.389912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.390221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.390550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.390817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.390971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.391067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.391373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.196 [2024-11-29 14:04:22.391722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.196 [2024-11-29 14:04:22.391919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.196 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.392066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.392369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.392687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.392831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.392948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.393273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.393542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.393867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.393985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.394127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.394398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.394688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.394856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.394972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.395245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.395607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.395771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.395888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.396179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.396435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.396757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.396871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.396994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.397218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.397580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.397775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.397907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.398174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.398509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.398841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.398987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.399151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.399419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.399700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.399819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.399981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.400069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.400096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.197 qpair failed and we were unable to recover it. 00:30:42.197 [2024-11-29 14:04:22.400201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.400301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.197 [2024-11-29 14:04:22.400328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.400488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.400624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.400652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.400795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.400912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.400937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.401077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.401371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.401658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.401835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.401957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.402224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.402567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.402735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.402875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.403195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.403452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.403801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.403959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.404106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.404405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.404753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.404885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.405028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.405312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.405658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.405850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.406000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.406266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.406632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.406755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.406877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.407204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.407502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.407764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.407902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.408044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.408351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.408657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.198 [2024-11-29 14:04:22.408812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.198 qpair failed and we were unable to recover it. 00:30:42.198 [2024-11-29 14:04:22.408999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.409259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.409560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.409872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.409975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.410182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.410423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.410689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.410861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.411017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.411293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.411566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.411803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.411926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.412049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.412266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.412576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.412829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.412988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.413097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.413364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.413666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.413774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.413929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.414149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.414437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.414764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.414935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.415070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.415321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.199 qpair failed and we were unable to recover it. 00:30:42.199 [2024-11-29 14:04:22.415628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.199 [2024-11-29 14:04:22.415800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.415979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.416246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.416512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.416767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.416938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.417095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.417369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.417667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.417820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.417946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.418225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.418543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.418826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.418993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.419089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.419400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.419639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.419826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.419959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.420260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.504 qpair failed and we were unable to recover it. 00:30:42.504 [2024-11-29 14:04:22.420579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.504 [2024-11-29 14:04:22.420724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.420897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.421168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.421437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.421747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.421895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.422052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.422373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.422673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.422827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.422947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.423247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.423552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.423846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.423977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.424089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.424421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.424755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.424897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.425022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.425277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.425586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.425753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.425892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.426197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.426502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.426810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.426925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.427059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.427178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.427203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.505 [2024-11-29 14:04:22.427344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.427479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.505 [2024-11-29 14:04:22.427509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.505 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.427660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.427782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.427806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.427986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.428264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.428595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.428877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.428999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.429118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.429391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.429677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.429863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.430005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.430358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.430663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.430794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.430908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.431149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.431449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.431746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.431926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.432096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.432403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.432757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.432903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.433014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.433334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.433612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.433781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.506 [2024-11-29 14:04:22.433940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.434067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.506 [2024-11-29 14:04:22.434092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.506 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.434247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.434561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.434848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.434997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.435143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.435425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.435683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.435810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.435929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.436210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.436498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.436729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.436886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.437004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.437269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.437598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.437746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.437872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.438161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.438489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.438728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.438893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.438999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.439299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.439618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.439863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.439981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.440008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.440150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.440277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.507 [2024-11-29 14:04:22.440304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.507 qpair failed and we were unable to recover it. 00:30:42.507 [2024-11-29 14:04:22.440449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.440571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.440600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.440749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.440911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.440938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.441064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.441341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.441602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.441740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.441876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.442168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.442480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.442783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.442971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.443124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.443354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.443808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.443994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.444137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.444460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.444758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.444896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.444996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.445273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.445552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.445844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.445997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.446160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.446462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.508 qpair failed and we were unable to recover it. 00:30:42.508 [2024-11-29 14:04:22.446734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.508 [2024-11-29 14:04:22.446861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.447009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.447295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.447573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.447849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.447982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.448105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.448405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.448729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.448853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.448981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.449232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.449570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.449736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.449879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.450134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.450436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.450759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.450931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.451056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.451379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.451685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.451821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.451928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.452200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.452491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.452810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.509 [2024-11-29 14:04:22.452969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.509 qpair failed and we were unable to recover it. 00:30:42.509 [2024-11-29 14:04:22.453116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.453405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.453712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.453860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.453999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.454254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.454561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.454824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.454981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.455126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.455419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.455756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.455860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.455972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.456286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.456590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.456868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.456992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.457164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.457491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.457776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.457943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.458086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.458188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.510 [2024-11-29 14:04:22.458213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.510 qpair failed and we were unable to recover it. 00:30:42.510 [2024-11-29 14:04:22.458347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.458507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.458533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.458628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.458751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.458791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.458923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.459283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.459611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.459795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.459907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.460238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.460543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.460777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.460920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.461089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.461425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.461675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.461815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.461937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.462222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.462521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.462766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.462912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.463067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.463379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.463683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.463846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.464001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.464127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.464152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.464317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.464483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.511 [2024-11-29 14:04:22.464514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.511 qpair failed and we were unable to recover it. 00:30:42.511 [2024-11-29 14:04:22.464643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.464743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.464769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.464929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.465223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.465584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.465843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.465994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.466173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.466484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.466730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.466906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.467061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.467374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.467648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.467857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.467976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.468126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.468375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.468653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.468807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.468935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.469183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.469389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.469666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.469781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.469875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.470212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.512 qpair failed and we were unable to recover it. 00:30:42.512 [2024-11-29 14:04:22.470569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.512 [2024-11-29 14:04:22.470750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.470877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.470976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.471120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.471440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.471764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.471915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.472042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.472309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.472574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.472847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.472986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.473144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.473447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.473723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.473845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.473971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.474228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.474455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.474755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.474898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.475020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.475366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.475667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.475796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.475891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.476128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.476379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.513 qpair failed and we were unable to recover it. 00:30:42.513 [2024-11-29 14:04:22.476699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.513 [2024-11-29 14:04:22.476819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.476844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.476971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.477192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.477531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.477748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.477927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.478026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.478262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.478590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.478858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.478977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.479118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.479404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.479753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.479902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.480052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.480378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.480675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.480854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.480981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.481279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.481537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.481807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.481933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.482054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.482419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.514 [2024-11-29 14:04:22.482690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.514 [2024-11-29 14:04:22.482838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.514 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.482931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.483203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.483517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.483766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.483886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.484018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.484265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.484542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.484817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.484961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.485116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.485354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.485614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.485762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.485911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.486151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.486426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.486762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.486916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.487043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.487289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.487547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.487832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.487985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.488075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.488197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.488225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.488340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.488476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.488502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.515 qpair failed and we were unable to recover it. 00:30:42.515 [2024-11-29 14:04:22.488632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.515 [2024-11-29 14:04:22.488756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.488781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.488902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.489154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.489440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.489697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.489848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.489975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.490194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.490463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.490716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.490872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.490967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.491230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.491604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.491854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.491976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.492125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.492459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.492752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.492871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.493028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.493153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.493178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.493300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.493423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.493449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.516 qpair failed and we were unable to recover it. 00:30:42.516 [2024-11-29 14:04:22.493545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.516 [2024-11-29 14:04:22.493669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.493695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.493823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.493946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.493972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.494101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.494415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.494739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.494886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.495008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.495262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.495541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.495781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.495955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.496048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.496372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.496666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.496785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.496912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.497246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.497527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.497806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.497948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.498081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.498435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.498744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.498893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.499019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.499300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.499600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-29 14:04:22.499722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.517 qpair failed and we were unable to recover it. 00:30:42.517 [2024-11-29 14:04:22.499845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.499933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.499958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.500048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.500263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.500552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.500862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.500983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.501108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.501407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.501626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.501771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.501905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.502202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.502542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.502793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.502946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.503074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.503441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.503691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.503837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.503933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.504150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.504475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.504753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.504894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.505014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.505368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.518 [2024-11-29 14:04:22.505642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-29 14:04:22.505795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.518 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.505913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.506133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.506461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.506700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.506932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.507081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.507345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.507647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.507764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.507911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.508252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.508633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.508830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.509014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.509311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.509566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.509796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.509908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.510173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.510442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.510738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.510889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.511014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.511257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.511545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.511757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.511901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.512001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.512124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.512149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.512274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.512404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-29 14:04:22.512431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.519 qpair failed and we were unable to recover it. 00:30:42.519 [2024-11-29 14:04:22.512582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.512747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.512792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.512915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.513224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.513520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.513678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.513818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.514150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.514402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.514778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.514983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.515095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.515349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.515728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.515935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.516039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.516302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.516591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.516780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.516911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.517179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.517457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.517811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.517944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.518045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.518313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.518631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.518853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.520 qpair failed and we were unable to recover it. 00:30:42.520 [2024-11-29 14:04:22.518986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-29 14:04:22.519102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.519127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.519250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.519377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.519410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.519560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.519784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.519812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.519978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.520262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.520538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.520747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.520881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.521204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.521424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.521747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.521974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.522139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.522363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.522714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.522881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.523049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.523334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.523708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.523879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.524008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.524274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.524526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.524788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.524954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.525275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.521 [2024-11-29 14:04:22.525558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.521 [2024-11-29 14:04:22.525718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.521 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.525882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.526221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.526526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.526677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.526824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.527296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.527803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.527941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.528184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.528521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.528688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.528891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.529228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.529529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.529732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.529910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.530231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.530509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.530753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.530897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.531026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.531328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.531577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.522 qpair failed and we were unable to recover it. 00:30:42.522 [2024-11-29 14:04:22.531853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.522 [2024-11-29 14:04:22.531980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.532131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.532399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.532704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.532847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.532945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.533219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.533508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.533777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.533930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.534054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.534295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.534543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.534766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.534941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.535036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.535321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.535646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.535760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.535880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.536179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.536410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.536676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.536827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.536962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.537338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.537672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.537849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.523 qpair failed and we were unable to recover it. 00:30:42.523 [2024-11-29 14:04:22.537983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.538102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.523 [2024-11-29 14:04:22.538128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.538262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.538361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.538388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.538543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.538759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.538785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.538958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.539227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.539524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.539761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.539911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.540176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.540420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.540724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.540890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.540996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.541314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.541555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.541828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.541971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.542067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.542339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.542612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.542885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.542981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.543136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.543382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.543689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.543858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.544008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.544130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.544155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.524 qpair failed and we were unable to recover it. 00:30:42.524 [2024-11-29 14:04:22.544270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.544367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.524 [2024-11-29 14:04:22.544399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.544529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.544655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.544680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.544832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.544952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.544977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.545135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.545409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.545803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.545972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.546097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.546352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.546733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.546919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.547074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.547349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.547689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.547939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.548091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.548455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.548784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.548988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.549188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.549458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.549819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.549990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.550112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.550370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.550638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.550877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.550998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.551023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.525 qpair failed and we were unable to recover it. 00:30:42.525 [2024-11-29 14:04:22.551146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.525 [2024-11-29 14:04:22.551269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.551295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.551421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.551570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.551596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.551753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.551874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.551899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.552030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.552299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.552624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.552848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.552973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.553245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.553502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.553803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.553953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.554078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.554294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.554550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.554788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.554939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.555057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.555360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.555671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.555793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.555914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.556153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.556426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.556759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.556895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.557043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.557164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.557190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.557358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.557474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.557505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.526 qpair failed and we were unable to recover it. 00:30:42.526 [2024-11-29 14:04:22.557637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.526 [2024-11-29 14:04:22.557785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.557811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.557934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.558174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.558436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.558697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.558887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.559022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.559332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.559667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.559821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.559994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.560243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.560514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.560776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.560939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.561052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.561320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.561595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.561756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.561869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.562173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.562464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.562752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.562909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.563105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.563233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.563266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.563409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.563555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.527 [2024-11-29 14:04:22.563579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.527 qpair failed and we were unable to recover it. 00:30:42.527 [2024-11-29 14:04:22.563713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.563871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.563898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.564035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.564325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.564581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.564772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.564954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.565278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.565557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.565794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.565982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.566142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.566301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.566328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.566483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.566634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.566659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.566847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.566968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.567143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.567440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.567695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.567884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.568050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.568365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.568668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.568839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.568970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.569308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.528 [2024-11-29 14:04:22.569583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.528 [2024-11-29 14:04:22.569728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.528 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.569814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.569987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.570169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.570467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.570791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.570974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.571073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.571338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.571632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.571862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.571993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.572163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.572471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.572720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.572890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.573034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.573293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.573560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.573809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.573947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.574084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.574368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.574715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.574849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.574994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.575080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.575105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.575238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.575410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.575441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.529 qpair failed and we were unable to recover it. 00:30:42.529 [2024-11-29 14:04:22.575591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.529 [2024-11-29 14:04:22.575677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.575719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.575862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.575958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.575985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.576157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.576471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.576760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.576897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.577033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.577296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.577563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.577853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.577975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.578069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.578358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.578692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.578854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.578946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.579271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.579541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.579832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.579960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.580080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.580360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.580640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.580786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.580959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.581254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.581581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.530 [2024-11-29 14:04:22.581853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.530 [2024-11-29 14:04:22.581968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.530 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.582093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.582430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.582717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.582886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.583028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.583262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.583530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.583793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.583913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.584072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.584331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.584576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.584804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.584995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.585090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.585382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.585645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.585810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.585977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.586257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.586558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.586711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.586842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.587152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.587427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.587708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.587862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.587991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.588114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.588142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.531 [2024-11-29 14:04:22.588285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.588444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.531 [2024-11-29 14:04:22.588472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.531 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.588619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.588700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.588724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.588812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.588961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.588988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.589120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.589363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.589682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.589873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.590010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.590354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.590658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.590780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.590890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.591183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.591483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.591830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.591981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.592069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.592355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.592649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.592845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.592992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.593235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.593455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.593719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.593867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.593984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.594093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.594120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.532 [2024-11-29 14:04:22.594263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.594414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.532 [2024-11-29 14:04:22.594439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.532 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.594597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.594725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.594752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.594899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.594980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.595142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.595472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.595781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.595909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.596089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.596302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.596607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.596781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.596931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.597222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.597526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.597763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.597937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.598351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.598680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.598796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.598892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.599150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.599380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.599699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.599831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.599952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.600206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.533 qpair failed and we were unable to recover it. 00:30:42.533 [2024-11-29 14:04:22.600463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.533 [2024-11-29 14:04:22.600652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.600788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.600922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.600950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.601108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.601363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.601680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.601813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.601963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.602239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.602590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.602746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.602899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.603196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.603515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.603839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.603971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.604134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.604407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.604696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.604843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.604936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.605148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.605384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.534 [2024-11-29 14:04:22.605507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.534 qpair failed and we were unable to recover it. 00:30:42.534 [2024-11-29 14:04:22.605599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.605724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.605750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.605915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.606176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.606432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.606687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.606827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.606976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.607244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.607549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.607835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.607982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.608110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.608356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.608657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.608881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.609052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.609328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.609635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.609772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.609934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.610189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.610489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.610770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.610886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.611014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.611305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.611594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.535 qpair failed and we were unable to recover it. 00:30:42.535 [2024-11-29 14:04:22.611863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.535 [2024-11-29 14:04:22.611989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.612179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.612488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.612728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.612900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.612989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.613321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.613635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.613855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.613969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.614121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.614419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.614731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.614908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.615055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.615379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.615660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.615850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.616011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.616258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.616563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.616749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.616844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.617167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.617404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.617710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.617861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-29 14:04:22.617990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.618120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.536 [2024-11-29 14:04:22.618147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.618291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.618416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.618442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.618594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.618728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.618756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.618890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.619185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.619476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.619700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.619863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.619967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.620219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.620486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.620728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.620891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.620999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.621298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.621609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.621883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.621996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.622155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.622442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.622768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.622906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.623082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.623406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.623673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.623833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.623980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.624251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-29 14:04:22.624550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.537 [2024-11-29 14:04:22.624758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.624882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.624968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.625169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.625524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.625804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.625933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.626032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.626382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.626660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.626847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.627016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.627273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.627587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.627735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.627915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.628247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.628572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.628862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.628976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.629127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.629397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.629750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.629910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.630011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.630293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.630612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.630840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.630998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.631031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.631177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.631296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.631321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-29 14:04:22.631500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.538 [2024-11-29 14:04:22.631606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.631633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.631761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.631889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.631916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.632077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.632323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.632631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.632789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.632954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.633223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.633535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.633725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.633888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.634212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.634517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.634808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.634918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.635082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.635407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.635697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.635864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.635980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.636309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.636596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.636721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.636883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.637165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.637439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.637667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.637790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.539 qpair failed and we were unable to recover it. 00:30:42.539 [2024-11-29 14:04:22.637916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.539 [2024-11-29 14:04:22.638018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.638165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.638503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.638771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.638925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.639091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.639398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.639644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.639800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.639965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.640254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.640523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.640817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.640986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.641145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.641414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.641665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.641908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.641994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.642189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.642450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.642727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.642879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.540 qpair failed and we were unable to recover it. 00:30:42.540 [2024-11-29 14:04:22.643056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.540 [2024-11-29 14:04:22.643182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.643210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.643375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.643530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.643555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.643685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.643822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.643851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.644001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.644602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.644758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.644896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.645200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.645498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.645818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.645979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.646115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.646442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.646757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.646885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.647024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.647282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.647594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.647740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.647859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.648114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.648391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.648598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.648845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.648985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.541 qpair failed and we were unable to recover it. 00:30:42.541 [2024-11-29 14:04:22.649112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.649278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.541 [2024-11-29 14:04:22.649305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.649483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.649585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.649610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.649734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.649851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.649876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.650000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.650255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.650497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.650827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.650999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.651155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.651446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.651779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.651903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.652017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.652312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.652636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.652900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.652999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.653167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.653428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.653697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.653859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.653998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.654271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.654518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.654833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.654969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.655130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.655258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.655285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.542 qpair failed and we were unable to recover it. 00:30:42.542 [2024-11-29 14:04:22.655427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.542 [2024-11-29 14:04:22.655554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.655579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.655735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.655893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.655917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.656063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.656399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.656689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.656835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.656983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.657224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.657537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.657778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.657895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.658014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.658303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.658541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.658777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.658888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.658977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.659281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.659573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.659869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.659985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.660099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.660432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.660738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.660937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.661076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.661158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.661183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.543 qpair failed and we were unable to recover it. 00:30:42.543 [2024-11-29 14:04:22.661331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.543 [2024-11-29 14:04:22.661438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.661467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.661578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.661702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.661730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.661833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.661998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.662129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.662440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.662797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.662927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.663092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.663372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.663688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.663882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.664000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.664209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.664445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.664717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.664910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.665033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.665355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.665685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.665858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.665980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.666337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.666609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.666775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.666892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.667181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.667496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.667694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.667837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.667958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.668081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.668106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.544 qpair failed and we were unable to recover it. 00:30:42.544 [2024-11-29 14:04:22.668247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.544 [2024-11-29 14:04:22.668398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.668424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.668513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.668613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.668638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.668805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.668940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.668968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.669082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.669381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.669698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.669869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.669955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.670186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.670520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.670814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.670977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.671138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.671399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.671741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.671886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.671982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.672241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.672545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.672785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.672952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.673090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.673384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.673693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.673813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.673988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.674274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.674523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.545 [2024-11-29 14:04:22.674726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.545 qpair failed and we were unable to recover it. 00:30:42.545 [2024-11-29 14:04:22.674844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.674966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.674990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.675106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.675428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.675731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.675890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.676028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.676287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.676582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.676751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.676866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.677167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.677421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.677695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.677856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.677971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.678316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.678608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.678806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.678978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.679089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.679383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.679710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.679842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.679989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.680265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.546 qpair failed and we were unable to recover it. 00:30:42.546 [2024-11-29 14:04:22.680563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.546 [2024-11-29 14:04:22.680719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.680870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.680995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.681129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.681397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.681707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.681849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.681992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.682321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.682615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.682771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.682934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.683203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.683537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.683803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.683975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.684145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.684440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.684719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.684883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.685017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.685297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.685595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.685782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.685914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.686195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.686443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.686702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.686864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.687049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.687256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.687616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.687775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.547 [2024-11-29 14:04:22.687882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.688029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.547 [2024-11-29 14:04:22.688054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.547 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.688178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.688486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.688760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.688900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.689043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.689321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.689598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.689793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.689941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.690248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.690538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.690813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.690968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.691085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.691334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.691637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.691825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.691961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.692209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.692452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.692748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.692934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.693077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.693418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.693647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.693800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.693898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.694255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.694572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.548 qpair failed and we were unable to recover it. 00:30:42.548 [2024-11-29 14:04:22.694834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.548 [2024-11-29 14:04:22.694957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.694984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.695150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.695472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.695782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.695957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.696140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.696409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.696701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.696826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.696968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.697220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.697536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.697803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.697998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.698146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.698474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.698745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.698942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.699079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.699404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.699699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.699888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.700022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.700322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.700607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.700871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.700995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.701162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.701463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.701729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.701852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.702042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.702163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.702188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.549 qpair failed and we were unable to recover it. 00:30:42.549 [2024-11-29 14:04:22.702358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.549 [2024-11-29 14:04:22.702535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.702561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.702724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.702829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.702857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.703035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.703359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.703717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.703916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.704051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.704320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.704638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.704795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.704902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.705229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.705504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.705768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.705872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.705967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.706320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.706641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.706790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.706881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.707151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.707459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.707792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.707935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.708096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.708440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.708693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.708867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.709023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.709355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.709658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.709833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.550 qpair failed and we were unable to recover it. 00:30:42.550 [2024-11-29 14:04:22.709958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.710054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.550 [2024-11-29 14:04:22.710079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.710201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.710385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.710420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.710589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.710744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.710769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.710867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.711195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.711485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.711751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.711896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.712053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.712382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.712686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.712808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.712958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.713230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.713517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.713770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.713919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.714012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.714247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.714498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.714742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.714892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.714986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.715280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.715605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.715817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.715963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.551 qpair failed and we were unable to recover it. 00:30:42.551 [2024-11-29 14:04:22.716082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.551 [2024-11-29 14:04:22.716206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.716362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.716643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.716862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.716985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.717075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.717412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.717654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.717825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.717926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.718172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.718411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.718648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.718819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.718972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.719255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.719599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.719811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.719953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.720054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.720295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.720585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.720731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.720851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.721137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.721404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.721713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.721829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.721976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.722334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.722671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.722836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.722973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.723264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.723572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.552 [2024-11-29 14:04:22.723744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.552 qpair failed and we were unable to recover it. 00:30:42.552 [2024-11-29 14:04:22.723836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.723952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.723977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.724099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.724341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.724586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.724848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.724973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.725069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.725359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.725632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.725779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.725878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.726150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.726451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.726721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.726871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.726960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.727210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.727488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.727772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.727912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.728031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.728335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.728571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.728846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.728971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.729065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.729368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.729659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.729839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.729946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.730379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.730714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.730854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.730974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.731091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.731116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.731276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.731403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.553 [2024-11-29 14:04:22.731428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.553 qpair failed and we were unable to recover it. 00:30:42.553 [2024-11-29 14:04:22.731578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.731673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.731700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.731793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.731917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.731943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.732069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.732349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.732699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.732884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.733024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.733346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.733649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.733791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.733940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.734210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.734452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.734754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.734905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.735035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.735265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.735682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.735835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.735970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.736215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.736538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.736764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.736889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.736981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.737277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.737584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.737855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.737998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.738139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.738428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.738707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.738857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.739013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.739349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.554 [2024-11-29 14:04:22.739653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.554 [2024-11-29 14:04:22.739809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.554 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.739931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.555 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.740155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.555 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.740422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.555 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.740639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.740777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.555 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.740898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.741046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.555 [2024-11-29 14:04:22.741072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.555 qpair failed and we were unable to recover it. 00:30:42.555 [2024-11-29 14:04:22.741183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.741365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.741402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.741554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.741691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.741721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.741858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.742203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.742533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.742691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.742889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.743279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.743601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.743814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.743938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.744040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.744279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.744529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.744761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.744906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.745000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.745152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.745177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.745318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.745455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.745481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.854 qpair failed and we were unable to recover it. 00:30:42.854 [2024-11-29 14:04:22.745629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.854 [2024-11-29 14:04:22.745748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.745773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.745866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.745983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.746134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.746402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.746671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.746843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.746933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.747216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.747598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.747774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.747876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.748185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.748423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.748668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.748861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.748984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.749274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.749613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.749758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.749879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.750158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.750410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.750657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.750860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.750966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.751187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.751509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.751755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.855 [2024-11-29 14:04:22.751930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.855 qpair failed and we were unable to recover it. 00:30:42.855 [2024-11-29 14:04:22.752075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.752349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.752709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.752915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.753124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.753300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.753326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.753530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.753683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.753711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.753906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.754226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.754528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.754808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.754954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.755058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.755281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.755540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.755813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.755960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.756086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.756352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.756686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.756806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.756956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.757257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.757504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.757731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.757852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.757942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.758094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.758119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.856 [2024-11-29 14:04:22.758251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.758405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.856 [2024-11-29 14:04:22.758431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.856 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.758521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.758611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.758636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.758760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.758845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.758871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.759020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.759324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.759631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.759814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.759966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.760259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.760537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.760697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.760860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.761223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.761526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.761770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.761887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.762192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.762505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.762789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.762935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.763027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.763324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.763656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.763829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.764033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.764370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.764729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.764936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.765054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.765216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.765241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.857 qpair failed and we were unable to recover it. 00:30:42.857 [2024-11-29 14:04:22.765387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.857 [2024-11-29 14:04:22.765536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.765580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.765728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.765866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.765892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.766020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.766337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.766695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.766857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.767009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.767322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.767599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.767813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.767956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.768215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.768414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.768659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.768810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.768961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.769262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.769558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.769852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.769994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.770146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.770419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.770761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.770935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.771086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.771330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.858 [2024-11-29 14:04:22.771614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.858 [2024-11-29 14:04:22.771734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.858 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.771856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.771947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.771974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.772104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.772404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.772674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.772815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.772921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.773198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.773461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.773670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.773814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.773936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.774150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.774425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.774699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.774877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.774969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.775234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.775512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.775802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.775971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.776107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.776350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.776560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.776802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.776923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.777024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.777148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.777173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.859 qpair failed and we were unable to recover it. 00:30:42.859 [2024-11-29 14:04:22.777298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.859 [2024-11-29 14:04:22.777417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.777444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.777545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.777667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.777692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.777811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.777902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.777928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.778043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.778309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.778580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.778814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.778971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.779068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.779318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.779559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.779867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.779993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.780144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.780398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.780758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.780904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.781050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.781323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.781583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.781786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.781920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.782055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.860 [2024-11-29 14:04:22.782080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.860 qpair failed and we were unable to recover it. 00:30:42.860 [2024-11-29 14:04:22.782203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.782464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.782779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.782924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.783047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.783356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.783647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.783844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.783952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.784050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.784342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.784599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.784745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.784853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.785194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.785440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.785698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.785812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.785937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.786241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.786498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.786767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.786911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.787007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.787249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.787586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.787757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.861 qpair failed and we were unable to recover it. 00:30:42.861 [2024-11-29 14:04:22.787924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.788045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.861 [2024-11-29 14:04:22.788072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.788193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.788313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.788338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2432518 Killed "${NVMF_APP[@]}" "$@" 00:30:42.862 [2024-11-29 14:04:22.788486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.788623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.788666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.788816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.789000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.789044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.789137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 14:04:22 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:42.862 [2024-11-29 14:04:22.789256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.789282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.789450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 14:04:22 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:42.862 [2024-11-29 14:04:22.789617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.789643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.789749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 14:04:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:42.862 [2024-11-29 14:04:22.789895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.789922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 14:04:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:42.862 [2024-11-29 14:04:22.790071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 14:04:22 -- common/autotest_common.sh@10 -- # set +x 00:30:42.862 [2024-11-29 14:04:22.790345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.790632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.790783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.790908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.791137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.791442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.791736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.791849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.791940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.792182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.792427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.792671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.792818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.792943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.793064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.793090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.793218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.793313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.793339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.862 qpair failed and we were unable to recover it. 00:30:42.862 [2024-11-29 14:04:22.793484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.862 [2024-11-29 14:04:22.793638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.793681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.793855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.794169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.794461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.794809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.794964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 14:04:22 -- nvmf/common.sh@469 -- # nvmfpid=2433215 00:30:42.863 [2024-11-29 14:04:22.795007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 14:04:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:42.863 [2024-11-29 14:04:22.795166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 14:04:22 -- nvmf/common.sh@470 -- # waitforlisten 2433215 00:30:42.863 [2024-11-29 14:04:22.795287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.795312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 14:04:22 -- common/autotest_common.sh@829 -- # '[' -z 2433215 ']' 00:30:42.863 [2024-11-29 14:04:22.795452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.795594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 14:04:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:42.863 [2024-11-29 14:04:22.795621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 14:04:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:42.863 [2024-11-29 14:04:22.795772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.795903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 14:04:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:42.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:42.863 [2024-11-29 14:04:22.795927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.796023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 14:04:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:42.863 [2024-11-29 14:04:22.796144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 14:04:22 -- common/autotest_common.sh@10 -- # set +x 00:30:42.863 [2024-11-29 14:04:22.796300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.796544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.796837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.796984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.797101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.797407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.797645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.797829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.797923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.798198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.798415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.798669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.798843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.863 [2024-11-29 14:04:22.798966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.799060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.863 [2024-11-29 14:04:22.799088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.863 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.799195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.799467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.799710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.799901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.800001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.800266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.800576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.800733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.801487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.801596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.801624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.801782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.801881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.801908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.802018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.802294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.802610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.802772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.802929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.803263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.803575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.803776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.803947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.804233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.804446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.804749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.804956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.805074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.805322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.805595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.864 [2024-11-29 14:04:22.805745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.864 qpair failed and we were unable to recover it. 00:30:42.864 [2024-11-29 14:04:22.805868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.805986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.806105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.806358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.806629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.806877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.806994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.807120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.807367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.807648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.807792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.807889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.808168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.808443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.808691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.808843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.808939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.809176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.809449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.809672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.809815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.809943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.810250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.810553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.810826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.810975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.865 [2024-11-29 14:04:22.811070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.811227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.865 [2024-11-29 14:04:22.811253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.865 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.811344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.811458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.811485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.811653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.811810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.811851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.811971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.812250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.812542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.812709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.812842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.813159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.813378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.813672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.813889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.813982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.814136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.814406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.814706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.814859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.814963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.815272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.815595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.815853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.815987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.816013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.866 qpair failed and we were unable to recover it. 00:30:42.866 [2024-11-29 14:04:22.816138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.866 [2024-11-29 14:04:22.816236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.816263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.816369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.816482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.816507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.816624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.816757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.816783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.816896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.817169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.817449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.817704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.817857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.817968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.818265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.818550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.818803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.818982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.819174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.819470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.819703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.819846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.819997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.820220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.820527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.820717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.820849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.821170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.821416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.821695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.821869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.867 [2024-11-29 14:04:22.821967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.822061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.867 [2024-11-29 14:04:22.822088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.867 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.822238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.822516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.822735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.822862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.823002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.823263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.823537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.823829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.823947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.824100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.824343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.824599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.824772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.824896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.825150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.825411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.825651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.825855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.825973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.826064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.826335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.826819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.826961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.827059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.827331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.868 [2024-11-29 14:04:22.827555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.868 [2024-11-29 14:04:22.827712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.868 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.827804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.827901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.827927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.828054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.828382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.828618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.828750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.828877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.829170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.829432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.829684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.829798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.829943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.830219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.830591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.830778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.830974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.831284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.831571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.831726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.831896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.832197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.832562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.832857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.832991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.833159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.833513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.833743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.833892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.834002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.834146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.834176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.869 [2024-11-29 14:04:22.834330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.834463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.869 [2024-11-29 14:04:22.834490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.869 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.834617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.834710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.834735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.834907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.835222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.835559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.835778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.835931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.836253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.836544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.836735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.836843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.840406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.840448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.840611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.840645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:42.870 [2024-11-29 14:04:22.840740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.840742] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:42.870 [2024-11-29 14:04:22.840777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.840929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.841230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.841552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.841728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.841874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.842209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.842551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.842787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.842979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.843126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.843403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.843720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.843879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.844014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.844153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.844184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.844366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.844532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.870 [2024-11-29 14:04:22.844558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.870 qpair failed and we were unable to recover it. 00:30:42.870 [2024-11-29 14:04:22.844737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.844870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.844900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.845046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.845210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.845239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.845398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.845526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.845568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.845816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.845972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.846009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.846163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.846297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.846338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.846530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.846659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.846698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.846829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.847193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.847523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.847819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.847968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.848062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.848348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.848569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.848867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.848974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.849102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.849409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.849688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.849812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.849941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.850202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.850470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.850617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.850820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.851016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.851041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.871 qpair failed and we were unable to recover it. 00:30:42.871 [2024-11-29 14:04:22.851144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.851258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.871 [2024-11-29 14:04:22.851283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.851402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.851531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.851556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.851654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.851736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.851761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.851858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.851988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.852137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.852447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.852731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.852848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.852973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.853273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.853526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.853803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.853964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.854061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.854355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.854633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.854777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.854903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.855151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.855426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.855728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.855887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.855978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.856125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.872 [2024-11-29 14:04:22.856150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.872 qpair failed and we were unable to recover it. 00:30:42.872 [2024-11-29 14:04:22.856248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.856517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.856812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.856963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.857086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.857407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.857685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.857826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.857927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.858175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.858400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.858643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.858863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.858992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.859172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.859455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.859675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.859822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.859950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.860194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.860420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.860664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.860879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.860995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.861149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.861453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.873 qpair failed and we were unable to recover it. 00:30:42.873 [2024-11-29 14:04:22.861797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.873 [2024-11-29 14:04:22.861914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.861950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.862125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.862400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.862627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.862878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.862995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.863183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.863475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.863723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.863885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.863978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.864289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.864594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.864864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.864980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.865114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.865358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.865626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.865747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.865900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.866229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.866541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.866803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.866978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.867111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.867412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.867643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.867816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.874 [2024-11-29 14:04:22.867962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.868079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.874 [2024-11-29 14:04:22.868104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.874 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.868228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.868508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.868716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.868865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.868965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.869220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.869528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.869797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.869972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.870125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.870436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.870723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.870861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.870961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.871276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.871599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.871763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.871901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.872143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.872477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.872820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.872993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.873099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.873401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.873716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.873892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.874086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.874241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.875 [2024-11-29 14:04:22.874266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.875 qpair failed and we were unable to recover it. 00:30:42.875 [2024-11-29 14:04:22.874373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.874545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.874574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.874718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.874821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.874850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.874972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.875291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.875577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.875775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.875906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 EAL: No free 2048 kB hugepages reported on node 1 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.876174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.876431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.876736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.876911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.877054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.877304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.877594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.877735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.877880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.878245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.878510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.878776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.878925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.879060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.879326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.879600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.879728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.879889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.880168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.876 qpair failed and we were unable to recover it. 00:30:42.876 [2024-11-29 14:04:22.880440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.876 [2024-11-29 14:04:22.880564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.880687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.880808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.880832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.880959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.881281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.881537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.881798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.881919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.882046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.882378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.882662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.882827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.882946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.883205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.883493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.883758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.883874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.883971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.884271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.884515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.884739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.884857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.884981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.885251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.885516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.885754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.885871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.886007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.886154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.886179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.877 qpair failed and we were unable to recover it. 00:30:42.877 [2024-11-29 14:04:22.886301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.877 [2024-11-29 14:04:22.886458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.886484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.886587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.886676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.886701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.886828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.886925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.886950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.887114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.887424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.887714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.887854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.887977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.888252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.888473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.888682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.888823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.888914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.889153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.889357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.889643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.889779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.889907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.890182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.890518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.890779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.890929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.878 qpair failed and we were unable to recover it. 00:30:42.878 [2024-11-29 14:04:22.891080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.878 [2024-11-29 14:04:22.891194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.891311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.891591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.891860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.891981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.892077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.892315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.892577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.892821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.892958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.893078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.893365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.893608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.893901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.893999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.894170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.894421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.894631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.894780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.894899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.895157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.895436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.895654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.895806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.895903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.896205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.896486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.896731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.879 [2024-11-29 14:04:22.896905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.879 qpair failed and we were unable to recover it. 00:30:42.879 [2024-11-29 14:04:22.897006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.897278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.897524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.897838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.897999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.898181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.898444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.898759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.898918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.899085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.899357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.899598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.899842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.899969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.900062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.900291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.900565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.900808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.900946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.901067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.901309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.901557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.901774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.901894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.902012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.902283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.902526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.880 [2024-11-29 14:04:22.902663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.880 qpair failed and we were unable to recover it. 00:30:42.880 [2024-11-29 14:04:22.902760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.902842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.902867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.902985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.903277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.903559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.903810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.903933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.904039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.904321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.904588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.904867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.904987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.905109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.905418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.905666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.905823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.905975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.906216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.906447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.906724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.906870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.906990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.907256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.907516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.907712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.907838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.907964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.908081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.908106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.881 qpair failed and we were unable to recover it. 00:30:42.881 [2024-11-29 14:04:22.908199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.881 [2024-11-29 14:04:22.908324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.908350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.908475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.908600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.908625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.908760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.908850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.908875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.908957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.909208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.909454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.909683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.909803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.909922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.910200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.910422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.910648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:42.882 [2024-11-29 14:04:22.910719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.910872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.910995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.911202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.911491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.911746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.911919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.912036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.912270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.912576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.912815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.912940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.913087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.913337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.882 [2024-11-29 14:04:22.913675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.882 [2024-11-29 14:04:22.913822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.882 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.913916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.914142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.914399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.914643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.914895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.914993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.915136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.915355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.915641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.915823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.915951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.916247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.916540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.916811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.916960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.917111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.917348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.917661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.917811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.917968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.918173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.918442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.918727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.918851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.918989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.919108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.919134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.919224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.919317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.919342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.883 qpair failed and we were unable to recover it. 00:30:42.883 [2024-11-29 14:04:22.919484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.883 [2024-11-29 14:04:22.919607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.919632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.919765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.919851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.919877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.920001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.920262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.920566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.920805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.920948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.921050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.921292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.921536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.921773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.921901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.921996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.922294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.922560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.922804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.922998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.923096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.923363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.923622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.923769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.923897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.924019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.924050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.924199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.924321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.884 [2024-11-29 14:04:22.924345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.884 qpair failed and we were unable to recover it. 00:30:42.884 [2024-11-29 14:04:22.924450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.924553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.924577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.924678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.924772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.924799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.924950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.925221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.925452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.925734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.925854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.925982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.926189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.926454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.926733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.926854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.926999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.927210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.927482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.927752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.927898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.927989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.928213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.928422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.928646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.928760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.928876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.929157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.929400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.885 qpair failed and we were unable to recover it. 00:30:42.885 [2024-11-29 14:04:22.929606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.885 [2024-11-29 14:04:22.929722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.929747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.929872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.929986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.930111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.930376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.930626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.930775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.930894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.931199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.931471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.931778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.931916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.932023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.932253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.932467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.932738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.932883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.933006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.933253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.933553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.933791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.933949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.934087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.934316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.934557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.934857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.934977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.935121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.935241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.886 [2024-11-29 14:04:22.935267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.886 qpair failed and we were unable to recover it. 00:30:42.886 [2024-11-29 14:04:22.935391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.935542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.935568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.935688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.935781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.935806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.935926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.936466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.936691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.936815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.936942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.937192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.937435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.937665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.937784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.937907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.938167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.938418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.938677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.938823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.938913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.939158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.939374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.939664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.939877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.939992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.940135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.940397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.887 qpair failed and we were unable to recover it. 00:30:42.887 [2024-11-29 14:04:22.940635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.887 [2024-11-29 14:04:22.940807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.940899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.941170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.941425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.941696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.941810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.941909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.942191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.942436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.942679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.942801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.942894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.943135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.943403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.943602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.943853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.943976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.944120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.944357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.944629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.944803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.944890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.945159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.945434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.945704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.945851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.945941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.946089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.946114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.888 qpair failed and we were unable to recover it. 00:30:42.888 [2024-11-29 14:04:22.946240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.888 [2024-11-29 14:04:22.946361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.946386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.946497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.946615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.946641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.946746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.946838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.946863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.946988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.947288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.947537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.947805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.947945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.948076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.948318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.948551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.948866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.948985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.949105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.949346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.949634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.949818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.949938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.950147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.950413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.950679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.950822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.950915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.951125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.951372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.951648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.951793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.951892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.952007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.952031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.889 qpair failed and we were unable to recover it. 00:30:42.889 [2024-11-29 14:04:22.952158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.889 [2024-11-29 14:04:22.952260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.952285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.952406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.952501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.952525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.952657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.952804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.952828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.952976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.953253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.953531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.953794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.953949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.954043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.954297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.954574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.954859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.954982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.955109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.955414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.955726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.955847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.955952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.956230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.956484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.956734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.956931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.890 [2024-11-29 14:04:22.957051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.957138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.890 [2024-11-29 14:04:22.957162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.890 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.957280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.957438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.957463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.957591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.957753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.957778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.957900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.958174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.958418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.958634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.958814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.958944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.959219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.959523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.959808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.959919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.960037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.960337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.960621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.960858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.960975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.961089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.961353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.961617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.961772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.961896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.962150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.962439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.962722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.962835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.891 [2024-11-29 14:04:22.962959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.963051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.891 [2024-11-29 14:04:22.963081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.891 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.963176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.963399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.963645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.963899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.963988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.964117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.964380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.964601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.964876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.964997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.965124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.965365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.965647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.965792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.965896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.966135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.966355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.966653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.966768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.966916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.967239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.967512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.967792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.967904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.968028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.968328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.892 qpair failed and we were unable to recover it. 00:30:42.892 [2024-11-29 14:04:22.968598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.892 [2024-11-29 14:04:22.968718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.968827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.968949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.968976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.969100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.969341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.969585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.969797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.969970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.970060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.970327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.970602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.970830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.970979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.971103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.971362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.971631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.971804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.971954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.972189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.972515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.972765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.972889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.972985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.973248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.973548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.973807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.973983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.893 qpair failed and we were unable to recover it. 00:30:42.893 [2024-11-29 14:04:22.974108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.974234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.893 [2024-11-29 14:04:22.974259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.974383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.974524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.974548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.974677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.974797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.974821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.974917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.975183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.975479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.975722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.975862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.975963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.976239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.976483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.976815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.976957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.977081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.977316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.977550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.977809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.977952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.978069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.978310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.978570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.978782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.978903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.979052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.979290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.979528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.894 [2024-11-29 14:04:22.979641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.894 qpair failed and we were unable to recover it. 00:30:42.894 [2024-11-29 14:04:22.979738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.979884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.979909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.980009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.980248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.980507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.980778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.980895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.981025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.981276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.981544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.981781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.981908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.982032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.982296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.982634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.982792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.982917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.983218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.983421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.983629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.983767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.983893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.984162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.984377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.984668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.984849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.984970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.985115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.985140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.985248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.985365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.985390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.895 qpair failed and we were unable to recover it. 00:30:42.895 [2024-11-29 14:04:22.985490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.895 [2024-11-29 14:04:22.985613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.985638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.985766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.985858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.985883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.986031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.986267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.986535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.986784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.986908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.987003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.987275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.987551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.987819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.987946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.988066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.988331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.988598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.988844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.988985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.989099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.989435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.989746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.989878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.990023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.990292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.990606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.990776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.896 qpair failed and we were unable to recover it. 00:30:42.896 [2024-11-29 14:04:22.990894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.991050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.896 [2024-11-29 14:04:22.991079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.991225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.991554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.991827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.991972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.992156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.992470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.992783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.992929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.993056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.993299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.993614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.993827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.993972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.994122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.994389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.994684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.994799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.994919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.995158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.995456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.995726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.995873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.995961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.996187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.996431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.996703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.996857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.996978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.997101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.997127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.997226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.997325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.997350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.897 qpair failed and we were unable to recover it. 00:30:42.897 [2024-11-29 14:04:22.997453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.897 [2024-11-29 14:04:22.997578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.997604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.997696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.997818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.997842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.997933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.998129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.998336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.998569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.998780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.998895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.998931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:42.898 [2024-11-29 14:04:22.998990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999056] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:42.898 [2024-11-29 14:04:22.999075] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:42.898 [2024-11-29 14:04:22.999077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999089] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:42.898 [2024-11-29 14:04:22.999100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.999194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:42.898 [2024-11-29 14:04:22.999180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:42.898 [2024-11-29 14:04:22.999293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b9[2024-11-29 14:04:22.999230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:42.898 0 with addr=10.0.0.2, port=4420 00:30:42.898 [2024-11-29 14:04:22.999233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.999436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.999707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:22.999818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:22.999912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.000187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.000405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.000671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.000906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.000993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.001141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.001407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.001650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.001770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.001909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.002025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.002051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.002172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.002268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.002292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.898 qpair failed and we were unable to recover it. 00:30:42.898 [2024-11-29 14:04:23.002388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.898 [2024-11-29 14:04:23.002496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.002522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.002617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.002707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.002733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.002840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.002959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.002985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.003110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.003355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.003574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.003768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.003913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.004013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.004260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.004486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.004723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.004859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.004946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.005168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.005422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.005700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.005809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.005894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.006134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.006376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.006673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.006779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.006879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.007122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.007340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.007591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.899 qpair failed and we were unable to recover it. 00:30:42.899 [2024-11-29 14:04:23.007834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.899 [2024-11-29 14:04:23.007952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.008069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.008308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.008544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.008791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.008912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.009008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.009276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.009521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.009782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.009926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.010022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.010260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.010474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.010732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.010852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.010939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.011166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.011404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.011635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.011868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.011983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.012105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.012370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.012579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.012783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.012905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.013003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.013086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.013113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.013204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.013323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.013348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.900 qpair failed and we were unable to recover it. 00:30:42.900 [2024-11-29 14:04:23.013457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.900 [2024-11-29 14:04:23.013550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.013585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.013679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.013797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.013822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.013923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.014133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.014344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.014583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.014796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.014910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.015009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.015210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.015422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.015631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.015874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.015988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.016110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.016370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.016613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.016852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.016968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.017088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.017353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.017565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.017804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.017941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.018032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.018182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.901 [2024-11-29 14:04:23.018207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.901 qpair failed and we were unable to recover it. 00:30:42.901 [2024-11-29 14:04:23.018308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.018544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.018778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.018919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.019047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.019257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.019519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.019736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.019864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.019990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.020201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.020416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.020640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.020853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.020999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.021088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.021340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.021594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.021826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.021951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.022052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.022344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.022649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.022804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.022900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.023162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.023379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.023639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.023859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.023969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.024073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.024168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.024193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.902 [2024-11-29 14:04:23.024289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.024375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.902 [2024-11-29 14:04:23.024416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.902 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.024506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.024634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.024659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.024796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.024915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.024940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.025042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.025296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.025543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.025760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.025882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.025980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.026206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.026455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.026661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.026912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.026996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.027117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.027360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.027575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.027856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.027999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.028091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.028303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.028535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.028788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.028906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.029055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.029285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.029524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.029737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.029847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.029999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.030272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.030525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.903 qpair failed and we were unable to recover it. 00:30:42.903 [2024-11-29 14:04:23.030790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.903 [2024-11-29 14:04:23.030879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.030905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.031002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.031198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.031451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.031665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.031781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.031904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.032166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.032453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.032679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.032796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.032924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.033192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.033400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.033675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.033815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.033910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.034153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.034364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.034630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.034841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.034981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.035075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.035373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.035597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.035823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.035938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.036090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.036326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.036575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.036819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.036963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.904 qpair failed and we were unable to recover it. 00:30:42.904 [2024-11-29 14:04:23.037067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.037161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.904 [2024-11-29 14:04:23.037185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.037278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.037484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.037730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.037843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.037945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.038148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.038423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.038658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.038781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.038928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.039129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.039359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.039617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.039755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.039876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.040121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.040331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.040567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.040820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.040939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.041036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.041257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.041505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.041782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.041904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.041994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.042237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.042501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.042730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.042865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.042971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.043066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.043090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.043177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.043297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.043321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.905 qpair failed and we were unable to recover it. 00:30:42.905 [2024-11-29 14:04:23.043419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.905 [2024-11-29 14:04:23.043509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.043533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.043679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.043771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.043797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.043897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.043986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.044129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.044417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.044634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.044867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.044984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.045073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.045281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.045519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.045746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.045889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.046007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.046273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.046512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.046768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.046909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.046999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.047221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.047466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.047710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.047860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.047953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.048170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.048375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.048649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.906 qpair failed and we were unable to recover it. 00:30:42.906 [2024-11-29 14:04:23.048889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.048979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.906 [2024-11-29 14:04:23.049004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.049124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.049362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.049599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.049843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.049960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.050048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.050323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.050601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.050821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.050936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.051054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.051271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.051495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.051703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.051841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.051936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.052138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.052352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.052633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.052985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.053096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.053296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.053515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.053716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.053861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.053965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.054179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.054403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.054642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.054849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.054957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.055075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.055314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.055552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.907 qpair failed and we were unable to recover it. 00:30:42.907 [2024-11-29 14:04:23.055815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.907 [2024-11-29 14:04:23.055904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.055928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.056018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.056243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.056504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.056750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.056877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.056968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.057221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.057470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.057679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.057797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.057896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.058129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.058350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.058627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.058780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.058899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.059150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.059407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.059634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.059841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.059992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.060090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.060323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.060616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.060802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.060888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.061150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.061362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.061635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.061756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.061863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.062134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.062339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.062613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.062784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.062882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.063150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.063406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.908 qpair failed and we were unable to recover it. 00:30:42.908 [2024-11-29 14:04:23.063643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.908 [2024-11-29 14:04:23.063772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.063797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.063899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.064146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.064362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.064619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.064859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.064976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.065069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.065372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.065639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.065850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.065960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.066060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.066281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.066522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.066779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.066900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.066995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.067201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.067439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.067674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.067841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.067957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.068200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.068466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.068679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.068830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.068916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.069148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.069410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.069657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.069806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.069910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.070154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.070390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.070748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.070906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.071002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.071097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.909 [2024-11-29 14:04:23.071122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.909 qpair failed and we were unable to recover it. 00:30:42.909 [2024-11-29 14:04:23.071223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.071450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.071725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.071839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.071946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.072193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.072439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.072675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.072823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.072913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.073183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.073434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.073681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.073823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.073930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.074135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.074377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.074604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.074840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.074949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.075071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.075290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.075541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.075754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.075899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.076021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.076269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.076506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.076797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.076911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.077033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.077245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.077468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.077705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.077907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.077999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.078023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.078143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.078227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.078251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.910 qpair failed and we were unable to recover it. 00:30:42.910 [2024-11-29 14:04:23.078345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.078475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.910 [2024-11-29 14:04:23.078501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.078628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.078744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.078769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.078893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.078977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.079092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.079365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.079590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.079827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.079945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.080038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.080282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.080494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.080749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.080899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.080988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.081191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.081430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.081666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.081778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.081925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.082157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.082399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.082599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.082878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.911 [2024-11-29 14:04:23.082999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.911 qpair failed and we were unable to recover it. 00:30:42.911 [2024-11-29 14:04:23.083120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.083328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.083547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.083777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.083925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.084040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.084306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.084563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.084764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.084884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.085005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.085239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.085446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.085665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.085873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.085981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.086082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.086280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.086506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.086768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.086879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.086974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.087065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.087090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.087236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.087359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.087384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.912 qpair failed and we were unable to recover it. 00:30:42.912 [2024-11-29 14:04:23.087542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.912 [2024-11-29 14:04:23.087656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.087680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.087777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.087865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.087894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.087980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.088216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.088432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.088641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.088877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.088997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.089095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.089340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.089600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.089745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.089868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.090142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.090364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.090659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.090897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.090993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.091110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.091348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.091847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.091966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.092054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.092146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.913 [2024-11-29 14:04:23.092171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.913 qpair failed and we were unable to recover it. 00:30:42.913 [2024-11-29 14:04:23.092292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.092555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.092809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.092927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.093022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.093236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.093497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.093742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.093858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.093948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.094189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.094403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.094626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.094865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.094981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.095007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:42.914 [2024-11-29 14:04:23.095111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.095201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.914 [2024-11-29 14:04:23.095226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:42.914 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.095350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.095607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.095851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.095971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.096063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.096381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.096610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.096819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.096932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.097023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.097292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.097544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.097797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.097911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.098060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.098296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.098540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.098752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.098895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.099015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.099279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.099495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.199 [2024-11-29 14:04:23.099742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.199 [2024-11-29 14:04:23.099861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.199 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.099981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.100255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.100531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.100766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.100910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.101057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.101312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.101525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.101761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.101906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.102020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.102254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.102485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.102715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.102830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.102985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.103199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.103478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.103699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.103845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.103965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.104254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.104463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.104735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.104852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.104973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.105204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.200 [2024-11-29 14:04:23.105434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.200 [2024-11-29 14:04:23.105547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.200 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.105670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.105759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.105784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.105904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.106131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.106342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.106550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.106828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.106943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.107039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.107309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.107536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.107802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.107921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.108014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.108244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.108466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.108678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.108819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.108910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.109149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.109447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.109662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.109785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.109933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.110136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.110401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.201 qpair failed and we were unable to recover it. 00:30:43.201 [2024-11-29 14:04:23.110645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.201 [2024-11-29 14:04:23.110792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.110911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.110995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.111116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.111350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.111602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.111840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.111988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.112083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.112294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.112541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.112768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.112908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.112998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.113200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.113470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.113737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.113882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.114002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.114195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.114457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.114671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.114875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.114986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.115107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.115347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.115608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.202 [2024-11-29 14:04:23.115754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.202 qpair failed and we were unable to recover it. 00:30:43.202 [2024-11-29 14:04:23.115869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.115956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.115982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.116100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.116353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.116617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.116855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.116982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.117092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.117338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.117598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.117865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.117988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.118071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.118276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.118559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.118803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.118922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.119011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.119249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.119502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.119742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.119864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.119984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.120216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.120443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.120647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.120761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.203 [2024-11-29 14:04:23.120884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.121011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.203 [2024-11-29 14:04:23.121037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.203 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.121135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.121405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.121607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.121819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.121992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.122132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.122338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.122546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.122760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.122868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.122995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.123206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.123417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.123633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.123866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.123986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.124105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.124337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.124577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.124767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.124915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.125046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.125321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.125561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.204 qpair failed and we were unable to recover it. 00:30:43.204 [2024-11-29 14:04:23.125793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.204 [2024-11-29 14:04:23.125882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.125906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.126024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.126227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.126510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.126709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.126849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.126951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.127159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.127400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.127605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.127843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.127960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.128049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.128250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.128472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.128720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.128828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.128916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.129158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.129382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.129610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.129822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.129943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.130056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.130148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.205 [2024-11-29 14:04:23.130172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.205 qpair failed and we were unable to recover it. 00:30:43.205 [2024-11-29 14:04:23.130267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.130536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.130742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.130851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.130948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.131214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.131499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.131701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.131855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.131946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.132248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.132466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.132708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.132851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.132941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.133153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.133369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.133614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.133827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.133943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.134040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.134302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.134553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.134782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.134923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.135014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.135107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.135132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.206 qpair failed and we were unable to recover it. 00:30:43.206 [2024-11-29 14:04:23.135248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.206 [2024-11-29 14:04:23.135339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.135365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.135471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.135564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.135588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.135716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.135828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.135852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.135979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.136230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.136498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.136740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.136883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.137006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.137221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.137509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.137706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.137852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.137945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.138167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.138417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.138661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.138882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.138994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.139110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.139375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.139596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.139811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.139928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.140023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.140112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.140137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.207 [2024-11-29 14:04:23.140263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.140349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.207 [2024-11-29 14:04:23.140374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.207 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.140511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.140611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.140637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.140762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.140848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.140871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.140961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.141172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.141413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.141629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.141837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.141950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.142049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.142247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.142462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.142678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.142821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.142919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.143129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.143362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.143595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.143845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.143963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.144091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.144319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.144602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.144812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.144926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.145037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.145140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.145172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.208 [2024-11-29 14:04:23.145292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.145400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.208 [2024-11-29 14:04:23.145430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.208 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.145579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.145689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.145719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.145863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.145960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.145989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.146097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.146399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.146673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.146807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.146952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.147249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.147502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.147743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.147862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.147971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.148209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.148424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.148661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.148893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.148982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.149124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.149340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.149546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.149785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.149927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.150026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.150259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.150534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.150738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.150852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.150969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.151058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.209 [2024-11-29 14:04:23.151085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.209 qpair failed and we were unable to recover it. 00:30:43.209 [2024-11-29 14:04:23.151176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.151380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.151624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.151863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.151972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.152060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.152297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.152559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.152824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.152962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.153060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.153259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.153496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.153729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.153868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.153961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.154228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.154473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.154677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.154827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.154918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.155162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.155372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.210 qpair failed and we were unable to recover it. 00:30:43.210 [2024-11-29 14:04:23.155576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.210 [2024-11-29 14:04:23.155719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.155823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.155920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.155945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.156037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.156270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.156518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.156749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.156863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.156990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.157239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.157444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.157743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.157859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.157948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.158153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.158353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.158574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.158780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.158885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.159000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.159208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.159418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.159681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.159799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.211 qpair failed and we were unable to recover it. 00:30:43.211 [2024-11-29 14:04:23.159892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.211 [2024-11-29 14:04:23.160014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.160130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.160373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.160593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.160822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.160942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.161066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.161298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.161546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.161768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.161878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.161999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.162235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.162430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.162639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.162854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.162969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.163063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.163299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.163514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.163782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.163900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.164019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.164229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.164454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.164660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.164835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.212 qpair failed and we were unable to recover it. 00:30:43.212 [2024-11-29 14:04:23.164960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.212 [2024-11-29 14:04:23.165050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.165166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.165366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.165616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.165887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.165981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.166098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.166308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.166550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.166757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.166879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.166972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.167179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.167417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.167653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.167851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.167964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.168089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.168300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.168552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.168778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.168888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.168972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.169211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.169477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.213 qpair failed and we were unable to recover it. 00:30:43.213 [2024-11-29 14:04:23.169757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.213 [2024-11-29 14:04:23.169872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.169956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.170185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.170411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.170649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.170801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.170896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.171133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.171328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.171568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.171827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.171940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.172034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.172296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.172514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.172726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.172840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.172936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.173171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.173426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.173640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.173788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.173919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.174186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.174391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.174636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.174836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.174950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.214 qpair failed and we were unable to recover it. 00:30:43.214 [2024-11-29 14:04:23.175042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.214 [2024-11-29 14:04:23.175131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.175247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.175465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.175703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.175846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.175939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.176138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.176366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.176590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.176792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.176913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.177001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.177228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.177480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.177726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.177846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.177964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.178176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.178449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.178691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.178893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.178983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.179105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.179383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.179627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.179825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.179964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.180059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.180143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.180169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.215 [2024-11-29 14:04:23.180260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.180381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.215 [2024-11-29 14:04:23.180412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.215 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.180506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.180655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.180680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.180770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.180868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.180893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.180984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.181210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.181431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.181672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.181887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.181980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.182128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.182375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.182586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.182818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.182929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.183019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.183274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.183489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.183690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.183901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.183992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.184105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.184318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.216 qpair failed and we were unable to recover it. 00:30:43.216 [2024-11-29 14:04:23.184525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.216 [2024-11-29 14:04:23.184689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.184784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.184903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.184929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.185016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.185215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.185421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.185671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.185877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.185992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.186105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.186346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.186581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.186844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.186964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.187059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.187288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.187533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.187730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.187851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.187976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.188096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.188122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.188247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.188402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.217 [2024-11-29 14:04:23.188427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.217 qpair failed and we were unable to recover it. 00:30:43.217 [2024-11-29 14:04:23.188527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.188674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.188699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.188824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.188952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.188977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.189069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.189335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.189567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.189793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.189914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.190002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.190250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.190527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.190725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.190846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.190941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.191135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.191353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.191581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.191837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.191977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.192074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.192309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.192550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.192754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.192867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.192958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.193223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.193446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.193687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.218 [2024-11-29 14:04:23.193799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.218 qpair failed and we were unable to recover it. 00:30:43.218 [2024-11-29 14:04:23.193893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.193991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.194122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.194365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.194618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.194850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.194993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.195078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.195304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.195563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.195802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.195947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.196062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.196329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.196605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.196811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.196923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.197016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.197221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.197450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.197649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.197860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.197979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.198151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.198359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.198604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.198859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.198971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.219 qpair failed and we were unable to recover it. 00:30:43.219 [2024-11-29 14:04:23.199067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.199195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.219 [2024-11-29 14:04:23.199220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.199318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.199534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.199765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.199905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.200032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.200298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.200508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.200738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.200848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.200966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.201179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.201408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.201621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.201832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.201976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.202077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.202279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.202486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.202687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.202898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.202991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.203101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.203306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.203537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.203745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.220 [2024-11-29 14:04:23.203863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.220 qpair failed and we were unable to recover it. 00:30:43.220 [2024-11-29 14:04:23.203953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.204159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.204358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.204592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.204855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.204967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.205064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.205301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.205508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.205720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.205826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.205948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.206199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.206441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.206647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.206860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.206976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.207097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.207298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.207575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.207795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.207940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.208025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.208230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.208487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.208735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.208886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.208989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.209080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.221 [2024-11-29 14:04:23.209107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.221 qpair failed and we were unable to recover it. 00:30:43.221 [2024-11-29 14:04:23.209220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.209470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.209713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.209833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.209955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.210178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.210402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.210615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.210820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.210937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.211060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.211276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.211537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.211755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.211868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.211952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.212175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.212398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.212640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.212907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.212992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.213139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.213352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.213594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.222 qpair failed and we were unable to recover it. 00:30:43.222 [2024-11-29 14:04:23.213806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.222 [2024-11-29 14:04:23.213917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.214010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.214250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.214470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.214685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.214813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.214911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.215130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.215371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.215594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.215798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.215909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.216031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.216243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.216459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.216721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.216876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.216981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.217244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.217527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.217852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.217984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.218132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.218379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.223 [2024-11-29 14:04:23.218638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.223 [2024-11-29 14:04:23.218803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.223 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.218915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.219214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.219509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.219719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.219871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.220022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.220262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.220482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.220691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.220839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.220955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.221202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.221406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.221677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.221797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.221891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.222140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.222352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.222602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.222821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.222939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.223034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.223242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.223454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.223668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.223813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.224 qpair failed and we were unable to recover it. 00:30:43.224 [2024-11-29 14:04:23.223910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.224 [2024-11-29 14:04:23.224032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.224174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.224424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.224667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.224905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.224990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.225130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.225405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.225652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.225795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.225917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.226196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.226460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.226705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.226819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.226906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.227173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.227381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.227598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.227868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.227983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.228102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.228338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.228635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.228846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.228963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.229084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.229182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.229207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.225 qpair failed and we were unable to recover it. 00:30:43.225 [2024-11-29 14:04:23.229302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.229398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.225 [2024-11-29 14:04:23.229435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.229535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.229630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.229656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.229747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.229893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.229918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.230016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.230223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.230468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.230705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.230848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.230952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.231196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.231403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.231671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.231793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.231886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.232123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.232320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.232561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.232789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.232907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.233025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.233277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.233556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.233799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.233929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.234019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.234136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.234166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.226 [2024-11-29 14:04:23.234262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.234378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.226 [2024-11-29 14:04:23.234408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.226 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.234501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.234593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.234620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.234718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.234839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.234865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.234955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.235197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.235426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.235722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.235840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.235961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.236176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.236464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.236710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.236856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.236956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.237168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.237433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.237652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.237773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.237863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.238161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.238405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.238644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.238880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.238977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.239100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.239310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.227 qpair failed and we were unable to recover it. 00:30:43.227 [2024-11-29 14:04:23.239570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.227 [2024-11-29 14:04:23.239694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.239783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.239902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.239927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.240019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.240232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.240446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.240691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.240834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.240930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.241166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.241384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.241633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.241874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.241996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.242091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.242330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.242552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.242792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.242937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.243029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.243262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.243475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.243684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.243906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.243992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.244017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.228 qpair failed and we were unable to recover it. 00:30:43.228 [2024-11-29 14:04:23.244120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.244211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.228 [2024-11-29 14:04:23.244238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.244361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.244574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.244851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.244974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.245100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.245368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.245582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.245846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.245990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.246082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.246314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.246552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.246791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.246934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.247029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.247260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.247513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.247715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.247838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.247968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.248215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.248479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.248717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.248857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.229 [2024-11-29 14:04:23.248979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.249070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.229 [2024-11-29 14:04:23.249095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.229 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.249182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.249422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.249628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.249897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.249989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.250109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.250352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.250596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.250852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.250998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.251117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.251330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.251550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.251831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.251944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.252040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.252291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.252538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.252787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.252900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.252997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.253235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.253492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.253728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.253850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.230 [2024-11-29 14:04:23.253971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.254091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.230 [2024-11-29 14:04:23.254116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.230 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.254239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.254475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.254712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.254823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.254939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.255174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.255420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.255635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.255848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.255962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.256067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.256278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.256520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.256765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.256905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.257000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.257265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.257511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.257787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.257907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.258004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.258250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.258521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.258738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.258886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.258983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.259080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.259106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.231 qpair failed and we were unable to recover it. 00:30:43.231 [2024-11-29 14:04:23.259197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.259317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.231 [2024-11-29 14:04:23.259341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.259435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.259527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.259552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.259654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.259776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.259802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.259894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.259986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.260116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.260365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.260590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.260806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.260968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.261089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.261327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.261578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.261837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.261985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.262075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.262339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.262579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.262813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.262937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.263057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.263264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.263525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.263738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.263867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.263990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.264106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.264131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.264251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.264338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.232 [2024-11-29 14:04:23.264365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.232 qpair failed and we were unable to recover it. 00:30:43.232 [2024-11-29 14:04:23.264465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.264581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.264606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.264736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.264828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.264853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.264995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.265213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.265434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.265681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.265828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.265920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.266136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.266349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.266603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.266847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.266987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.267086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.267326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.267572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.267824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.267940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.268034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.268276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.268527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.268738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.268883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.268981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.269237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.269490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.269733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.269883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.233 qpair failed and we were unable to recover it. 00:30:43.233 [2024-11-29 14:04:23.269987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.233 [2024-11-29 14:04:23.270078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.270205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.270471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.270686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.270831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.270921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.271159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.271400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.271609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.271851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.271973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.272073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.272313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.272580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.272786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.272910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.273003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.273240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.273509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.273718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.273827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.273918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.274161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.234 qpair failed and we were unable to recover it. 00:30:43.234 [2024-11-29 14:04:23.274377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.234 [2024-11-29 14:04:23.274501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.274595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.274719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.274756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.274907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.274998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.275109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.275326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.275558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.275789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.275909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.276033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.276265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.276486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.276708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.276882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.276984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.277189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.277403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.277668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.277905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.277993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.278139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.278330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.278542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.278795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.278915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.279007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.279128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.279154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.235 qpair failed and we were unable to recover it. 00:30:43.235 [2024-11-29 14:04:23.279273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.235 [2024-11-29 14:04:23.279402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.279429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.279523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.279615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.279641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.279728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.279850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.279874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.279960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.280200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.280417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.280689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.280837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.280961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.281199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.281408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.281650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.281890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.281998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.282089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.282295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.282553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.282788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.282930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.283024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.283287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.283552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.283824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.283942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.284060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.284282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.236 qpair failed and we were unable to recover it. 00:30:43.236 [2024-11-29 14:04:23.284528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.236 [2024-11-29 14:04:23.284645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.284730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.284817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.284842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.284929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.285170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.285414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.285655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.285779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.285881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.286126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.286365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.286591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.286830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.286950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.287070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.287287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.287581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.287790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.287934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.288058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.288264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.288517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.288784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.288891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.288995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.289230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.289474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.237 qpair failed and we were unable to recover it. 00:30:43.237 [2024-11-29 14:04:23.289704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.237 [2024-11-29 14:04:23.289822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.289848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.289975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.290176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.290398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.290673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.290816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.290934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.291138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.291380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.291629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.291870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.291979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.292072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.292288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.292556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.292788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.292932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.293053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.293264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.293537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.293778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.293948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.294052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.294273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.294522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.294730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.294844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.238 qpair failed and we were unable to recover it. 00:30:43.238 [2024-11-29 14:04:23.294946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.238 [2024-11-29 14:04:23.295038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.295155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.295372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.295585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.295833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.295945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.296030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.296275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.296512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.296758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.296868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.296956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.297184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.297421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.297626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.297832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.297973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.298093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.298293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.298513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.298743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.298891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.298983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.299212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.299451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.299665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.299814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.239 qpair failed and we were unable to recover it. 00:30:43.239 [2024-11-29 14:04:23.299906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.239 [2024-11-29 14:04:23.300001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.300117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.300328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.300569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.300801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.300949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.301042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.301252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.301482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.301695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.301899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.301998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.302120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.302331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.302565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.302837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.302948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.303046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.303290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.303526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.303797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.303919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.304033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.304126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.304153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.240 qpair failed and we were unable to recover it. 00:30:43.240 [2024-11-29 14:04:23.304272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.240 [2024-11-29 14:04:23.304367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.304398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.304506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.304623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.304649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.304746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.304863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.304888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.304972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.305208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.305485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.305784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.305898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.306023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.306285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.306498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.306731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.306846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.306950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.307213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.307452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.307665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.307873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.307991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.308080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.308368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.308588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.308850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.308998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.309089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.309179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.309204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.309291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.309411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.309436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.241 qpair failed and we were unable to recover it. 00:30:43.241 [2024-11-29 14:04:23.309558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.241 [2024-11-29 14:04:23.309650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.309675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.309775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.309867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.309893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.310017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.310219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.310440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.310649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.310894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.310992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.311107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.311371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.311587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.311789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.311938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.312030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.312232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.312477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.312713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.312831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.312949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.313191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.313386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.313630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.313870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.313992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.314107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.314369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.314577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.242 qpair failed and we were unable to recover it. 00:30:43.242 [2024-11-29 14:04:23.314770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.242 [2024-11-29 14:04:23.314852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.314877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.315000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.315235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.315485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.315714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.315822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.315917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.316126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.316332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.316562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.316944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.317033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.317326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.317538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.317756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.317874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.317962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.318233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.318453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.318694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.318839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.318933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.319200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.319403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.319622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.319859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.319970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.320060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.320179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.320203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.320323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.320440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.243 [2024-11-29 14:04:23.320465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.243 qpair failed and we were unable to recover it. 00:30:43.243 [2024-11-29 14:04:23.320568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.320665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.320690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.320784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.320908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.320932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.321048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.321253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.321515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.321711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.321856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.321942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.322179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.322374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.322594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.322851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.322975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.323094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.323330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.323568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.323765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.323874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.323967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.324262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.324478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.324705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.324819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.324941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.325182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.244 [2024-11-29 14:04:23.325425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.244 [2024-11-29 14:04:23.325567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.244 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.325657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.325741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.325765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.325861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.325979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.326096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.326339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.326562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.326808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.326926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.327016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.327222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.327412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.327648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.327909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.327997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.328143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.328346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.328611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.328814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.328933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.329023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.329260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.329514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.329777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.329895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.329984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.330069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.330094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.330180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.330304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.330328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.245 qpair failed and we were unable to recover it. 00:30:43.245 [2024-11-29 14:04:23.330449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.245 [2024-11-29 14:04:23.330541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.330566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.330652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.330744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.330770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.330858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.330949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.330974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.331091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.331348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.331575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.331771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.331890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.331979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.332212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.332422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.332627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.332825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.332974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.333065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.333288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.333502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.333801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.333986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.334078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.334291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.334518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.334720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.334836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.334931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.335022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.335048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.246 qpair failed and we were unable to recover it. 00:30:43.246 [2024-11-29 14:04:23.335139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.246 [2024-11-29 14:04:23.335219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.335341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.335569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.335804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.335944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.336076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.336303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.336567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.336802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.336942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.337042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.337248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.337460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.337703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.337819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.337938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.338144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.338347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.338558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.338825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.338966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.339083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.339290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.339498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.339739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.339860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.339943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.340151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.340353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.247 [2024-11-29 14:04:23.340624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.247 [2024-11-29 14:04:23.340743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.247 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.340837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.340952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.340977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.341064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.341322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.341534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.341773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.341916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.342006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.342207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.342441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.342649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.342852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.342974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.343100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.343322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.343541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.343749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.343862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.343986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.344207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.344447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.344647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.344846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.344958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.345044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.345311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.345546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.345774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.345913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.248 qpair failed and we were unable to recover it. 00:30:43.248 [2024-11-29 14:04:23.346008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.248 [2024-11-29 14:04:23.346105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.346477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.346692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.346798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.346914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.347159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.347360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.347585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.347760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.347860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.348169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.348410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.348664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.348809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.348898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.349155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.349387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.349613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.349820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.349935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.350034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.350250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.350498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.350711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.350825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.350973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.351241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.351482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.351715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.351827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.249 qpair failed and we were unable to recover it. 00:30:43.249 [2024-11-29 14:04:23.351916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.352033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.249 [2024-11-29 14:04:23.352058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.352150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.352375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.352591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.352827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.352945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.353033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.353239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.353546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.353756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.353876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.353998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.354243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.354459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.354657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.354864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.354988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.355135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.355370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.355628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.355829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.355945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.356035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.356232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.356478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.356687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.356827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.356920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.357122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.357325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.357540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.357748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.357889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.357988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.358073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.358098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.250 qpair failed and we were unable to recover it. 00:30:43.250 [2024-11-29 14:04:23.358194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.250 [2024-11-29 14:04:23.358308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.358333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.358432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.358578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.358603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.358698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.358787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.358811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.358926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.359159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.359439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.359710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.359827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.359926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.360132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.360411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.360655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.360800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.360920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.361149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.361349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.361600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.361807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.361984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.362104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.362311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.362557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.362790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.362909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.362997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.363299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.363529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.363734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.363848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.251 qpair failed and we were unable to recover it. 00:30:43.251 [2024-11-29 14:04:23.363994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.364082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.251 [2024-11-29 14:04:23.364107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.364227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.364436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.364669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.364783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.364903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.365154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.365398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.365604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.365802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.365940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.366036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.366232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.366475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.366698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.366899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.366981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.367097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.367330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.367539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.367806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.367924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.368045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.368291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.368503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.368740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.368850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.368973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.369216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.369454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.369680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.369849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.370056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.370080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.252 qpair failed and we were unable to recover it. 00:30:43.252 [2024-11-29 14:04:23.370162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.370244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.252 [2024-11-29 14:04:23.370268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.370397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.370607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.370878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.370991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.371080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.371314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.371541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.371753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.371893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.371979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.372206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.372426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.372628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.372867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.372975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.373064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.373304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.373521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.373756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.373895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.374014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.374212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.374423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.374662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.374801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.374920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.375128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.375351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.375579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.375796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.375924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.253 qpair failed and we were unable to recover it. 00:30:43.253 [2024-11-29 14:04:23.376015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.253 [2024-11-29 14:04:23.376128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.376240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.376478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.376723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.376834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.376963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.377173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.377387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.377609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.377850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.377992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.378141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.378443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.378723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.378876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.379014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.379255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.379521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.379723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.379835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.379926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.380194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.380413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.380651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.380894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.380980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.381097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.381308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.381521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.381742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.381886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.382023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.382261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.382489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.254 [2024-11-29 14:04:23.382735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.254 [2024-11-29 14:04:23.382876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.254 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.382969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.383184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.383418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.383656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.383865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.383996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.384109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.384318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.384559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.384818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.384930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.385021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.385256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.385467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.385678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.385891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.385995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.386122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.386386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.386597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.386839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.386957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.387048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.387306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.387560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.387784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.387896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.388000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.388237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.388444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.388696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.388816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.388938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.389024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.389049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.389172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.389264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.389289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.255 qpair failed and we were unable to recover it. 00:30:43.255 [2024-11-29 14:04:23.389411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.255 [2024-11-29 14:04:23.389533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.389560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.389653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.389769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.389794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.389886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.390117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.390344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.390563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.390795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.390904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.390990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.391205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.391405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.391641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.391875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.391991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.392095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.392326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.392566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.392831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.392945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.393043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.393258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.393486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.393752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.393904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.394001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.394205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.394430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.394663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.394875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.394987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.256 qpair failed and we were unable to recover it. 00:30:43.256 [2024-11-29 14:04:23.395108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.395230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.256 [2024-11-29 14:04:23.395254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.395371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.395647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.395850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.395970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.396053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.396349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.396567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.396848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.396966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.397064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.397278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.397509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.397758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.397869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.397964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.398208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.398434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.398650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.398862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.398965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.399068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.399308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.399550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.399882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.399972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.400225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.400450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.400656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.400864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.400982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.401101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.401363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.401587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.257 qpair failed and we were unable to recover it. 00:30:43.257 [2024-11-29 14:04:23.401798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.257 [2024-11-29 14:04:23.401883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.401907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.402000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.402207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.402448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.402662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.402804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.402902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.403164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.403378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.403613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.403848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.403994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.404115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.404329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.404551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.404795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.404937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.405023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.405220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.405429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.405669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.405909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.405996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.406103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.406335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.406543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.406828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.406938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.407028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.407233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.407491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.407766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.407904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.408000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.408215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.258 qpair failed and we were unable to recover it. 00:30:43.258 [2024-11-29 14:04:23.408522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.258 [2024-11-29 14:04:23.408649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.408752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.408845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.408870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.408958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.409196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.409442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.409655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.409803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.409898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.410168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.410382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.410591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.410837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.410947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.411083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.411301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.411528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.411760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.411907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.412023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.412249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.412460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.412661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.412800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.412898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.413130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.413390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.413627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.413866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.413978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.414097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.414322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.414564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.414766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.414902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.414998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.415078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.415104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.259 qpair failed and we were unable to recover it. 00:30:43.259 [2024-11-29 14:04:23.415206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.415326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.259 [2024-11-29 14:04:23.415351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.415474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.415561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.415584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.415681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.415763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.415788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.415883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.415976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.416126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.416363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.416589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.416850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.416995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.417114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.417345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.417587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.417802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.417943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.418042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.418251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.418463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.418737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.418876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.418976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.419211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.419424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.419625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.419862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.419975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.420066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.420280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.420523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.420772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.420883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.420974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.421191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.421484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.421704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.421845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.260 [2024-11-29 14:04:23.421935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.422020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.260 [2024-11-29 14:04:23.422044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.260 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.422144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.422382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.422586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.422802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.422924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.423014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.423258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.423483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.423677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.423786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.423873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.424127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.424361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.424592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.424844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.424955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.425070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.425317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.425570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.425781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.425926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.426050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.426283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.426492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.426734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.426847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.426939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.427180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.427428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.427725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.261 [2024-11-29 14:04:23.427883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.261 qpair failed and we were unable to recover it. 00:30:43.261 [2024-11-29 14:04:23.428011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.428229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.428473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.428685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.428885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.428997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.429080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.429311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.429543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.429747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.429863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.429957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.430183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.430423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.430619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.430862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.430987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.431101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.431336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.431553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.431780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.431903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.431999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.432205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.432459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.432702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.432849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.432973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.433217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.433434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.433670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.433879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.433999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.434100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.434196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.434221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.434337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.434461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.262 [2024-11-29 14:04:23.434487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.262 qpair failed and we were unable to recover it. 00:30:43.262 [2024-11-29 14:04:23.434611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.434699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.434724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.434808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.434954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.434979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.435073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.435336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.435545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.435747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.435889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.435983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.436275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.436489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.436705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.436823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.436943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.437205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.437415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.437634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.437871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.437983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.438071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.438317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.438525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.438749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.438899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.438994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.439258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.439521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.439776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.439905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.439997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.440249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.440504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.440773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.440889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.440988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.441082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.441109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.441200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.441321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.263 [2024-11-29 14:04:23.441346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.263 qpair failed and we were unable to recover it. 00:30:43.263 [2024-11-29 14:04:23.441442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.441536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.441562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.441663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.441797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.441823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.441912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.442153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.442588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.442801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.442914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.443006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.443245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.443524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.443745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.443859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.443952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.444164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.444415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.444706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.444852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.444939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.445143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.445379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.445629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.445898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.445991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.446110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.446328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.446573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.446808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.446921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.447016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.447249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.447523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.447768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.447895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.264 [2024-11-29 14:04:23.447988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.448085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.264 [2024-11-29 14:04:23.448112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.264 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.448207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.448420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.448666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.448781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.448874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.449154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.449370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.449596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.449811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.449957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.450078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.450382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.450627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.450830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.450981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.451128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.451339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.451556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.451777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.451893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.451985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.452235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.452510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.452717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.452836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.452930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.453198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.453407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.265 [2024-11-29 14:04:23.453639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.265 [2024-11-29 14:04:23.453765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.265 qpair failed and we were unable to recover it. 00:30:43.549 [2024-11-29 14:04:23.453866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.549 [2024-11-29 14:04:23.453989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.549 [2024-11-29 14:04:23.454015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.549 qpair failed and we were unable to recover it. 00:30:43.549 [2024-11-29 14:04:23.454148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.549 [2024-11-29 14:04:23.454272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.549 [2024-11-29 14:04:23.454300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.549 qpair failed and we were unable to recover it. 00:30:43.549 [2024-11-29 14:04:23.454428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.454520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.454546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.454669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.454764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.454789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.454907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.454994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.455144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.455345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.455589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.455809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.455958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.456050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.456348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.456565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.456763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.456877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.456974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.457218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.457493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.457705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.457822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.457922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.458186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.458414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.458632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.550 [2024-11-29 14:04:23.458844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.550 [2024-11-29 14:04:23.458998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.550 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.459092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.459311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.459520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.459880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.459978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.460183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.460441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.460679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.460798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.460922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.461135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.461344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.461600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.461804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.461926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.462008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.462236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.462703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.462846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.462962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.463057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.463082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.463173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.463261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.463286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.551 qpair failed and we were unable to recover it. 00:30:43.551 [2024-11-29 14:04:23.463416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.551 [2024-11-29 14:04:23.463512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.463539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.463660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.463778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.463804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.463948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.464162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.464378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.464607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.464848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.464963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.465054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.465257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.465534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc16c000b90 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.465789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.465913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.466016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.466216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.466474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.466687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.466848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.466941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.467156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.467383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.467613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.467890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.467985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.468133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.468378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.468622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.468791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.552 qpair failed and we were unable to recover it. 00:30:43.552 [2024-11-29 14:04:23.468939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.469026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.552 [2024-11-29 14:04:23.469050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.469134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.469372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.469617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.469826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.469944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.470040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.470277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.470486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.470737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.470878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.470976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.471224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.471507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.471750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.471860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.471981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.472216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.472448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.472724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.472841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.472961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.473169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.473422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.473655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.473916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.473998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.474139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.474343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.474556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.474797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.474934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.475027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.475249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.475500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.553 qpair failed and we were unable to recover it. 00:30:43.553 [2024-11-29 14:04:23.475701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.553 [2024-11-29 14:04:23.475813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.475838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.475927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.476152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.476359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.476604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.476815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.476958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.477059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.477269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.477541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.477770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.477884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.478008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.478278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.478539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.478740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.478891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.478982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.479219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.479434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.479655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.479894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.479992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.480107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.480340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.480554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.480757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.480870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.480988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.481214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.481439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.481647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.481909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.481998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.482023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.482146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.482231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.482256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.554 qpair failed and we were unable to recover it. 00:30:43.554 [2024-11-29 14:04:23.482362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.554 [2024-11-29 14:04:23.482453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.482486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.482587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.482675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.482701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.482800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.482888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.482912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.483063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.483299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.483559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.483777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.483887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.483982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.484184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.484407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.484654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.484770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.484865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.485140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.485362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.485582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.485819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.485966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.486086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.486285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.486524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.486738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.486909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.486999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.487276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.487494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.487756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.487895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.487994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.488111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.488136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.555 qpair failed and we were unable to recover it. 00:30:43.555 [2024-11-29 14:04:23.488235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.488316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.555 [2024-11-29 14:04:23.488340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.488433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.488648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.488842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.488955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.489067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.489283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.489490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.489692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.489806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.489902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.490159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.490403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.490607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.490873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.490983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.491072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.491291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.491541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.491776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.491915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.492017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.492283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.492527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.492757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.492869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.492958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.493166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.493405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.493649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.493869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.493983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.494070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.494315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.494582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.556 [2024-11-29 14:04:23.494797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.556 [2024-11-29 14:04:23.494938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.556 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.495086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.495345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.495555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.495792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.495906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.496034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.496269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.496489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.496730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.496838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.496936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.497139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.497350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.497553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.497752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.497898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.497980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.498183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.498427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.498661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.498884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.498979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.499109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.499310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.499535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.499737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.499851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.499945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.500184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.500398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.500635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.500846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.500957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.501083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.501173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.501198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.557 [2024-11-29 14:04:23.501358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.501479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.557 [2024-11-29 14:04:23.501503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.557 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.501624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.501708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.501732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.501819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.501906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.501930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.502055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.502253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.502503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.502716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.502828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.502921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.503160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.503412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.503660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.503901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.503995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.504138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.504386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.504595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.504803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.504910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.505024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.505261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.505542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.505744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.505890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.506016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.506249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.506491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.506716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.506854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.506950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.507159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.507364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.507630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.507852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.507960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.558 [2024-11-29 14:04:23.508089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.508180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.558 [2024-11-29 14:04:23.508206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.558 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.508311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.508524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.508731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.508847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.508972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.509179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.509381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.509625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.509878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.509993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.510108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.510347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.510600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.510806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.510956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.511049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.511259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.511467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.511697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.511841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.511934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.512181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.512436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.512668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.512984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.513160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.513412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.513684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.513790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.513911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.514000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.514024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.559 [2024-11-29 14:04:23.514145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.514237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.559 [2024-11-29 14:04:23.514262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.559 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.514348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.514619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.514865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.514983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.515074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.515339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.515549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.515762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.515877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.515972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.516176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.516444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.516680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.516817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.516942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.517174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.517389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.517600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.517825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.517968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.518053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.518284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.518489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.518704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.518809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.518904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.519132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.519379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.519675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.519794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.519949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.520148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.520371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.520591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.560 [2024-11-29 14:04:23.520832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.560 [2024-11-29 14:04:23.520953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.560 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.521041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.521249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.521475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.521675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.521906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.521999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.522113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.522319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.522551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.522775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.522912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.523003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.523236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.523512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.523716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.523840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.523935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.524192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.524424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.524662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.524778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.524908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.525142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.525345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.525579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.525818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.525959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.526058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.526271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.526502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.526712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.526851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.526950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.527064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.527092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.527213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.527326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.527350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.561 qpair failed and we were unable to recover it. 00:30:43.561 [2024-11-29 14:04:23.527455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.561 [2024-11-29 14:04:23.527542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.527566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.527666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.527753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.527778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.527869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.527984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.528156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.528372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.528618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.528826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.528966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.529081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.529307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.529564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.529779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.529891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.529990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.530219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.530441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.530647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.530844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.530954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.531045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.531302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.531509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.531766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.531880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.531969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.532171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.532378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.532593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.532820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.532937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.533036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.533251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.533470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.533700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.533819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.562 qpair failed and we were unable to recover it. 00:30:43.562 [2024-11-29 14:04:23.533934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.534051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.562 [2024-11-29 14:04:23.534076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.534170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.534369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.534612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.534879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.534995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.535111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.535351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.535579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.535784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.535899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.535986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.536220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.536477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.536720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.536832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.536918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.537174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.537389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.537636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.537836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.537977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.538073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.538343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.538585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.538810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.538949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.539040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.539283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.539533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.539747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.539859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.539944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.540188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.540453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.563 [2024-11-29 14:04:23.540665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.563 [2024-11-29 14:04:23.540771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.563 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.540923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.541134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.541402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.541682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.541822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.541946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.542174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.542412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.542613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.542786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.542905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.543144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.543341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.543581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.543794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.543937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.544065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.544280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.544527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.544768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.544875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.544974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.545200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.545405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.545644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.545879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.545994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.546084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.546313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.546550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.564 qpair failed and we were unable to recover it. 00:30:43.564 [2024-11-29 14:04:23.546762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.564 [2024-11-29 14:04:23.546886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.546978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.547209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.547425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.547665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.547806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.547928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.548193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.548405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.548619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.548829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.548966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.549115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.549379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.549629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.549873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.549978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.550071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.550278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.550520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.550791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.550937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.551057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.551290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.551510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.551735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.551875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.551965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.552193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.552425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.552631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.552867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.552979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.553076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.553348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.565 [2024-11-29 14:04:23.553587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.565 [2024-11-29 14:04:23.553732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.565 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.553848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.553991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.554139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.554378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.554598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.554830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.554941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.555028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.555289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.555514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.555722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.555862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.555986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.556216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.556456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.556664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.556800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.556922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.557124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.557357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.557592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.557829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.557944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.558045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.558272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.558491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.558759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.558873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.558974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.559236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.559466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.559702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.559852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.559976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.560183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.566 [2024-11-29 14:04:23.560446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.566 [2024-11-29 14:04:23.560558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.566 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.560658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.560778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.560801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.560891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.561121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.561360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.561600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.561846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.561958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.562051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.562263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.562473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.562695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.562838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.562961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.563160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.563372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.563586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.563793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.563942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.564034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.564276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.564522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.564740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.564892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.565019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.565277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.565520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.565734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.565846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.565944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.566155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.566391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.566602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.566834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.566951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.567 [2024-11-29 14:04:23.567035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.567168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-29 14:04:23.567192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.567 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.567278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.567536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.567746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.567880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.567979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.568215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.568471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.568675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.568797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.568919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.569164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.569381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.569630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.569904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.569983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.570129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.570336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.570567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.570808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.570918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.571041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.571270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.571486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.571696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.571837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.571927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.572140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.572421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.572654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.572795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.572918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.573004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.573029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.573142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.573237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-29 14:04:23.573262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.568 qpair failed and we were unable to recover it. 00:30:43.568 [2024-11-29 14:04:23.573357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.573605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.573814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.573927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.574020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.574232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.574478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.574750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.574866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.574958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.575190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.575437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.575677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.575806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.575896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.576132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.576372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.576621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.576865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.576986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.577094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.577301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.577599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.577801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.577947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.578047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.578263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.578474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.578693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.578803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.578919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.579147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.579419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.579620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.579828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-29 14:04:23.579947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.569 qpair failed and we were unable to recover it. 00:30:43.569 [2024-11-29 14:04:23.580069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.580302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.580538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.580787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.580901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.580995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.581257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.581489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.581727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.581841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.581934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.582195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.582411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.582634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.582842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.582960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.583048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.583279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.583497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.583725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.583841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.583941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.584181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.584414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.584685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.584891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.584981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.585097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.585307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.585518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.585723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.585837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.585929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.586194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.586399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.570 [2024-11-29 14:04:23.586539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.570 qpair failed and we were unable to recover it. 00:30:43.570 [2024-11-29 14:04:23.586659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.586750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.586774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.586869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.586950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.586974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.587068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.587280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.587519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.587757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.587879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.587970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.588197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.588432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.588677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.588812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.588942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.589177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.589385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.589628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.589749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.589864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.590154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.590384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.590598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.590840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.590967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.591066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.591295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.591519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.591764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.591913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.592063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.592274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.592489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.592693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.592812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.592936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.593035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.593059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.593148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.593235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.593263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.571 qpair failed and we were unable to recover it. 00:30:43.571 [2024-11-29 14:04:23.593350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.571 [2024-11-29 14:04:23.593471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.593496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.593614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.593701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.593725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.593843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.593929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.593954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.594044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.594285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.594508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.594741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.594855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.594946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.595150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.595352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.595595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.595843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.595953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.596065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.596291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.596548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.596748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.596867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.596964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.597219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.597465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.597666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.597775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.597907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.598138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.598430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.598659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.598862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.598980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.599075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.599285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.599532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.599798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.599936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.572 qpair failed and we were unable to recover it. 00:30:43.572 [2024-11-29 14:04:23.600029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.572 [2024-11-29 14:04:23.600122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.600296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.600538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.600745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.600865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.600956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.601193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.601452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.601691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.601809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.601933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.602125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.602327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.602564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.602813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.602929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.603018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.603242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.603465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.603704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.603848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.603969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.604184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.604381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.604630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.604745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.604865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.605133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.605374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.605589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.605792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.605904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.573 qpair failed and we were unable to recover it. 00:30:43.573 [2024-11-29 14:04:23.606000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.606117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.573 [2024-11-29 14:04:23.606141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.606230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.606437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.606644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.606756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.606905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.607167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.607384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.607620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.607875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.607985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.608085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.608322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.608553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.608825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.608962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.609085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.609292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.609553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.609758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.609870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.609962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.610200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.610497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.610732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.610845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.610936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.611154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.611348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.611615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.611826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.611941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.612031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.612285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.612552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.574 [2024-11-29 14:04:23.612795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.574 [2024-11-29 14:04:23.612914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.574 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.613030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.613242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.613450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.613717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.613826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.613917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.614187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.614400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.614616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.614850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.614968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.615091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.615336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.615580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.615820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.615989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.616081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.616325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.616540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.616751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.616919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.617012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.617243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.617469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.617710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.617829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.617977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.618193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.618429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.618638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.618784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.618943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.619209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.619421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.575 [2024-11-29 14:04:23.619713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.575 [2024-11-29 14:04:23.619856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.575 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.619977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.620207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.620414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.620622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.620874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.620988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.621088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.621380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.621588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.621790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.621946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.622097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.622303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.622522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.622735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.622845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.622970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.623206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.623423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.623662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.623865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.623977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.624067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.624304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.624520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.624776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.624884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.625029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.625267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.625478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.625724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.625869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.625966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.626196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.576 [2024-11-29 14:04:23.626434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.576 [2024-11-29 14:04:23.626554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.576 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.626659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.626783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.626879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.627170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.627401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.627643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.627843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.627985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.628070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.628291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.628569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.628781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.628896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.628993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.629245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.629513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.629733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.629848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.629938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.630168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.630484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.630696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.630817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.630915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.631172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.631411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.631605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.631856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.631970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.632086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.632345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.632556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.577 [2024-11-29 14:04:23.632692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.577 qpair failed and we were unable to recover it. 00:30:43.577 [2024-11-29 14:04:23.632782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.632872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.632896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.633021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.633228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.633483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.633700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.633813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.633932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.634174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.634418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.634625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.634824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.634960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.635089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.635280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.635551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.635791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.635899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.636014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.636222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.636451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.636688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.636898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.636992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.637144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.637346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.637560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.637827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.637966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.638083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.638308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.638528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.638767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.638880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.638979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.639095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.639119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.639210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.639293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.578 [2024-11-29 14:04:23.639319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.578 qpair failed and we were unable to recover it. 00:30:43.578 [2024-11-29 14:04:23.639469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.639589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.639614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.639706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.639795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.639820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.639907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.639999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.640120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.640384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.640597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.640866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.640984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.641099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.641373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.641586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.641830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.641951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.642045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.642309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.642518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.642781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.642894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.642979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.643203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.643468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.643678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.643823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.643910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.644114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.644346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.644575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.644786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.644905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.644997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.645229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.645449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.645686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.645833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.645929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.646046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.579 [2024-11-29 14:04:23.646071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.579 qpair failed and we were unable to recover it. 00:30:43.579 [2024-11-29 14:04:23.646171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.646391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.646607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.646842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.646960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.647043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.647281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.647532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.647743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.647860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.648010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.648215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.648457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.648675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.648814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.648902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.649132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.649359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.649603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.649835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.649948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.650046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.650282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.650527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.650761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.650885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.650980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.651450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.651656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.651891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.651978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.652095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.652292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.652520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.580 [2024-11-29 14:04:23.652662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.580 qpair failed and we were unable to recover it. 00:30:43.580 [2024-11-29 14:04:23.652754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.652841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.652864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.652951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.653194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.653406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.653650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.653846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.653984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.654100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.654296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.654515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.654724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.654878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.654995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.655226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.655475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.655754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.655866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.655957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.656199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.656421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.656635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.656865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.656977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.657072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.657341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.657548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.657758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.657902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.658019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.658246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.658497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.658775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.658880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.659005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.659099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.659122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.659211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.659300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.581 [2024-11-29 14:04:23.659325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.581 qpair failed and we were unable to recover it. 00:30:43.581 [2024-11-29 14:04:23.659426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.659639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.659871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.659995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.660089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.660307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.660537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.660743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.660886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.660972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.661185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.661418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.661716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.661870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.661996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.662208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.662461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.662669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.662868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.662984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.663111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.663424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.663687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.663796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.663890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.664004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.664029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.664154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.664238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.582 [2024-11-29 14:04:23.664262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.582 qpair failed and we were unable to recover it. 00:30:43.582 [2024-11-29 14:04:23.664406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.664520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.664552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.664695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.664800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.664830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.664970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.665250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.665534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.665752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.665896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.665988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.666219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.666424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.666670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.666886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.666983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.667127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.667328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.667554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.667787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.667898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.667987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.668215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.668465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.668675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.668894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.668986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.669099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.669310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.669529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.669741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.669853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.669941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.670171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.670416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.670649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.670790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.670914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.671027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.583 [2024-11-29 14:04:23.671051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.583 qpair failed and we were unable to recover it. 00:30:43.583 [2024-11-29 14:04:23.671140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.671345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.671623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.671856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.671997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.672090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.672350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.672581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.672815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.672927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.673019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.673255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.673526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.673757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.673881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.673981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.674235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.674468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.674735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.674851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.674941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.675169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.675375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.675599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.675798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.675911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.676002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.676242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.676495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.676721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.676837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.676933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.677137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.677340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.677561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.584 [2024-11-29 14:04:23.677686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.584 qpair failed and we were unable to recover it. 00:30:43.584 [2024-11-29 14:04:23.677785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.677881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.677905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.678029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.678258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.678469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.678678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.678882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.678991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.679118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.679357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.679615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.679852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.679964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.680054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.680315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.680575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.680770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.680918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.681041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.681278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.681523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.681734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.681849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.681940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.682140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.682353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.682591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.682830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.682942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.683066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.683271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.683529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.683787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.683910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.684001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.684095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.684121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.684213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.684305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.585 [2024-11-29 14:04:23.684330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.585 qpair failed and we were unable to recover it. 00:30:43.585 [2024-11-29 14:04:23.684426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.684546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.684571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.684695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.684815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.684839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.684930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.685173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.685408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.685618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.685856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.685969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.686099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.686337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.686561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.686763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.686931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.687017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.687228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.687462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.687692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.687806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.688124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.688350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.688625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.688849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.688988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.689073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.689298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.689566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.689773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.689944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.690035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.690240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.690459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.690719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.690855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.690975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.691063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.586 [2024-11-29 14:04:23.691087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.586 qpair failed and we were unable to recover it. 00:30:43.586 [2024-11-29 14:04:23.691175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.691433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.691640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.691848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.691997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.692099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.692369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.692578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.692812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.692962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.693047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.693347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.693552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.693752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.693893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.693982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.694183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.694378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.694647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.694874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.694997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.695117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.695406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.695646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.695878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.695993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.696119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.696347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.696566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.696797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.696909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.587 [2024-11-29 14:04:23.696998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.697124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.587 [2024-11-29 14:04:23.697148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.587 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.697239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.697463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.697693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.697808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.697931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.698166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.698427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.698683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.698889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.698986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.699110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.699348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.699560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.699968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.700058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.700336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.700534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.700775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.700894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.700987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.701208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.701413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.701650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.701866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.701986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.702074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.702318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.702532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.702765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.702882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.702977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.703172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.703417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.703684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.588 [2024-11-29 14:04:23.703806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.588 qpair failed and we were unable to recover it. 00:30:43.588 [2024-11-29 14:04:23.703897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.704134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.704344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.704612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.704837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.704948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.705043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.705305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.705529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.705768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.705920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.706038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.706270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.706507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.706707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.706822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.706953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.707155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.707418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.707680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.707825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.707945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.708187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.708622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.708884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.708998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.709091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.709353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.709572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.709807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.709923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.710027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.710263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.710480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.589 [2024-11-29 14:04:23.710596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.589 qpair failed and we were unable to recover it. 00:30:43.589 [2024-11-29 14:04:23.710694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.710810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.710836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.710934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.711136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.711376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.711589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.711838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.711956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.712043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.712259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.712505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.712706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.712850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.712935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.713131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.713343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.713578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.713840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.713994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.714088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.714291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.714516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.714722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.714837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.714932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.715129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.715417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.715624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.715858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.715977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.716094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.716309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.716588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.716806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.716974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.717071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.717186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.717210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.590 qpair failed and we were unable to recover it. 00:30:43.590 [2024-11-29 14:04:23.717300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.590 [2024-11-29 14:04:23.717399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.717423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.717549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.717644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.717668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.717764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.717888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.717912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.718041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.718293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.718554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.718761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.718916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.719011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.719243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.719452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.719659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.719871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.719988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.720112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.720343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.720588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.720817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.720937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.721028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.721238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.721467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.721678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.721792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.721939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.722172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.722405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.722641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.722869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.722992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.723016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.723104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.723191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.723216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-29 14:04:23.723332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.723460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.591 [2024-11-29 14:04:23.723486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.723608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.723698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.723723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.723842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.723966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.723991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.724079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.724290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.724500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.724707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.724820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.724919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.725166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.725380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.725625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.725870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.725982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.726067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.726330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.726533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.726775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.726883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.726974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.727185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.727416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.727676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.727879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.727999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.728129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.728335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.728579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.728796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.728904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.728996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.729262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.729538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.729774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.729891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.729975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.730264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.730511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.592 [2024-11-29 14:04:23.730626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-29 14:04:23.730712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.730820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.730844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.730953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.731194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.731416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.731630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.731821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.731934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.732027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.732257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.732532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.732773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.732889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.733007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.733221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.733427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.733625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.733859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.733975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.734066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.734326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.734560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.734777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.734916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.735005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.735216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.735447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.735681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.735799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.735900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.736147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.736423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.736686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.736905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.736993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.737103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.737379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.737610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-29 14:04:23.737813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.593 [2024-11-29 14:04:23.737898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.737921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.738040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.738250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.738494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.738751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.738860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.738957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.739191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.739398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.739637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.739851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.739968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.740067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.740277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.740501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.740708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.740846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.740964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.741195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.741459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.741701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.741844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.741937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.742148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.742385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.742633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.742896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.742988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.743128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.743391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.743610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.743757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.743905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.744171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.744371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.744610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.744830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.744976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.594 [2024-11-29 14:04:23.745096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.745186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.594 [2024-11-29 14:04:23.745210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.594 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.745313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.745529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.745736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.745893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.746009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.746224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.746527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.746765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.746905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.747030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.747238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.747452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.747653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.747791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.747886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.748118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.748327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.748566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.748805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.748913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.749004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.749287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.749510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.749746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.749889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.749983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.750224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.750441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.750667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.750830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.750916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.751120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.751362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.751571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.595 qpair failed and we were unable to recover it. 00:30:43.595 [2024-11-29 14:04:23.751809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.595 [2024-11-29 14:04:23.751931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.751956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.752088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.752318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.752558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.752820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.752925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.753051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.753310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.753527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.753758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.753875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.753967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.754205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.754471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.754706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.754819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.754908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.755130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.755363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.755614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.755850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.755975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.756116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.756381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.756672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.756868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.756989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.757015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.757135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.757228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.757252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.596 qpair failed and we were unable to recover it. 00:30:43.596 [2024-11-29 14:04:23.757336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.757463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.596 [2024-11-29 14:04:23.757488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.757581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.757671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.757697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.757795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.757917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.757942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.758038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.758243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.758461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.758718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.758830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.758949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.759190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.759456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.759688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.759798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.759943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.760170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.760415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.760617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.760842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.760985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.761084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.761322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.761532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.761742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.761855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.761945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.762154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.597 qpair failed and we were unable to recover it. 00:30:43.597 [2024-11-29 14:04:23.762390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.597 [2024-11-29 14:04:23.762502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.762631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.762784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.762809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.762904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.762996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.763112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.763355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.763582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.763817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.763960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.764055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.764296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.764516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.764743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.764881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.764969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.765198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.765405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.765607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.765820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.765938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.766022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.766265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.766488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.766705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.766849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.766972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.767096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.767120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.598 [2024-11-29 14:04:23.767214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.767314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.598 [2024-11-29 14:04:23.767338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.598 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.767434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.767536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.767560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.767650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.767755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.767780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.767887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.768126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.768368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.768590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.768791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.768907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.769057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.769294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.769531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.769763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.769873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.770001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.770207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.770419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.770701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.770814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.770911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.771146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.771382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.771647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.771846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.771964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.772052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.772167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.772191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.599 [2024-11-29 14:04:23.772284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.772368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.599 [2024-11-29 14:04:23.772406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.599 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.772504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.772588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.772612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.772734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.772828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.772852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.772947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.773175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.773381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.773652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.773856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.773964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.774087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.774320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.774526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.774748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.774867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.774961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.775206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.775463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.775736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.775874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.775984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.776249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc174000b90 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.776500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.776705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.776838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.776956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.777236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.600 qpair failed and we were unable to recover it. 00:30:43.600 [2024-11-29 14:04:23.777441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.600 [2024-11-29 14:04:23.777557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.777644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.777767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.777791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.777878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.777967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.777992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.778077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.778316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.778584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.778805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.778919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.779039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.779265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.779496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.779708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.779836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.779927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.780144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.780355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.780603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.780829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.780942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.781070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.781379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.781618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.781738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.781893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.782041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.782065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.601 qpair failed and we were unable to recover it. 00:30:43.601 [2024-11-29 14:04:23.782157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.601 [2024-11-29 14:04:23.782244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.782357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.782582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.782800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.782921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.783016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.783223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.783432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.783638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.783874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.783987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.784115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.784311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.784729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.784841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.784942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.785196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.785440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.785705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.785843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.785967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.786219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.786427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.786733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.786903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.787002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.787207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.787473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.787695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.787837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.602 qpair failed and we were unable to recover it. 00:30:43.602 [2024-11-29 14:04:23.788008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.602 [2024-11-29 14:04:23.788112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.788263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.788510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.788800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.788915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.789009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.789234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.789504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.789714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.789830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.789948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.790160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.790406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.790648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 14:04:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:43.603 [2024-11-29 14:04:23.790739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.790769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 14:04:23 -- common/autotest_common.sh@862 -- # return 0 00:30:43.603 [2024-11-29 14:04:23.790864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 14:04:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:43.603 [2024-11-29 14:04:23.790984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 14:04:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:43.603 [2024-11-29 14:04:23.791107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.603 [2024-11-29 14:04:23.791195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.791340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.791588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.791822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.791938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.792056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.792260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.792483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.603 qpair failed and we were unable to recover it. 00:30:43.603 [2024-11-29 14:04:23.792739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.603 [2024-11-29 14:04:23.792828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.792854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.792980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.793221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.793459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.793666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.793810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.793938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.794172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.794413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.794652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.794862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.794982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.795137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.795372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.795619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.795857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.795984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.796098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.796327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.796566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.796776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.796913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.797007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.797197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.797446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.797658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.797777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.604 [2024-11-29 14:04:23.797924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.798019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.604 [2024-11-29 14:04:23.798043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.604 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.798127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.798364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.798579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.798796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.798941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.799028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.799300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.799516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.799725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.799838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.799962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.800177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.800415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.800690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.800897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.800988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.801102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.801314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.801531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.801771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.801905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.802029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.802266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.802509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.802721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.802853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.605 qpair failed and we were unable to recover it. 00:30:43.605 [2024-11-29 14:04:23.802945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.803038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.605 [2024-11-29 14:04:23.803063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.803155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.803365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.803581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.803811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.803933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.804020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.804261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.804516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.804784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.804943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.606 [2024-11-29 14:04:23.805031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.805132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.606 [2024-11-29 14:04:23.805156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.606 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.805245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.805494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.805719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.805886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.805977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.806201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.806406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.806647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.806796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.806953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.807159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.807353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.807620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.807838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.807991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.808111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.808255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.808279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.808377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.808500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.808525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.870 [2024-11-29 14:04:23.808640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 14:04:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:43.870 [2024-11-29 14:04:23.808740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.870 [2024-11-29 14:04:23.808764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.870 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.808851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 14:04:23 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:43.871 [2024-11-29 14:04:23.808936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.808961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.871 [2024-11-29 14:04:23.809116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.871 [2024-11-29 14:04:23.809260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.809381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.809666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.809875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.809997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.810120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.810330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.810546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.810767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.810916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.811015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.811225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.811486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.811703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.811847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.811965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.812172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.812365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.812582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.812798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.812919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.813036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.813270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.813488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.871 qpair failed and we were unable to recover it. 00:30:43.871 [2024-11-29 14:04:23.813761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.871 [2024-11-29 14:04:23.813852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.813876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.813963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.814182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.814447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.814679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.814818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.814935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.815140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.815403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.815619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.815825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.815970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.816073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.816289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.816552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.816800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.816918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.817038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.817283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.817501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.817707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.817846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.817933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.818197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.818416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.872 qpair failed and we were unable to recover it. 00:30:43.872 [2024-11-29 14:04:23.818649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.872 [2024-11-29 14:04:23.818796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.818919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.819134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.819343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.819575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.819815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.819931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.820033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.820242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.820475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.820712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.820859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.820969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.821227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.821447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.821713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.821831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.821950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.822158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.822431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.822633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.822885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.822976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.823117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.823344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.873 qpair failed and we were unable to recover it. 00:30:43.873 [2024-11-29 14:04:23.823561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.873 [2024-11-29 14:04:23.823687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.823712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.823807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.823937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.823961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.824055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.824285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.824543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.824762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.824880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.824997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.825230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.825537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.825786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.825954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.826076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.826315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.826782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.826894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.826984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.827230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.827485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.827695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.827813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.827908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.828144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.828348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.828572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.874 qpair failed and we were unable to recover it. 00:30:43.874 [2024-11-29 14:04:23.828784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.874 [2024-11-29 14:04:23.828876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.828902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.828994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.829277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.829493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.829787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.829907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.830000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.830243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.830461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.830673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 Malloc0 00:30:43.875 [2024-11-29 14:04:23.830797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.830821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.830916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.831141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.875 [2024-11-29 14:04:23.831292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 14:04:23 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:43.875 [2024-11-29 14:04:23.831418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.875 [2024-11-29 14:04:23.831621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.875 [2024-11-29 14:04:23.831727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.831852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.831962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.832049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.832265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.832562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.832816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.832965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.833053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.833143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.833168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.833261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.833418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.833442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.875 qpair failed and we were unable to recover it. 00:30:43.875 [2024-11-29 14:04:23.833558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.875 [2024-11-29 14:04:23.833654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.833680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.833776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.833858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.833882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.833975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.834205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.834439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834517] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:43.876 [2024-11-29 14:04:23.834555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.834673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.834809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.834936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.835177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.835380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.835606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.835857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.835976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.836094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.836309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.836540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.836781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.836898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.837022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.837263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.876 [2024-11-29 14:04:23.837548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.876 [2024-11-29 14:04:23.837735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.876 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.837880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.838185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.838480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc168000b90 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.838808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.838925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.839050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.839380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.839590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.839820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.839937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.840060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.840293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.840551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.840769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.840897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.840997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.841270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.841492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.841761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.841887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.841978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.842214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.842426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.842648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.877 [2024-11-29 14:04:23.842747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 [2024-11-29 14:04:23.842783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.842899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 14:04:23 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:43.877 [2024-11-29 14:04:23.843045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.877 [2024-11-29 14:04:23.843070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.877 qpair failed and we were unable to recover it. 00:30:43.877 [2024-11-29 14:04:23.843161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.877 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.878 [2024-11-29 14:04:23.843274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.843429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.843655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.843887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.843981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.844096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.844387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.844599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.844818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.844960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.845056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.845293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.845513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.845744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.845883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.845976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.846179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.846418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.846661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.846800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.846900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.847162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.847419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.847668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.847812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.847911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.848007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.848031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.848149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.848241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.878 [2024-11-29 14:04:23.848266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.878 qpair failed and we were unable to recover it. 00:30:43.878 [2024-11-29 14:04:23.848421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.848669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.848865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.848983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.849108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.849332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.849589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.849803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.849950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.850050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.850261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.850489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.850711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.879 [2024-11-29 14:04:23.850798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.850822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.850943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 14:04:23 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:43.879 [2024-11-29 14:04:23.851034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.879 [2024-11-29 14:04:23.851173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.879 [2024-11-29 14:04:23.851261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.851415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.851668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.851839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.851941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.852159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.852415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.852650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.852850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.852966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.853058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.853178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.853202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.879 qpair failed and we were unable to recover it. 00:30:43.879 [2024-11-29 14:04:23.853291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.879 [2024-11-29 14:04:23.853377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.853408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.853501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.853593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.853618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.853719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.853815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.853839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.853927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.854140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.854429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.854643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.854848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.854989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.855078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.855288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.855518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.855743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.855868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.855955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.856186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.856493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.856720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.856829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.856953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.857182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.857436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.857766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.857886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.858006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.858234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.858435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.880 [2024-11-29 14:04:23.858553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.880 qpair failed and we were unable to recover it. 00:30:43.880 [2024-11-29 14:04:23.858644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.858740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.858765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.881 [2024-11-29 14:04:23.858863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.858959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.858984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 14:04:23 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:43.881 [2024-11-29 14:04:23.859112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.881 [2024-11-29 14:04:23.859197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.881 [2024-11-29 14:04:23.859304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.859545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.859746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.859895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.860070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.860342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.860602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.860840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.860947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.861033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.861315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.861553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.861761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.861874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.861996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.862258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.862503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.881 [2024-11-29 14:04:23.862621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8b0f20 with addr=10.0.0.2, port=4420 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 [2024-11-29 14:04:23.862772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:43.881 [2024-11-29 14:04:23.865237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.881 [2024-11-29 14:04:23.865354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.881 [2024-11-29 14:04:23.865382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.881 [2024-11-29 14:04:23.865421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.881 [2024-11-29 14:04:23.865438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.881 [2024-11-29 14:04:23.865475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.881 qpair failed and we were unable to recover it. 00:30:43.881 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.881 14:04:23 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:43.881 14:04:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.881 14:04:23 -- common/autotest_common.sh@10 -- # set +x 00:30:43.881 14:04:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.881 14:04:23 -- host/target_disconnect.sh@58 -- # wait 2432675 00:30:43.881 [2024-11-29 14:04:23.875116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.881 [2024-11-29 14:04:23.875266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.881 [2024-11-29 14:04:23.875294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.881 [2024-11-29 14:04:23.875308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.881 [2024-11-29 14:04:23.875327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.881 [2024-11-29 14:04:23.875356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.885124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.885271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.885297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.885312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.885325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.885353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.895146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.895252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.895278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.895292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.895305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.895333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.905078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.905177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.905203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.905217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.905229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.905257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.915132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.915253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.915280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.915294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.915306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.915337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.925282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.925416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.925443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.925458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.925470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.925500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.935178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.935289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.935315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.935329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.935342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.935370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.945165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.945297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.945323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.945337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.945350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.945377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.955208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.955307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.955334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.882 [2024-11-29 14:04:23.955348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.882 [2024-11-29 14:04:23.955360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.882 [2024-11-29 14:04:23.955401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.882 qpair failed and we were unable to recover it. 00:30:43.882 [2024-11-29 14:04:23.965329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.882 [2024-11-29 14:04:23.965435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.882 [2024-11-29 14:04:23.965462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:23.965476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:23.965494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:23.965523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:23.975255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:23.975388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:23.975419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:23.975434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:23.975447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:23.975476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:23.985357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:23.985503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:23.985529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:23.985543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:23.985556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:23.985584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:23.995415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:23.995539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:23.995565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:23.995579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:23.995591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:23.995621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.005360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.005467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.005494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.005509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.005522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.005550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.015512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.015628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.015654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.015667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.015680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.015711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.025498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.025611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.025637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.025650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.025663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.025696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.035493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.035590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.035616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.035630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.035643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.035670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.045511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.045610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.045635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.045649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.045662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.045690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.055596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.055699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.055724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.055738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.055757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.883 [2024-11-29 14:04:24.055785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.883 qpair failed and we were unable to recover it. 00:30:43.883 [2024-11-29 14:04:24.065630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.883 [2024-11-29 14:04:24.065733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.883 [2024-11-29 14:04:24.065759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.883 [2024-11-29 14:04:24.065773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.883 [2024-11-29 14:04:24.065785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.065815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.075552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.075651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.075676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.075691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.075703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.075732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.085631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.085739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.085765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.085780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.085792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.085820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.095670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.095790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.095815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.095829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.095842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.095870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.105731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.105856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.105881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.105895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.105908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.105935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.115698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.115798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.115823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.115836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.115849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.115877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.125745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.125868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.125893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.125907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.125920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.125947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:43.884 [2024-11-29 14:04:24.135776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.884 [2024-11-29 14:04:24.135880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.884 [2024-11-29 14:04:24.135906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.884 [2024-11-29 14:04:24.135919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.884 [2024-11-29 14:04:24.135932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:43.884 [2024-11-29 14:04:24.135960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.884 qpair failed and we were unable to recover it. 00:30:44.144 [2024-11-29 14:04:24.145790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.144 [2024-11-29 14:04:24.145892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.144 [2024-11-29 14:04:24.145917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.144 [2024-11-29 14:04:24.145931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.144 [2024-11-29 14:04:24.145950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.144 [2024-11-29 14:04:24.145978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.144 qpair failed and we were unable to recover it. 00:30:44.144 [2024-11-29 14:04:24.155869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.144 [2024-11-29 14:04:24.155983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.144 [2024-11-29 14:04:24.156008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.144 [2024-11-29 14:04:24.156022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.144 [2024-11-29 14:04:24.156035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.144 [2024-11-29 14:04:24.156063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.144 qpair failed and we were unable to recover it. 00:30:44.144 [2024-11-29 14:04:24.165890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.144 [2024-11-29 14:04:24.165996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.144 [2024-11-29 14:04:24.166025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.144 [2024-11-29 14:04:24.166040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.144 [2024-11-29 14:04:24.166054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.144 [2024-11-29 14:04:24.166082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.144 qpair failed and we were unable to recover it. 00:30:44.144 [2024-11-29 14:04:24.175868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.144 [2024-11-29 14:04:24.175998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.144 [2024-11-29 14:04:24.176024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.144 [2024-11-29 14:04:24.176038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.144 [2024-11-29 14:04:24.176051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.144 [2024-11-29 14:04:24.176079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.144 qpair failed and we were unable to recover it. 00:30:44.144 [2024-11-29 14:04:24.185952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.144 [2024-11-29 14:04:24.186056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.144 [2024-11-29 14:04:24.186082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.144 [2024-11-29 14:04:24.186095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.144 [2024-11-29 14:04:24.186108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.186137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.195964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.196066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.196092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.196106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.196119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.196147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.205957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.206050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.206075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.206089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.206102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.206130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.216039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.216162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.216187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.216202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.216215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.216242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.226134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.226231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.226261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.226276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.226289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.226317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.236116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.236213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.236239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.236260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.236274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.236303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.246099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.246205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.246234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.246249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.246267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.246301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.256216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.256316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.256342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.256355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.256368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.256403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.266156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.266255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.266282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.266296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.266309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.266336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.276167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.276264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.276289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.276303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.276316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:44.145 [2024-11-29 14:04:24.276345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.286203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.286297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.286330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.145 [2024-11-29 14:04:24.286354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.145 [2024-11-29 14:04:24.286379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.145 [2024-11-29 14:04:24.286437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.145 qpair failed and we were unable to recover it. 00:30:44.145 [2024-11-29 14:04:24.296253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.145 [2024-11-29 14:04:24.296405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.145 [2024-11-29 14:04:24.296434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.296472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.296499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.296547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.306269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.306366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.306406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.306433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.306458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.306507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.316302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.316409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.316437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.316460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.316484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.316532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.326356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.326465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.326494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.326525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.326550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.326597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.336363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.336481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.336509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.336532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.336556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.336602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.346424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.346536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.346567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.346591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.346615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.346666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.356451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.356555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.356583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.356606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.356630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.356678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.366483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.366578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.366605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.366628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.366653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.366701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.376587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.376724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.376752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.376776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.376800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.376847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.386514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.386616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.386644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.386667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.386691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.386738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.396610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.146 [2024-11-29 14:04:24.396714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.146 [2024-11-29 14:04:24.396742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.146 [2024-11-29 14:04:24.396765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.146 [2024-11-29 14:04:24.396789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.146 [2024-11-29 14:04:24.396838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.146 qpair failed and we were unable to recover it. 00:30:44.146 [2024-11-29 14:04:24.406589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.147 [2024-11-29 14:04:24.406684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.147 [2024-11-29 14:04:24.406711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.147 [2024-11-29 14:04:24.406734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.147 [2024-11-29 14:04:24.406758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.147 [2024-11-29 14:04:24.406805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.147 qpair failed and we were unable to recover it. 00:30:44.147 [2024-11-29 14:04:24.416634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.147 [2024-11-29 14:04:24.416746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.147 [2024-11-29 14:04:24.416780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.147 [2024-11-29 14:04:24.416804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.147 [2024-11-29 14:04:24.416830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.147 [2024-11-29 14:04:24.416877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.147 qpair failed and we were unable to recover it. 00:30:44.407 [2024-11-29 14:04:24.426650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.407 [2024-11-29 14:04:24.426754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.407 [2024-11-29 14:04:24.426782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.407 [2024-11-29 14:04:24.426805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.407 [2024-11-29 14:04:24.426830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.407 [2024-11-29 14:04:24.426898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.407 qpair failed and we were unable to recover it. 00:30:44.407 [2024-11-29 14:04:24.436674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.407 [2024-11-29 14:04:24.436769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.407 [2024-11-29 14:04:24.436796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.407 [2024-11-29 14:04:24.436819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.407 [2024-11-29 14:04:24.436843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.407 [2024-11-29 14:04:24.436891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.407 qpair failed and we were unable to recover it. 00:30:44.407 [2024-11-29 14:04:24.446714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.407 [2024-11-29 14:04:24.446837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.407 [2024-11-29 14:04:24.446864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.407 [2024-11-29 14:04:24.446886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.407 [2024-11-29 14:04:24.446910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.407 [2024-11-29 14:04:24.446957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.407 qpair failed and we were unable to recover it. 00:30:44.407 [2024-11-29 14:04:24.456730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.407 [2024-11-29 14:04:24.456836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.407 [2024-11-29 14:04:24.456863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.407 [2024-11-29 14:04:24.456886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.407 [2024-11-29 14:04:24.456910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.456957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.466754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.466852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.466879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.466903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.466926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.466989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.476776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.476871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.476898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.476921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.476945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.476992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.486802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.486933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.486960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.486983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.487007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.487056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.496885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.496995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.497023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.497048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.497072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.497121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.506958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.507068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.507102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.507127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.507151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.507197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.516966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.517078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.517105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.517128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.517153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.517200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.527066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.527162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.527190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.527214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.527240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.527287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.537028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.537138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.537164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.537188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.537212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.537258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.547013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.547117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.547144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.547167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.547191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.547245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.557039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.557140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.557168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.557190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.557214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.557262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.567054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.567150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.567177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.567200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.567224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.567270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.577160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.577279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.577308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.577330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.577355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.577408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.587149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.408 [2024-11-29 14:04:24.587260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.408 [2024-11-29 14:04:24.587288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.408 [2024-11-29 14:04:24.587314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.408 [2024-11-29 14:04:24.587340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.408 [2024-11-29 14:04:24.587390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.408 qpair failed and we were unable to recover it. 00:30:44.408 [2024-11-29 14:04:24.597160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.597262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.597295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.597319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.597346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.597401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.607169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.607267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.607295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.607318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.607343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.607400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.617208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.617317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.617344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.617368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.617401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.617452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.627242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.627350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.627376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.627407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.627433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.627482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.637259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.637360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.637387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.637434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.637469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.637521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.647294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.647409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.647436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.647460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.647485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.647533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.657328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.657443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.657476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.657499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.657525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.657573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.667376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.667497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.667525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.667552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.667576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.667626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.409 [2024-11-29 14:04:24.677389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.409 [2024-11-29 14:04:24.677503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.409 [2024-11-29 14:04:24.677530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.409 [2024-11-29 14:04:24.677553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.409 [2024-11-29 14:04:24.677577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.409 [2024-11-29 14:04:24.677624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.409 qpair failed and we were unable to recover it. 00:30:44.671 [2024-11-29 14:04:24.687459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.671 [2024-11-29 14:04:24.687568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.671 [2024-11-29 14:04:24.687596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.671 [2024-11-29 14:04:24.687620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.671 [2024-11-29 14:04:24.687644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.671 [2024-11-29 14:04:24.687690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.671 qpair failed and we were unable to recover it. 00:30:44.671 [2024-11-29 14:04:24.697477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.671 [2024-11-29 14:04:24.697586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.671 [2024-11-29 14:04:24.697614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.671 [2024-11-29 14:04:24.697637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.671 [2024-11-29 14:04:24.697661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.671 [2024-11-29 14:04:24.697707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.671 qpair failed and we were unable to recover it. 00:30:44.671 [2024-11-29 14:04:24.707490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.671 [2024-11-29 14:04:24.707598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.671 [2024-11-29 14:04:24.707627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.671 [2024-11-29 14:04:24.707650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.671 [2024-11-29 14:04:24.707674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.671 [2024-11-29 14:04:24.707721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.671 qpair failed and we were unable to recover it. 00:30:44.671 [2024-11-29 14:04:24.717504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.671 [2024-11-29 14:04:24.717608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.671 [2024-11-29 14:04:24.717635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.671 [2024-11-29 14:04:24.717659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.671 [2024-11-29 14:04:24.717683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.671 [2024-11-29 14:04:24.717731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.671 qpair failed and we were unable to recover it. 00:30:44.671 [2024-11-29 14:04:24.727622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.671 [2024-11-29 14:04:24.727746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.671 [2024-11-29 14:04:24.727773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.727796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.727828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.727879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.737615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.737723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.737750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.737774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.737797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.737845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.747595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.747702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.747729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.747752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.747775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.747824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.757664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.757775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.757802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.757824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.757848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.757894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.767708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.767810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.767837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.767860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.767883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.767930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.777715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.777826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.777853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.777875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.777904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.777952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.787705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.787809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.787836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.787859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.787884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.787931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.797754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.797855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.797882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.797904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.797926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.797970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.807790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.807919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.807947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.807969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.807994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.808041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.817803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.817908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.817935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.817965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.817991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.818042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.827905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.828007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.828034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.828057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.828084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.828132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.837826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.837933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.837961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.837984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.838008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.838054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.847856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.847954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.847981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.848004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.848028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.672 [2024-11-29 14:04:24.848074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.672 qpair failed and we were unable to recover it. 00:30:44.672 [2024-11-29 14:04:24.857919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.672 [2024-11-29 14:04:24.858028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.672 [2024-11-29 14:04:24.858054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.672 [2024-11-29 14:04:24.858077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.672 [2024-11-29 14:04:24.858104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.858166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.867914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.868030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.868062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.868086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.868107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.868151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.877998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.878129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.878157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.878181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.878205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.878253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.887969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.888062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.888089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.888112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.888138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.888185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.898075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.898182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.898209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.898231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.898258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.898306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.908044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.908142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.908169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.908199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.908224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.908272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.918067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.918188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.918215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.918238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.918262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.918309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.928131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.928265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.928292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.928315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.928339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.928404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.938156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.938265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.938292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.938315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.938339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.938386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.673 [2024-11-29 14:04:24.948144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.673 [2024-11-29 14:04:24.948243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.673 [2024-11-29 14:04:24.948270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.673 [2024-11-29 14:04:24.948294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.673 [2024-11-29 14:04:24.948319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.673 [2024-11-29 14:04:24.948368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.673 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:24.958178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:24.958281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:24.958307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:24.958330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:24.958355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:24.958408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:24.968206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:24.968309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:24.968336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:24.968359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:24.968383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:24.968438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:24.978252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:24.978380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:24.978414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:24.978438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:24.978462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:24.978510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:24.988299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:24.988425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:24.988453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:24.988475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:24.988500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:24.988546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:24.998336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:24.998437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:24.998470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:24.998495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:24.998520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:24.998567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.008346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.008450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.008481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.008505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.008531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.008579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.018377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.018506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.018536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.018559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.018586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.018634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.028465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.028570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.028598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.028622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.028647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.028695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.038434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.038546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.038573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.038596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.038623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.038678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.048466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.048570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.048597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.048619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.048643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.048698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.942 [2024-11-29 14:04:25.058528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.942 [2024-11-29 14:04:25.058638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.942 [2024-11-29 14:04:25.058666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.942 [2024-11-29 14:04:25.058689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.942 [2024-11-29 14:04:25.058715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.942 [2024-11-29 14:04:25.058764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.942 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.068518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.068617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.068644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.068668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.068692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.068739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.078629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.078738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.078767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.078790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.078815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.078862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.088557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.088656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.088689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.088713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.088738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.088785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.098663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.098774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.098800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.098824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.098850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.098898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.108655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.108804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.108832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.108855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.108880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.108928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.118693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.118798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.118826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.118850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.118874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.118923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.128772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.128874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.128900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.128924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.128949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.129004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.138713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.138812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.138838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.138862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.138886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.138933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.148755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.148861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.148887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.148911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.148935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.148983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.158815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.158920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.158947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.158969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.158995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.159043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.168797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.168898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.168925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.168948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.168972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.169020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.178871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.178986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.179016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.179042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.179067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.179115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.188851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.188954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.188981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.189005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.189031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.189080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.198880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.198978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.199005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.199028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.199052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.199100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.208892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.943 [2024-11-29 14:04:25.209000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.943 [2024-11-29 14:04:25.209028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.943 [2024-11-29 14:04:25.209051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.943 [2024-11-29 14:04:25.209075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.943 [2024-11-29 14:04:25.209124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.943 qpair failed and we were unable to recover it. 00:30:44.943 [2024-11-29 14:04:25.218987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.944 [2024-11-29 14:04:25.219092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.944 [2024-11-29 14:04:25.219118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.944 [2024-11-29 14:04:25.219142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.944 [2024-11-29 14:04:25.219173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:44.944 [2024-11-29 14:04:25.219220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:44.944 qpair failed and we were unable to recover it. 00:30:45.203 [2024-11-29 14:04:25.228986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.203 [2024-11-29 14:04:25.229097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.203 [2024-11-29 14:04:25.229125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.203 [2024-11-29 14:04:25.229148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.203 [2024-11-29 14:04:25.229174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.203 [2024-11-29 14:04:25.229221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.203 qpair failed and we were unable to recover it. 00:30:45.203 [2024-11-29 14:04:25.238990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.203 [2024-11-29 14:04:25.239099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.203 [2024-11-29 14:04:25.239126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.203 [2024-11-29 14:04:25.239148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.203 [2024-11-29 14:04:25.239172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.203 [2024-11-29 14:04:25.239218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.203 qpair failed and we were unable to recover it. 00:30:45.203 [2024-11-29 14:04:25.249012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.203 [2024-11-29 14:04:25.249153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.249181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.249205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.249232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.249279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.259093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.259207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.259237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.259260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.259286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.259333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.269092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.269209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.269236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.269259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.269283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.269345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.279099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.279203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.279229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.279252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.279276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.279323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.289139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.289270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.289298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.289321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.289348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.289402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.299166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.299267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.299293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.299316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.299341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.299388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.309218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.309325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.309352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.309382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.309418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.309468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.319221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.319357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.319384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.319416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.319442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.319492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.329234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.329331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.329357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.329380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.329414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.329462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.339320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.339443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.339470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.339493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.339521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.339568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.349321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.349435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.349463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.349487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.349512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.349559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.359380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.359505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.359532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.359555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.359578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.359626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.369367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.369470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.369498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.369521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.369548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.204 [2024-11-29 14:04:25.369596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.204 qpair failed and we were unable to recover it. 00:30:45.204 [2024-11-29 14:04:25.379426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.204 [2024-11-29 14:04:25.379541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.204 [2024-11-29 14:04:25.379571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.204 [2024-11-29 14:04:25.379596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.204 [2024-11-29 14:04:25.379621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.379669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.389441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.389540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.389568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.389592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.389616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.389663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.399472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.399573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.399600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.399630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.399656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.399703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.409477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.409579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.409606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.409628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.409656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.409703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.419579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.419702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.419728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.419751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.419778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.419825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.429591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.429715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.429742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.429765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.429790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.429852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.439574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.439673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.439700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.439722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.439748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.439796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.449620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.449723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.449750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.449773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.449799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.449847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.459639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.459760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.459787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.459810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.459836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.459882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.469687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.469789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.469816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.469839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.469866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.469913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.205 [2024-11-29 14:04:25.479682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.205 [2024-11-29 14:04:25.479776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.205 [2024-11-29 14:04:25.479802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.205 [2024-11-29 14:04:25.479824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.205 [2024-11-29 14:04:25.479849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.205 [2024-11-29 14:04:25.479895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.205 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.489716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.489823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.489855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.489879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.489903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.489951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.499772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.499902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.499931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.499954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.499979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.500024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.509865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.509972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.509999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.510023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.510047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.510094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.519819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.519912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.519939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.519962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.519986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.520034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.529832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.529933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.529959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.529982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.530008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.530064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.539898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.540019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.540045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.540068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.540092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.540139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.549993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.550129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.550156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.550179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.550203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.550249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.559916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.560018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.560045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.560068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.560095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.560144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.465 qpair failed and we were unable to recover it. 00:30:45.465 [2024-11-29 14:04:25.569971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.465 [2024-11-29 14:04:25.570080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.465 [2024-11-29 14:04:25.570107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.465 [2024-11-29 14:04:25.570130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.465 [2024-11-29 14:04:25.570156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.465 [2024-11-29 14:04:25.570204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.580029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.580138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.580170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.580193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.580217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.466 [2024-11-29 14:04:25.580264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.590004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.590107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.590135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.590158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.590183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.466 [2024-11-29 14:04:25.590230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.600084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.600181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.600209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.600232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.600256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc168000b90 00:30:45.466 [2024-11-29 14:04:25.600303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.610124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.610248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.610282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.610298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.610311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.610341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.620116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.620212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.620238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.620252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.620266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.620300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.630149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.630249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.630275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.630289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.630303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.630333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.640185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.640290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.640317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.640331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.640344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.640372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.650193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.650292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.650320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.650335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.650348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.650377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.660335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.660434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.660461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.660475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.660488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.466 [2024-11-29 14:04:25.660516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.466 qpair failed and we were unable to recover it. 00:30:45.466 [2024-11-29 14:04:25.670247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.466 [2024-11-29 14:04:25.670360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.466 [2024-11-29 14:04:25.670391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.466 [2024-11-29 14:04:25.670416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.466 [2024-11-29 14:04:25.670429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.670460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.680311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.680436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.680461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.680475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.680488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.680517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.690332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.690427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.690454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.690468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.690481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.690509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.700388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.700503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.700529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.700543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.700556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.700584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.710372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.710484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.710511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.710525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.710538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.710571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.720424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.720549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.720576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.720590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.720602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.720631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.730438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.730560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.730587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.730601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.730614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.730642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.467 [2024-11-29 14:04:25.740555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.467 [2024-11-29 14:04:25.740660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.467 [2024-11-29 14:04:25.740689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.467 [2024-11-29 14:04:25.740704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.467 [2024-11-29 14:04:25.740718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.467 [2024-11-29 14:04:25.740747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.467 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.750514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.750647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.750677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.750693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.750706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.750735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.760571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.760676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.760711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.760727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.760740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.760769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.770546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.770641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.770668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.770682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.770694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.770722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.780617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.780744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.780769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.780783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.780796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.780825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.790635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.790734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.790759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.790773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.790786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.790814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.800633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.800734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.800759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.800773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.800790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.800819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.726 [2024-11-29 14:04:25.810703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.726 [2024-11-29 14:04:25.810801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.726 [2024-11-29 14:04:25.810827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.726 [2024-11-29 14:04:25.810841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.726 [2024-11-29 14:04:25.810853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.726 [2024-11-29 14:04:25.810881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.726 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.820717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.820847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.820873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.820887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.820900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.820929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.830712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.830810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.830836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.830850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.830863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.830891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.840743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.840865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.840891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.840905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.840918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.840946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.850849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.850987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.851013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.851027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.851039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.851067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.860858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.860956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.860982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.860995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.861009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.861037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.870878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.870975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.870999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.871013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.871025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.871052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.880929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.881037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.881069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.881084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.881097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.881127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.890924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.891019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.891045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.891060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.891078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.891107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.901003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.901146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.901172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.901185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.901198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.901226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.911065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.911170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.911196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.911210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.911223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.911252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.920986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.921081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.921106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.921121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.921133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.921161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.931017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.931123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.931148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.931162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.727 [2024-11-29 14:04:25.931175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.727 [2024-11-29 14:04:25.931203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.727 qpair failed and we were unable to recover it. 00:30:45.727 [2024-11-29 14:04:25.941076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.727 [2024-11-29 14:04:25.941181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.727 [2024-11-29 14:04:25.941206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.727 [2024-11-29 14:04:25.941219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.941232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.941261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:25.951113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:25.951210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:25.951237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:25.951251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.951263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.951291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:25.961172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:25.961271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:25.961296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:25.961311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.961324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.961352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:25.971160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:25.971294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:25.971320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:25.971334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.971347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.971375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:25.981196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:25.981299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:25.981324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:25.981338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.981356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.981385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:25.991215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:25.991345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:25.991371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:25.991385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:25.991405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:25.991435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.728 [2024-11-29 14:04:26.001236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.728 [2024-11-29 14:04:26.001372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.728 [2024-11-29 14:04:26.001405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.728 [2024-11-29 14:04:26.001421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.728 [2024-11-29 14:04:26.001434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.728 [2024-11-29 14:04:26.001465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.728 qpair failed and we were unable to recover it. 00:30:45.987 [2024-11-29 14:04:26.011283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.987 [2024-11-29 14:04:26.011378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.987 [2024-11-29 14:04:26.011412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.987 [2024-11-29 14:04:26.011427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.987 [2024-11-29 14:04:26.011440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.987 [2024-11-29 14:04:26.011468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.987 qpair failed and we were unable to recover it. 00:30:45.987 [2024-11-29 14:04:26.021326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.987 [2024-11-29 14:04:26.021429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.987 [2024-11-29 14:04:26.021455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.987 [2024-11-29 14:04:26.021469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.987 [2024-11-29 14:04:26.021482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.987 [2024-11-29 14:04:26.021510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.987 qpair failed and we were unable to recover it. 00:30:45.987 [2024-11-29 14:04:26.031489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.987 [2024-11-29 14:04:26.031647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.987 [2024-11-29 14:04:26.031673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.987 [2024-11-29 14:04:26.031687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.987 [2024-11-29 14:04:26.031699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.987 [2024-11-29 14:04:26.031730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.987 qpair failed and we were unable to recover it. 00:30:45.987 [2024-11-29 14:04:26.041415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.987 [2024-11-29 14:04:26.041514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.987 [2024-11-29 14:04:26.041540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.041554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.041567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.041597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.051510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.051641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.051666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.051680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.051693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.051721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.061494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.061601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.061627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.061641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.061654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.061682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.071482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.071584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.071609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.071623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.071642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.071670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.081499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.081610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.081635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.081649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.081662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.081691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.091519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.091615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.091641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.091655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.091667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.091696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.101541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.101645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.101671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.101685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.101698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.101727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.111556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.111698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.111723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.111737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.111750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.111777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.121613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.121721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.121746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.121760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.121774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.121802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.131599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.131697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.131722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.131736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.131749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.131777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.141682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.141779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.141805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.141819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.141832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.141860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.151709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.151829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.151855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.151869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.151883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.151910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.161769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.161865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.161890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.161904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.161922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.161951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.988 [2024-11-29 14:04:26.171736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.988 [2024-11-29 14:04:26.171841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.988 [2024-11-29 14:04:26.171866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.988 [2024-11-29 14:04:26.171880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.988 [2024-11-29 14:04:26.171893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.988 [2024-11-29 14:04:26.171921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.988 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.181788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.181886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.181910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.181925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.181938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.181966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.191822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.191918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.191943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.191956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.191970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.191997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.201842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.201975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.202001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.202014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.202027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.202055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.211840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.211935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.211961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.211975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.211988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.212016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.221941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.222052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.222081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.222096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.222109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.222138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.231941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.232053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.232079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.232093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.232106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.232133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.241949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.242076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.242101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.242115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.242127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.242156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.251982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.252076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.252102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.252123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.252137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.252164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:45.989 [2024-11-29 14:04:26.262038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.989 [2024-11-29 14:04:26.262142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.989 [2024-11-29 14:04:26.262167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.989 [2024-11-29 14:04:26.262182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.989 [2024-11-29 14:04:26.262194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:45.989 [2024-11-29 14:04:26.262224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.989 qpair failed and we were unable to recover it. 00:30:46.249 [2024-11-29 14:04:26.272031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.249 [2024-11-29 14:04:26.272129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.249 [2024-11-29 14:04:26.272156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.249 [2024-11-29 14:04:26.272171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.249 [2024-11-29 14:04:26.272184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.249 [2024-11-29 14:04:26.272213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.249 qpair failed and we were unable to recover it. 00:30:46.249 [2024-11-29 14:04:26.282081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.249 [2024-11-29 14:04:26.282233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.249 [2024-11-29 14:04:26.282260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.249 [2024-11-29 14:04:26.282275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.249 [2024-11-29 14:04:26.282288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.249 [2024-11-29 14:04:26.282317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.249 qpair failed and we were unable to recover it. 00:30:46.249 [2024-11-29 14:04:26.292124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.249 [2024-11-29 14:04:26.292253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.249 [2024-11-29 14:04:26.292279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.249 [2024-11-29 14:04:26.292294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.249 [2024-11-29 14:04:26.292306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.249 [2024-11-29 14:04:26.292334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.249 qpair failed and we were unable to recover it. 00:30:46.249 [2024-11-29 14:04:26.302231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.249 [2024-11-29 14:04:26.302331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.302357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.302371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.302385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.302420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.312156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.312253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.312279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.312293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.312306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.312334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.322184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.322287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.322313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.322327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.322340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.322369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.332252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.332352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.332377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.332399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.332415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.332443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.342237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.342373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.342404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.342426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.342447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.342475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.352295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.352399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.352425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.352439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.352452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.352480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.362306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.362442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.362468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.362482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.362494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.362522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.372329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.372446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.372472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.372487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.372500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.372528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.382354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.382475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.382500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.382514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.382527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.382555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.392383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.392499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.392527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.392542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.392555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.392584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.402427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.402534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.402560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.402574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.402587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.402616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.412428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.412538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.412564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.412578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.412591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.412618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.422526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.422640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.422666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.422680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.422692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.250 [2024-11-29 14:04:26.422722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.250 qpair failed and we were unable to recover it. 00:30:46.250 [2024-11-29 14:04:26.432503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.250 [2024-11-29 14:04:26.432644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.250 [2024-11-29 14:04:26.432669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.250 [2024-11-29 14:04:26.432692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.250 [2024-11-29 14:04:26.432707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.432734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.442560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.442666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.442694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.442708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.442721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.442750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.452591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.452710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.452737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.452752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.452765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.452794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.462594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.462698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.462724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.462738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.462751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.462779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.472638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.472741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.472767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.472781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.472793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.472823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.482688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.482813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.482839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.482853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.482866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.482894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.492680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.492789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.492815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.492829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.492844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.492872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.502722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.502823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.502848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.502863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.502875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.502903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.512757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.512874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.512900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.512914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.512927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.512957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.251 [2024-11-29 14:04:26.522779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.251 [2024-11-29 14:04:26.522875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.251 [2024-11-29 14:04:26.522901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.251 [2024-11-29 14:04:26.522921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.251 [2024-11-29 14:04:26.522934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.251 [2024-11-29 14:04:26.522963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.251 qpair failed and we were unable to recover it. 00:30:46.511 [2024-11-29 14:04:26.532795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.511 [2024-11-29 14:04:26.532887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.511 [2024-11-29 14:04:26.532913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.511 [2024-11-29 14:04:26.532927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.511 [2024-11-29 14:04:26.532940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.511 [2024-11-29 14:04:26.532970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.511 qpair failed and we were unable to recover it. 00:30:46.511 [2024-11-29 14:04:26.542826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.511 [2024-11-29 14:04:26.542928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.511 [2024-11-29 14:04:26.542953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.511 [2024-11-29 14:04:26.542967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.542980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.543008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.552881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.552983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.553008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.553022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.553035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.553063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.562905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.562999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.563024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.563038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.563051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.563079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.572902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.573002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.573028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.573042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.573055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.573083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.582964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.583084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.583109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.583122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.583135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.583163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.593012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.593139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.593164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.593178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.593190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.593219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.603123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.603219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.603244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.603257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.603272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.603302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.613099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.613200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.613229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.613251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.613264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.613293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.623105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.623229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.623255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.623270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.623283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.623311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.633167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.633267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.633293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.633306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.633320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.633348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.643147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.643249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.643274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.643288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.643300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.643329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.653175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.653317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.653343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.653357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.653370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.653404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.663220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.663322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.512 [2024-11-29 14:04:26.663347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.512 [2024-11-29 14:04:26.663361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.512 [2024-11-29 14:04:26.663374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.512 [2024-11-29 14:04:26.663408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.512 qpair failed and we were unable to recover it. 00:30:46.512 [2024-11-29 14:04:26.673288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.512 [2024-11-29 14:04:26.673388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.673421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.673435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.673448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.673475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.683302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.683401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.683427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.683441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.683453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.683482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.693289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.693431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.693457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.693471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.693484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.693513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.703452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.703557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.703581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.703602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.703615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.703644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.713411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.713527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.713552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.713566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.713578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.713606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.723407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.723501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.723527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.723541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.723553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.723583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.733418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.733524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.733550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.733564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.733577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.733607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.743479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.743600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.743625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.743639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.743652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.743681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.753495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.753592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.753617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.753631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.753644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.753672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.763520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.763644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.763670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.763684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.763696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.763725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.773524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.773622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.773648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.773663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.773676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.773703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.513 [2024-11-29 14:04:26.783575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.513 [2024-11-29 14:04:26.783671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.513 [2024-11-29 14:04:26.783697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.513 [2024-11-29 14:04:26.783711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.513 [2024-11-29 14:04:26.783724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.513 [2024-11-29 14:04:26.783752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.513 qpair failed and we were unable to recover it. 00:30:46.775 [2024-11-29 14:04:26.793633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.775 [2024-11-29 14:04:26.793734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.775 [2024-11-29 14:04:26.793766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.775 [2024-11-29 14:04:26.793781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.775 [2024-11-29 14:04:26.793794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.775 [2024-11-29 14:04:26.793822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.775 qpair failed and we were unable to recover it. 00:30:46.775 [2024-11-29 14:04:26.803679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.775 [2024-11-29 14:04:26.803781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.775 [2024-11-29 14:04:26.803807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.775 [2024-11-29 14:04:26.803822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.775 [2024-11-29 14:04:26.803834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.775 [2024-11-29 14:04:26.803862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.775 qpair failed and we were unable to recover it. 00:30:46.775 [2024-11-29 14:04:26.813781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.775 [2024-11-29 14:04:26.813876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.775 [2024-11-29 14:04:26.813901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.775 [2024-11-29 14:04:26.813915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.775 [2024-11-29 14:04:26.813928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.775 [2024-11-29 14:04:26.813956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.775 qpair failed and we were unable to recover it. 00:30:46.775 [2024-11-29 14:04:26.823669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.775 [2024-11-29 14:04:26.823766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.775 [2024-11-29 14:04:26.823791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.775 [2024-11-29 14:04:26.823804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.775 [2024-11-29 14:04:26.823817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.775 [2024-11-29 14:04:26.823846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.775 qpair failed and we were unable to recover it. 00:30:46.775 [2024-11-29 14:04:26.833711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.775 [2024-11-29 14:04:26.833839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.775 [2024-11-29 14:04:26.833865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.775 [2024-11-29 14:04:26.833879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.775 [2024-11-29 14:04:26.833892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.775 [2024-11-29 14:04:26.833919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.775 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.843790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.843890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.843916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.843931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.843944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.843972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.853761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.853893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.853919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.853933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.853946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.853973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.863810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.863924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.863949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.863963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.863975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.864004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.873810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.873923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.873948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.873961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.873972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.873999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.883857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.883953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.883984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.883999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.884012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.884040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.893881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.893971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.893996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.894010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.894023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.894050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.903956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.904061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.904087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.904100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.904114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.904142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.913949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.914063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.914088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.914102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.914115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.914143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.923997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.924120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.924145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.924159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.924172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.924201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.933988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.934079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.934104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.934118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.934131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.934158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.944058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.944155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.944180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.944194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.944207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.944235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.954088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.954222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.954247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.954262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.954273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.954303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.964072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.964192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.776 [2024-11-29 14:04:26.964218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.776 [2024-11-29 14:04:26.964232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.776 [2024-11-29 14:04:26.964244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.776 [2024-11-29 14:04:26.964273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.776 qpair failed and we were unable to recover it. 00:30:46.776 [2024-11-29 14:04:26.974123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.776 [2024-11-29 14:04:26.974219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:26.974251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:26.974266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:26.974279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:26.974306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:26.984171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:26.984268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:26.984293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:26.984307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:26.984320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:26.984348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:26.994178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:26.994276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:26.994301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:26.994315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:26.994328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:26.994356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:27.004294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:27.004386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:27.004418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:27.004432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:27.004445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:27.004474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:27.014209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:27.014300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:27.014326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:27.014340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:27.014353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:27.014388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:27.024352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:27.024460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:27.024485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:27.024499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:27.024512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:27.024540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:27.034277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:27.034374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:27.034406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:27.034422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:27.034434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:27.034462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:46.777 [2024-11-29 14:04:27.044322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.777 [2024-11-29 14:04:27.044420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.777 [2024-11-29 14:04:27.044446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.777 [2024-11-29 14:04:27.044460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.777 [2024-11-29 14:04:27.044473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:46.777 [2024-11-29 14:04:27.044503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:46.777 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.054400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.054532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.054559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.054573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.054586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.054614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.064432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.064543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.064573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.064588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.064601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.064630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.074403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.074508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.074533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.074548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.074560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.074588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.084427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.084551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.084577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.084590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.084603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.084631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.094554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.094650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.094679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.094695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.094708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.094737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.104494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.104663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.104690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.104704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.104717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.104755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.114547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.114645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.114670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.114685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.114698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.114727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.124544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.124635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.124661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.124675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.124688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.124717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.134583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.134675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.037 [2024-11-29 14:04:27.134701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.037 [2024-11-29 14:04:27.134715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.037 [2024-11-29 14:04:27.134728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.037 [2024-11-29 14:04:27.134756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.037 qpair failed and we were unable to recover it. 00:30:47.037 [2024-11-29 14:04:27.144634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.037 [2024-11-29 14:04:27.144738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.144763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.144777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.144790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.144819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.154736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.154835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.154866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.154880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.154893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.154921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.164691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.164818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.164844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.164858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.164871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.164899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.174713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.174805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.174830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.174845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.174858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.174885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.184725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.184844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.184869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.184883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.184895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.184924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.194771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.194866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.194893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.194907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.194919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.194955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.204770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.204897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.204923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.204937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.204949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.204979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.214825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.214922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.214948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.214962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.214975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.215003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.224830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.224926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.224952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.224966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.224979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.225006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.234921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.235048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.235074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.235088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.235101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.235128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.244895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.244991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.245021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.245036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.245049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.245078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.254901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.254994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.255019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.255033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.255046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.255074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.264971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.265084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.265109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.265123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.265136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.038 [2024-11-29 14:04:27.265164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.038 qpair failed and we were unable to recover it. 00:30:47.038 [2024-11-29 14:04:27.274964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.038 [2024-11-29 14:04:27.275065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.038 [2024-11-29 14:04:27.275090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.038 [2024-11-29 14:04:27.275104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.038 [2024-11-29 14:04:27.275117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.039 [2024-11-29 14:04:27.275145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.039 qpair failed and we were unable to recover it. 00:30:47.039 [2024-11-29 14:04:27.285013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.039 [2024-11-29 14:04:27.285113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.039 [2024-11-29 14:04:27.285139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.039 [2024-11-29 14:04:27.285153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.039 [2024-11-29 14:04:27.285166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.039 [2024-11-29 14:04:27.285201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.039 qpair failed and we were unable to recover it. 00:30:47.039 [2024-11-29 14:04:27.295039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.039 [2024-11-29 14:04:27.295137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.039 [2024-11-29 14:04:27.295163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.039 [2024-11-29 14:04:27.295177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.039 [2024-11-29 14:04:27.295190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.039 [2024-11-29 14:04:27.295219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.039 qpair failed and we were unable to recover it. 00:30:47.039 [2024-11-29 14:04:27.305069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.039 [2024-11-29 14:04:27.305170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.039 [2024-11-29 14:04:27.305196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.039 [2024-11-29 14:04:27.305209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.039 [2024-11-29 14:04:27.305223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.039 [2024-11-29 14:04:27.305250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.039 qpair failed and we were unable to recover it. 00:30:47.039 [2024-11-29 14:04:27.315080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.039 [2024-11-29 14:04:27.315178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.039 [2024-11-29 14:04:27.315208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.039 [2024-11-29 14:04:27.315223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.039 [2024-11-29 14:04:27.315236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.039 [2024-11-29 14:04:27.315264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.039 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.325110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.325217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.325243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.325257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.325270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.325299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.335147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.335247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.335282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.335298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.335311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.335340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.345203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.345320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.345347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.345360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.345374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.345410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.355307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.355441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.355468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.355482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.355495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.355523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.365227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.365330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.365356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.365370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.365382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.365419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.375254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.375348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.375374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.375388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.375415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.375452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.385282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.385382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.385414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.385430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.385444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.385473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.395320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.299 [2024-11-29 14:04:27.395450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.299 [2024-11-29 14:04:27.395476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.299 [2024-11-29 14:04:27.395491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.299 [2024-11-29 14:04:27.395504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.299 [2024-11-29 14:04:27.395531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.299 qpair failed and we were unable to recover it. 00:30:47.299 [2024-11-29 14:04:27.405380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.405492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.405518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.405532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.405544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.405574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.415384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.415499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.415524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.415538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.415551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.415580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.425439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.425541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.425572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.425587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.425600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.425630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.435445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.435540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.435565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.435579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.435591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.435621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.445488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.445584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.445610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.445624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.445637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.445665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.455483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.455573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.455599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.455614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.455626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.455654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.465572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.465673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.465701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.465715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.465734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.465763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.475640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.475742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.475768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.475782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.475797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.475826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.485610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.485747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.485772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.485786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.485799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.485827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.495598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.495694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.495720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.495734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.495747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.495775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.505650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.505754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.505779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.505793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.505806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.505834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.515723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.515825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.515851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.515866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.515879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.515907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.525689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.525820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.525846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.525860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.525873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.300 [2024-11-29 14:04:27.525902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.300 qpair failed and we were unable to recover it. 00:30:47.300 [2024-11-29 14:04:27.535727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.300 [2024-11-29 14:04:27.535822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.300 [2024-11-29 14:04:27.535848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.300 [2024-11-29 14:04:27.535862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.300 [2024-11-29 14:04:27.535875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.301 [2024-11-29 14:04:27.535902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.301 qpair failed and we were unable to recover it. 00:30:47.301 [2024-11-29 14:04:27.545767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.301 [2024-11-29 14:04:27.545870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.301 [2024-11-29 14:04:27.545896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.301 [2024-11-29 14:04:27.545909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.301 [2024-11-29 14:04:27.545922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.301 [2024-11-29 14:04:27.545952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.301 qpair failed and we were unable to recover it. 00:30:47.301 [2024-11-29 14:04:27.555757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.301 [2024-11-29 14:04:27.555857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.301 [2024-11-29 14:04:27.555883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.301 [2024-11-29 14:04:27.555897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.301 [2024-11-29 14:04:27.555916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.301 [2024-11-29 14:04:27.555944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.301 qpair failed and we were unable to recover it. 00:30:47.301 [2024-11-29 14:04:27.565891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.301 [2024-11-29 14:04:27.565986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.301 [2024-11-29 14:04:27.566011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.301 [2024-11-29 14:04:27.566025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.301 [2024-11-29 14:04:27.566038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.301 [2024-11-29 14:04:27.566066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.301 qpair failed and we were unable to recover it. 00:30:47.301 [2024-11-29 14:04:27.575834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.301 [2024-11-29 14:04:27.575924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.301 [2024-11-29 14:04:27.575950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.301 [2024-11-29 14:04:27.575964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.301 [2024-11-29 14:04:27.575977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.301 [2024-11-29 14:04:27.576004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.301 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.585880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.586007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.586032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.586046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.586059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.586087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.595989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.596121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.596147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.596161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.596174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.596201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.606024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.606125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.606151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.606165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.606178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.606206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.615950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.616069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.616095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.616109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.616122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.616150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.626011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.626127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.626151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.626166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.626178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.626207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.636014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.636115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.636141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.636155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.636167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.636196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.646055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.646148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.646173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.646187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.646205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.646234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.656090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.656212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.656238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.656252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.656265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.656294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.666111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.666209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.666234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.666248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.666261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.666288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.676164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.676265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.676294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.676309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.676322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.676350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.686164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.686273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.686299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.686314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.686326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.686354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.696219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.696341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.696368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.696382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.696402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.696433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.706358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.706468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.706495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.706509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.706522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.706549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.716252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.716349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.560 [2024-11-29 14:04:27.716375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.560 [2024-11-29 14:04:27.716389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.560 [2024-11-29 14:04:27.716413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.560 [2024-11-29 14:04:27.716442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.560 qpair failed and we were unable to recover it. 00:30:47.560 [2024-11-29 14:04:27.726303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.560 [2024-11-29 14:04:27.726418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.726444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.726458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.726471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.726501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.736344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.736439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.736466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.736480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.736499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.736528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.746339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.746446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.746472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.746486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.746499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.746528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.756377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.756507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.756533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.756547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.756560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.756588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.766432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.766526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.766552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.766566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.766579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.766607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.776438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.776536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.776562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.776576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.776589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.776617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.786486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.786611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.786636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.786650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.786663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.786692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.796550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.796684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.796710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.796724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.796737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.796764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.806509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.806599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.806624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.806639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.806650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.806678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.816575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.816676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.816702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.816716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.816729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.816757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.826589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.826689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.826715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.826729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.826747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.826776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.561 [2024-11-29 14:04:27.836608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.561 [2024-11-29 14:04:27.836717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.561 [2024-11-29 14:04:27.836743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.561 [2024-11-29 14:04:27.836758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.561 [2024-11-29 14:04:27.836770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.561 [2024-11-29 14:04:27.836797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.561 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.846675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.846790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.846815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.846830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.846843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.846871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.856682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.856774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.856800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.856813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.856826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.856854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.866763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.866866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.866891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.866904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.866917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.866945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.876713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.876815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.876839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.876852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.876865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.876891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.886746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.886842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.886868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.886882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.886895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.886923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.896867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.896964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.896990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.897003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.897016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.897043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.906816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.906918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.906944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.906957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.906970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.906998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.916842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.916946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.916973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.916993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.917007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.917035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.926854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.926947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.926973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.926988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.927001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.927031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.936925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.937039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.937066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.937080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.937093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.937122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.946976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.947128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.947153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.947167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.947180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.947208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.957002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.957100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.957129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.820 [2024-11-29 14:04:27.957145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.820 [2024-11-29 14:04:27.957158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.820 [2024-11-29 14:04:27.957186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.820 qpair failed and we were unable to recover it. 00:30:47.820 [2024-11-29 14:04:27.967086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.820 [2024-11-29 14:04:27.967189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.820 [2024-11-29 14:04:27.967215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:27.967229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:27.967242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:27.967271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:27.977118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:27.977209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:27.977235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:27.977249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:27.977262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:27.977289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:27.987094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:27.987231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:27.987257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:27.987271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:27.987284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:27.987311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:27.997114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:27.997225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:27.997253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:27.997268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:27.997282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:27.997310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.007096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.007191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.007217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.007237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.007251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.007280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.017129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.017221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.017253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.017267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.017280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.017308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.027172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.027273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.027298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.027312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.027325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.027352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.037278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.037408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.037435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.037448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.037462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.037490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.047313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.047422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.047452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.047465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.047478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.047508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.057403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.057533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.057559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.057572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.057585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.057614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.067369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.067485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.067510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.067524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.067537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.067566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.077320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.077427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.077458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.077473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.077487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.077515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.087479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.087606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.087632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.087646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.087659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.087687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:47.821 [2024-11-29 14:04:28.097365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.821 [2024-11-29 14:04:28.097467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.821 [2024-11-29 14:04:28.097493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.821 [2024-11-29 14:04:28.097514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.821 [2024-11-29 14:04:28.097528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:47.821 [2024-11-29 14:04:28.097556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:47.821 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.107420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.107580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.107605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.107619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.107632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.107661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.117460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.117562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.117588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.117602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.117614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.117642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.127485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.127575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.127601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.127615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.127628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.127656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.137536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.137633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.137658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.137672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.137685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.137714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.147524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.147624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.147649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.147663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.147676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.147704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.157609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.157712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.157738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.157752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.157765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.157792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.167600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.167695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.167724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.167739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.167752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.167781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.177606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.177733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.177759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.177773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.177786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.177814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.187670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.187767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.187793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.187813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.187827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.187856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.197732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.197828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.197853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.197867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.197880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.197907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.207712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.207829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.207854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.207869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.207882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.207909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.217799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.217906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.217931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.081 [2024-11-29 14:04:28.217945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.081 [2024-11-29 14:04:28.217958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.081 [2024-11-29 14:04:28.217985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.081 qpair failed and we were unable to recover it. 00:30:48.081 [2024-11-29 14:04:28.227842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.081 [2024-11-29 14:04:28.227936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.081 [2024-11-29 14:04:28.227962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.227976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.227988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.228017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.237827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.237920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.237945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.237960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.237972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.238000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.247882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.248000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.248025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.248039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.248052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.248080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.257938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.258034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.258060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.258073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.258086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.258114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.267933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.268038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.268064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.268078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.268091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.268120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.278022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.278165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.278191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.278212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.278225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.278253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.287966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.288061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.288087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.288101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.288115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.288143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.297985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.298080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.298105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.298119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.298132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.298160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.308023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.308121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.308146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.308160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.308173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.308201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.318060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.318152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.318178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.318192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.318204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.318233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.328081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.328174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.328199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.328214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.328226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.328254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.338124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.338223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.338248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.338262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.338275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.338303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.348197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.348330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.348355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.348370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.348382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.082 [2024-11-29 14:04:28.348417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.082 qpair failed and we were unable to recover it. 00:30:48.082 [2024-11-29 14:04:28.358148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.082 [2024-11-29 14:04:28.358241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.082 [2024-11-29 14:04:28.358267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.082 [2024-11-29 14:04:28.358281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.082 [2024-11-29 14:04:28.358294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.083 [2024-11-29 14:04:28.358322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.083 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.368197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.368292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.368318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.368339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.368352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.368381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.378236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.378334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.378359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.378374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.378387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.378425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.388258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.388411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.388437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.388452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.388466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.388496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.398294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.398428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.398454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.398468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.398480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.398511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.408328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.408447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.408474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.408488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.408500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.408529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.418437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.418532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.418557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.418571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.418583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.418613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.428387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.428491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.428516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.428531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.428543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.428571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.438463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.438604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.438630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.438644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.438657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.438686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.448442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.448535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.448560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.448574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.448587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.448616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.458471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.458567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.458598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.458613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.458626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.458654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.468515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.468631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.468656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.468670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.468682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.468710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.478603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.478695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.478721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.478735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.478748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.342 [2024-11-29 14:04:28.478776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.342 qpair failed and we were unable to recover it. 00:30:48.342 [2024-11-29 14:04:28.488534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.342 [2024-11-29 14:04:28.488630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.342 [2024-11-29 14:04:28.488656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.342 [2024-11-29 14:04:28.488670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.342 [2024-11-29 14:04:28.488683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.488711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.498581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.498675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.498701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.498715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.498727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.498755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.508617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.508726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.508750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.508765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.508777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.508807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.518631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.518726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.518751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.518765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.518778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.518805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.528674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.528775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.528801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.528815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.528827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.528856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.538687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.538776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.538802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.538816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.538829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.538858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.548738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.548838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.548868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.548883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.548896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.548926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.558762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.558861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.558886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.558899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.558912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.558939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.568828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.568925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.568954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.568973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.568986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.569017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.578813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.578906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.578932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.578946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.578959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.578986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.588899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.589003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.589029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.589043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.589055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.589089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.598881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.598973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.598999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.599013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.599026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.599053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.608905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.609004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.609030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.609044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.609057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.609085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.343 [2024-11-29 14:04:28.618943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.343 [2024-11-29 14:04:28.619070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.343 [2024-11-29 14:04:28.619096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.343 [2024-11-29 14:04:28.619110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.343 [2024-11-29 14:04:28.619123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.343 [2024-11-29 14:04:28.619151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.343 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.629084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.629220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.629249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.629264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.629277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.629306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.638996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.639099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.639134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.639149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.639162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.639190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.649049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.649181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.649207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.649221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.649233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.649262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.659045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.659141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.659167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.659182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.659195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.659222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.669119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.669219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.669245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.669260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.669272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.669300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.679146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.679254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.679281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.679295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.679308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.679342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.689138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.689234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.689260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.689274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.689286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.689315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.699216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.699324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.699353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.699368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.699381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.699418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.709196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.709290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.709315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.709329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.709341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.709370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.719232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.719355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.719381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.719400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.719414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.719444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.729300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.603 [2024-11-29 14:04:28.729416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.603 [2024-11-29 14:04:28.729455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.603 [2024-11-29 14:04:28.729470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.603 [2024-11-29 14:04:28.729483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.603 [2024-11-29 14:04:28.729511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.603 qpair failed and we were unable to recover it. 00:30:48.603 [2024-11-29 14:04:28.739281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.739381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.739414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.739429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.739442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.739470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.749299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.749409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.749434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.749448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.749460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.749489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.759336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.759485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.759511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.759525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.759539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.759569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.769372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.769477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.769503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.769517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.769530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.769564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.779400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.779515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.779541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.779555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.779568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.779596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.789466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.789571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.789596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.789610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.789623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.789651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.799467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.799577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.799603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.799617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.799630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.799657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.809508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.809622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.809651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.809665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.809677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.809707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.819512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.819602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.819632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.819647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.819659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.819687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.829647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.829748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.829774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.829790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.829803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.829831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.839586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.839709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.839735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.839748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.839761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.839789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.849596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.849700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.849725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.849739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.849751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.849780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.859637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.859753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.859778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.859792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.604 [2024-11-29 14:04:28.859805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.604 [2024-11-29 14:04:28.859839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.604 qpair failed and we were unable to recover it. 00:30:48.604 [2024-11-29 14:04:28.869690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.604 [2024-11-29 14:04:28.869786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.604 [2024-11-29 14:04:28.869812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.604 [2024-11-29 14:04:28.869826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.605 [2024-11-29 14:04:28.869839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.605 [2024-11-29 14:04:28.869867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.605 qpair failed and we were unable to recover it. 00:30:48.605 [2024-11-29 14:04:28.879678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.605 [2024-11-29 14:04:28.879774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.605 [2024-11-29 14:04:28.879799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.605 [2024-11-29 14:04:28.879812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.605 [2024-11-29 14:04:28.879824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.605 [2024-11-29 14:04:28.879851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.605 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.889756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.889904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.889930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.889944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.889957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.889986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.899737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.899837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.899866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.899881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.899894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.899922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.909769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.909871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.909902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.909917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.909930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.909958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.919792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.919888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.919913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.919928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.919940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.919968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.929828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.929921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.929946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.929960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.929973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.930001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.939862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.939969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.939995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.940009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.940022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.940049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.949898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.950000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.950025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.950039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.950052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.950086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.959984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.960080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.960105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.960119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.863 [2024-11-29 14:04:28.960132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.863 [2024-11-29 14:04:28.960160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.863 qpair failed and we were unable to recover it. 00:30:48.863 [2024-11-29 14:04:28.969966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.863 [2024-11-29 14:04:28.970082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.863 [2024-11-29 14:04:28.970107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.863 [2024-11-29 14:04:28.970121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:28.970134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:28.970162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:28.980000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:28.980118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:28.980143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:28.980158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:28.980171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:28.980198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:28.990014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:28.990115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:28.990141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:28.990157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:28.990170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:28.990199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.000015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.000119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.000150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.000165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.000178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.000207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.010047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.010145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.010171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.010187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.010200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.010228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.020129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.020227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.020253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.020267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.020280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.020307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.030129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.030256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.030281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.030295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.030308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.030337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.040163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.040264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.040294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.040309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.040328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.040359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.050214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.050338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.050363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.050377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.050389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.050428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.060201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.060301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.060327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.060341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.060354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.060381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.070311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.070451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.070478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.070492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.070505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.070536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.080280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.080379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.080422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.080437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.080460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.080489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.090323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.090435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.090467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.090482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.090495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.090523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.100323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.100424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.100450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.100465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.100477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.100505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.110421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.110525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.110551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.110565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.110578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.110608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.120380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.120492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.120518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.120532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.120544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.120573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.130430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.130535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.130561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.130575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.130594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.130623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:48.864 [2024-11-29 14:04:29.140494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.864 [2024-11-29 14:04:29.140589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.864 [2024-11-29 14:04:29.140615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.864 [2024-11-29 14:04:29.140629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.864 [2024-11-29 14:04:29.140642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:48.864 [2024-11-29 14:04:29.140669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.864 qpair failed and we were unable to recover it. 00:30:49.124 [2024-11-29 14:04:29.150514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:49.124 [2024-11-29 14:04:29.150615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:49.124 [2024-11-29 14:04:29.150640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:49.124 [2024-11-29 14:04:29.150654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:49.124 [2024-11-29 14:04:29.150667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8b0f20 00:30:49.124 [2024-11-29 14:04:29.150707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:49.124 qpair failed and we were unable to recover it. 00:30:49.124 [2024-11-29 14:04:29.160539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:49.124 [2024-11-29 14:04:29.160654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:49.124 [2024-11-29 14:04:29.160698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:49.124 [2024-11-29 14:04:29.160717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:49.124 [2024-11-29 14:04:29.160730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc16c000b90 00:30:49.124 [2024-11-29 14:04:29.160762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:49.124 qpair failed and we were unable to recover it. 00:30:49.124 [2024-11-29 14:04:29.170539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:49.124 [2024-11-29 14:04:29.170628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:49.124 [2024-11-29 14:04:29.170656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:49.124 [2024-11-29 14:04:29.170670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:49.124 [2024-11-29 14:04:29.170685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc16c000b90 00:30:49.124 [2024-11-29 14:04:29.170715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:49.124 qpair failed and we were unable to recover it. 00:30:49.124 [2024-11-29 14:04:29.170820] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:49.124 A controller has encountered a failure and is being reset. 00:30:49.124 [2024-11-29 14:04:29.170887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8be980 (9): Bad file descriptor 00:30:49.124 Controller properly reset. 00:30:49.124 Initializing NVMe Controllers 00:30:49.124 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:49.124 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:49.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:49.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:49.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:49.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:49.124 Initialization complete. Launching workers. 00:30:49.124 Starting thread on core 1 00:30:49.124 Starting thread on core 2 00:30:49.124 Starting thread on core 3 00:30:49.124 Starting thread on core 0 00:30:49.124 14:04:29 -- host/target_disconnect.sh@59 -- # sync 00:30:49.124 00:30:49.124 real 0m11.615s 00:30:49.124 user 0m21.744s 00:30:49.124 sys 0m5.140s 00:30:49.124 14:04:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:49.124 14:04:29 -- common/autotest_common.sh@10 -- # set +x 00:30:49.124 ************************************ 00:30:49.124 END TEST nvmf_target_disconnect_tc2 00:30:49.124 ************************************ 00:30:49.124 14:04:29 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:49.124 14:04:29 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:49.124 14:04:29 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:49.124 14:04:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:49.124 14:04:29 -- nvmf/common.sh@116 -- # sync 00:30:49.124 14:04:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:49.124 14:04:29 -- nvmf/common.sh@119 -- # set +e 00:30:49.124 14:04:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:49.124 14:04:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:49.124 rmmod nvme_tcp 00:30:49.124 rmmod nvme_fabrics 00:30:49.124 rmmod nvme_keyring 00:30:49.124 14:04:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:49.124 14:04:29 -- nvmf/common.sh@123 -- # set -e 00:30:49.124 14:04:29 -- nvmf/common.sh@124 -- # return 0 00:30:49.124 14:04:29 -- nvmf/common.sh@477 -- # '[' -n 2433215 ']' 00:30:49.124 14:04:29 -- nvmf/common.sh@478 -- # killprocess 2433215 00:30:49.124 14:04:29 -- common/autotest_common.sh@936 -- # '[' -z 2433215 ']' 00:30:49.124 14:04:29 -- common/autotest_common.sh@940 -- # kill -0 2433215 00:30:49.124 14:04:29 -- common/autotest_common.sh@941 -- # uname 00:30:49.124 14:04:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:49.124 14:04:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2433215 00:30:49.424 14:04:29 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:49.424 14:04:29 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:49.424 14:04:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2433215' 00:30:49.424 killing process with pid 2433215 00:30:49.424 14:04:29 -- common/autotest_common.sh@955 -- # kill 2433215 00:30:49.424 14:04:29 -- common/autotest_common.sh@960 -- # wait 2433215 00:30:49.424 14:04:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:49.424 14:04:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:49.424 14:04:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:49.424 14:04:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:49.424 14:04:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:49.424 14:04:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:49.424 14:04:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:49.424 14:04:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:51.964 14:04:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:51.964 00:30:51.964 real 0m16.434s 00:30:51.964 user 0m48.586s 00:30:51.964 sys 0m7.093s 00:30:51.964 14:04:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:51.964 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.964 ************************************ 00:30:51.964 END TEST nvmf_target_disconnect 00:30:51.964 ************************************ 00:30:51.964 14:04:31 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:51.964 14:04:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.964 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.964 14:04:31 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:51.964 00:30:51.964 real 22m59.820s 00:30:51.964 user 66m48.699s 00:30:51.964 sys 5m29.015s 00:30:51.964 14:04:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:51.964 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.964 ************************************ 00:30:51.964 END TEST nvmf_tcp 00:30:51.964 ************************************ 00:30:51.964 14:04:31 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:51.964 14:04:31 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:51.964 14:04:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:51.964 14:04:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:51.964 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.964 ************************************ 00:30:51.964 START TEST spdkcli_nvmf_tcp 00:30:51.964 ************************************ 00:30:51.964 14:04:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:51.964 * Looking for test storage... 00:30:51.964 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:51.964 14:04:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:51.964 14:04:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:51.964 14:04:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:51.964 14:04:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:51.964 14:04:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:51.964 14:04:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:51.964 14:04:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:51.964 14:04:31 -- scripts/common.sh@335 -- # IFS=.-: 00:30:51.964 14:04:31 -- scripts/common.sh@335 -- # read -ra ver1 00:30:51.964 14:04:31 -- scripts/common.sh@336 -- # IFS=.-: 00:30:51.964 14:04:31 -- scripts/common.sh@336 -- # read -ra ver2 00:30:51.964 14:04:31 -- scripts/common.sh@337 -- # local 'op=<' 00:30:51.964 14:04:31 -- scripts/common.sh@339 -- # ver1_l=2 00:30:51.964 14:04:31 -- scripts/common.sh@340 -- # ver2_l=1 00:30:51.964 14:04:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:51.964 14:04:31 -- scripts/common.sh@343 -- # case "$op" in 00:30:51.964 14:04:31 -- scripts/common.sh@344 -- # : 1 00:30:51.964 14:04:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:51.964 14:04:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:51.964 14:04:31 -- scripts/common.sh@364 -- # decimal 1 00:30:51.964 14:04:31 -- scripts/common.sh@352 -- # local d=1 00:30:51.965 14:04:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:51.965 14:04:31 -- scripts/common.sh@354 -- # echo 1 00:30:51.965 14:04:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:51.965 14:04:31 -- scripts/common.sh@365 -- # decimal 2 00:30:51.965 14:04:31 -- scripts/common.sh@352 -- # local d=2 00:30:51.965 14:04:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:51.965 14:04:31 -- scripts/common.sh@354 -- # echo 2 00:30:51.965 14:04:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:51.965 14:04:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:51.965 14:04:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:51.965 14:04:31 -- scripts/common.sh@367 -- # return 0 00:30:51.965 14:04:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:51.965 14:04:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:51.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.965 --rc genhtml_branch_coverage=1 00:30:51.965 --rc genhtml_function_coverage=1 00:30:51.965 --rc genhtml_legend=1 00:30:51.965 --rc geninfo_all_blocks=1 00:30:51.965 --rc geninfo_unexecuted_blocks=1 00:30:51.965 00:30:51.965 ' 00:30:51.965 14:04:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:51.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.965 --rc genhtml_branch_coverage=1 00:30:51.965 --rc genhtml_function_coverage=1 00:30:51.965 --rc genhtml_legend=1 00:30:51.965 --rc geninfo_all_blocks=1 00:30:51.965 --rc geninfo_unexecuted_blocks=1 00:30:51.965 00:30:51.965 ' 00:30:51.965 14:04:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:51.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.965 --rc genhtml_branch_coverage=1 00:30:51.965 --rc genhtml_function_coverage=1 00:30:51.965 --rc genhtml_legend=1 00:30:51.965 --rc geninfo_all_blocks=1 00:30:51.965 --rc geninfo_unexecuted_blocks=1 00:30:51.965 00:30:51.965 ' 00:30:51.965 14:04:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:51.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.965 --rc genhtml_branch_coverage=1 00:30:51.965 --rc genhtml_function_coverage=1 00:30:51.965 --rc genhtml_legend=1 00:30:51.965 --rc geninfo_all_blocks=1 00:30:51.965 --rc geninfo_unexecuted_blocks=1 00:30:51.965 00:30:51.965 ' 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:51.965 14:04:31 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:51.965 14:04:31 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:51.965 14:04:31 -- nvmf/common.sh@7 -- # uname -s 00:30:51.965 14:04:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:51.965 14:04:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:51.965 14:04:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:51.965 14:04:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:51.965 14:04:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:51.965 14:04:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:51.965 14:04:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:51.965 14:04:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:51.965 14:04:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:51.965 14:04:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:51.965 14:04:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:51.965 14:04:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:51.965 14:04:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:51.965 14:04:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:51.965 14:04:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:51.965 14:04:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:51.965 14:04:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:51.965 14:04:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:51.965 14:04:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:51.965 14:04:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.965 14:04:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.965 14:04:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.965 14:04:31 -- paths/export.sh@5 -- # export PATH 00:30:51.965 14:04:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.965 14:04:31 -- nvmf/common.sh@46 -- # : 0 00:30:51.965 14:04:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:51.965 14:04:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:51.965 14:04:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:51.965 14:04:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:51.965 14:04:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:51.965 14:04:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:51.965 14:04:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:51.965 14:04:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:51.965 14:04:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.965 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.965 14:04:31 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:51.965 14:04:31 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2434445 00:30:51.965 14:04:31 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:51.965 14:04:31 -- spdkcli/common.sh@34 -- # waitforlisten 2434445 00:30:51.965 14:04:31 -- common/autotest_common.sh@829 -- # '[' -z 2434445 ']' 00:30:51.965 14:04:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:51.965 14:04:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:51.965 14:04:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:51.965 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:51.965 14:04:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:51.965 14:04:31 -- common/autotest_common.sh@10 -- # set +x 00:30:51.965 [2024-11-29 14:04:31.946425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:51.965 [2024-11-29 14:04:31.946521] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2434445 ] 00:30:51.965 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.965 [2024-11-29 14:04:32.004359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:51.965 [2024-11-29 14:04:32.089167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.965 [2024-11-29 14:04:32.089406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:51.965 [2024-11-29 14:04:32.089413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:52.901 14:04:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:52.901 14:04:32 -- common/autotest_common.sh@862 -- # return 0 00:30:52.901 14:04:32 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:52.901 14:04:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:52.901 14:04:32 -- common/autotest_common.sh@10 -- # set +x 00:30:52.901 14:04:32 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:52.901 14:04:32 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:52.901 14:04:32 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:52.901 14:04:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:52.901 14:04:32 -- common/autotest_common.sh@10 -- # set +x 00:30:52.901 14:04:32 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:52.901 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:52.901 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:52.901 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:52.901 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:52.901 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:52.901 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:52.901 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.901 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.901 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:52.901 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:52.901 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:52.901 ' 00:30:53.161 [2024-11-29 14:04:33.397648] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:55.694 [2024-11-29 14:04:35.578195] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:56.633 [2024-11-29 14:04:36.830655] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:59.184 [2024-11-29 14:04:39.149967] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:01.089 [2024-11-29 14:04:41.148766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:02.464 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:02.464 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:02.464 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:02.464 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:02.464 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:02.464 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.465 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.465 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:02.465 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:02.465 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:02.722 14:04:42 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:02.722 14:04:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:02.722 14:04:42 -- common/autotest_common.sh@10 -- # set +x 00:31:02.722 14:04:42 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:02.722 14:04:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:02.722 14:04:42 -- common/autotest_common.sh@10 -- # set +x 00:31:02.722 14:04:42 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:02.722 14:04:42 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:02.981 14:04:43 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:02.981 14:04:43 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:02.981 14:04:43 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:02.981 14:04:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:02.981 14:04:43 -- common/autotest_common.sh@10 -- # set +x 00:31:03.240 14:04:43 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:03.240 14:04:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:03.240 14:04:43 -- common/autotest_common.sh@10 -- # set +x 00:31:03.240 14:04:43 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:03.240 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:03.240 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:03.240 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:03.240 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:03.240 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:03.240 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:03.241 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:03.241 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:03.241 ' 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:08.512 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:08.512 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:08.512 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:08.512 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:08.512 14:04:48 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:08.512 14:04:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:08.512 14:04:48 -- common/autotest_common.sh@10 -- # set +x 00:31:08.512 14:04:48 -- spdkcli/nvmf.sh@90 -- # killprocess 2434445 00:31:08.512 14:04:48 -- common/autotest_common.sh@936 -- # '[' -z 2434445 ']' 00:31:08.512 14:04:48 -- common/autotest_common.sh@940 -- # kill -0 2434445 00:31:08.512 14:04:48 -- common/autotest_common.sh@941 -- # uname 00:31:08.512 14:04:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:08.512 14:04:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2434445 00:31:08.512 14:04:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:08.512 14:04:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:08.512 14:04:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2434445' 00:31:08.512 killing process with pid 2434445 00:31:08.512 14:04:48 -- common/autotest_common.sh@955 -- # kill 2434445 00:31:08.512 [2024-11-29 14:04:48.612323] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:08.512 14:04:48 -- common/autotest_common.sh@960 -- # wait 2434445 00:31:08.769 14:04:48 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:08.769 14:04:48 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:08.769 14:04:48 -- spdkcli/common.sh@13 -- # '[' -n 2434445 ']' 00:31:08.769 14:04:48 -- spdkcli/common.sh@14 -- # killprocess 2434445 00:31:08.769 14:04:48 -- common/autotest_common.sh@936 -- # '[' -z 2434445 ']' 00:31:08.769 14:04:48 -- common/autotest_common.sh@940 -- # kill -0 2434445 00:31:08.769 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2434445) - No such process 00:31:08.769 14:04:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2434445 is not found' 00:31:08.769 Process with pid 2434445 is not found 00:31:08.769 14:04:48 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:08.769 14:04:48 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:08.769 14:04:48 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:08.769 00:31:08.769 real 0m17.072s 00:31:08.769 user 0m36.502s 00:31:08.769 sys 0m0.809s 00:31:08.769 14:04:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:08.769 14:04:48 -- common/autotest_common.sh@10 -- # set +x 00:31:08.769 ************************************ 00:31:08.769 END TEST spdkcli_nvmf_tcp 00:31:08.769 ************************************ 00:31:08.769 14:04:48 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:08.769 14:04:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:08.769 14:04:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:08.769 14:04:48 -- common/autotest_common.sh@10 -- # set +x 00:31:08.769 ************************************ 00:31:08.769 START TEST nvmf_identify_passthru 00:31:08.769 ************************************ 00:31:08.769 14:04:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:08.769 * Looking for test storage... 00:31:08.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:08.769 14:04:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:08.769 14:04:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:08.769 14:04:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:08.769 14:04:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:08.769 14:04:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:08.769 14:04:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:08.769 14:04:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:08.769 14:04:48 -- scripts/common.sh@335 -- # IFS=.-: 00:31:08.769 14:04:48 -- scripts/common.sh@335 -- # read -ra ver1 00:31:08.769 14:04:48 -- scripts/common.sh@336 -- # IFS=.-: 00:31:08.769 14:04:48 -- scripts/common.sh@336 -- # read -ra ver2 00:31:08.769 14:04:48 -- scripts/common.sh@337 -- # local 'op=<' 00:31:08.769 14:04:48 -- scripts/common.sh@339 -- # ver1_l=2 00:31:08.769 14:04:48 -- scripts/common.sh@340 -- # ver2_l=1 00:31:08.769 14:04:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:08.769 14:04:48 -- scripts/common.sh@343 -- # case "$op" in 00:31:08.769 14:04:48 -- scripts/common.sh@344 -- # : 1 00:31:08.769 14:04:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:08.769 14:04:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:08.769 14:04:48 -- scripts/common.sh@364 -- # decimal 1 00:31:08.769 14:04:48 -- scripts/common.sh@352 -- # local d=1 00:31:08.769 14:04:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:08.769 14:04:48 -- scripts/common.sh@354 -- # echo 1 00:31:08.769 14:04:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:08.769 14:04:48 -- scripts/common.sh@365 -- # decimal 2 00:31:08.769 14:04:48 -- scripts/common.sh@352 -- # local d=2 00:31:08.769 14:04:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:08.769 14:04:48 -- scripts/common.sh@354 -- # echo 2 00:31:08.769 14:04:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:08.769 14:04:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:08.769 14:04:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:08.769 14:04:48 -- scripts/common.sh@367 -- # return 0 00:31:08.769 14:04:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:08.769 14:04:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:08.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.769 --rc genhtml_branch_coverage=1 00:31:08.769 --rc genhtml_function_coverage=1 00:31:08.769 --rc genhtml_legend=1 00:31:08.769 --rc geninfo_all_blocks=1 00:31:08.769 --rc geninfo_unexecuted_blocks=1 00:31:08.770 00:31:08.770 ' 00:31:08.770 14:04:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:08.770 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.770 --rc genhtml_branch_coverage=1 00:31:08.770 --rc genhtml_function_coverage=1 00:31:08.770 --rc genhtml_legend=1 00:31:08.770 --rc geninfo_all_blocks=1 00:31:08.770 --rc geninfo_unexecuted_blocks=1 00:31:08.770 00:31:08.770 ' 00:31:08.770 14:04:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:08.770 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.770 --rc genhtml_branch_coverage=1 00:31:08.770 --rc genhtml_function_coverage=1 00:31:08.770 --rc genhtml_legend=1 00:31:08.770 --rc geninfo_all_blocks=1 00:31:08.770 --rc geninfo_unexecuted_blocks=1 00:31:08.770 00:31:08.770 ' 00:31:08.770 14:04:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:08.770 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.770 --rc genhtml_branch_coverage=1 00:31:08.770 --rc genhtml_function_coverage=1 00:31:08.770 --rc genhtml_legend=1 00:31:08.770 --rc geninfo_all_blocks=1 00:31:08.770 --rc geninfo_unexecuted_blocks=1 00:31:08.770 00:31:08.770 ' 00:31:08.770 14:04:48 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:08.770 14:04:48 -- nvmf/common.sh@7 -- # uname -s 00:31:08.770 14:04:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:08.770 14:04:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:08.770 14:04:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:08.770 14:04:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:08.770 14:04:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:08.770 14:04:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:08.770 14:04:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:08.770 14:04:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:08.770 14:04:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:08.770 14:04:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:08.770 14:04:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.770 14:04:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.770 14:04:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:08.770 14:04:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:08.770 14:04:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:08.770 14:04:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:08.770 14:04:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:08.770 14:04:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:08.770 14:04:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:08.770 14:04:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@5 -- # export PATH 00:31:08.770 14:04:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- nvmf/common.sh@46 -- # : 0 00:31:08.770 14:04:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:08.770 14:04:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:08.770 14:04:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:08.770 14:04:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:08.770 14:04:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:08.770 14:04:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:08.770 14:04:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:08.770 14:04:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:08.770 14:04:48 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:08.770 14:04:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:08.770 14:04:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:08.770 14:04:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:08.770 14:04:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- paths/export.sh@5 -- # export PATH 00:31:08.770 14:04:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.770 14:04:48 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:08.770 14:04:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:08.770 14:04:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:08.770 14:04:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:08.770 14:04:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:08.770 14:04:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:08.770 14:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:08.770 14:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:08.770 14:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:08.770 14:04:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:08.770 14:04:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:08.770 14:04:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:08.770 14:04:48 -- common/autotest_common.sh@10 -- # set +x 00:31:10.671 14:04:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:10.671 14:04:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:10.671 14:04:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:10.671 14:04:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:10.671 14:04:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:10.671 14:04:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:10.671 14:04:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:10.671 14:04:50 -- nvmf/common.sh@294 -- # net_devs=() 00:31:10.671 14:04:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:10.671 14:04:50 -- nvmf/common.sh@295 -- # e810=() 00:31:10.671 14:04:50 -- nvmf/common.sh@295 -- # local -ga e810 00:31:10.671 14:04:50 -- nvmf/common.sh@296 -- # x722=() 00:31:10.671 14:04:50 -- nvmf/common.sh@296 -- # local -ga x722 00:31:10.671 14:04:50 -- nvmf/common.sh@297 -- # mlx=() 00:31:10.671 14:04:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:10.671 14:04:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:10.671 14:04:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:10.671 14:04:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:10.671 14:04:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:10.671 14:04:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:10.671 14:04:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:10.671 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:10.671 14:04:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:10.671 14:04:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:10.672 14:04:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:10.672 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:10.672 14:04:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:10.672 14:04:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:10.672 14:04:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:10.672 14:04:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:10.672 14:04:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:10.672 14:04:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:10.672 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:10.672 14:04:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:10.672 14:04:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:10.672 14:04:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:10.672 14:04:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:10.672 14:04:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:10.672 14:04:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:10.672 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:10.672 14:04:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:10.672 14:04:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:10.672 14:04:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:10.672 14:04:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:10.672 14:04:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:10.672 14:04:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:10.672 14:04:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:10.672 14:04:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:10.672 14:04:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:10.672 14:04:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:10.672 14:04:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:10.672 14:04:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:10.672 14:04:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:10.672 14:04:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:10.672 14:04:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:10.672 14:04:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:10.672 14:04:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:10.672 14:04:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:10.932 14:04:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:10.932 14:04:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:10.932 14:04:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:10.932 14:04:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:10.932 14:04:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:10.932 14:04:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:10.932 14:04:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:10.932 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:10.932 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:31:10.932 00:31:10.932 --- 10.0.0.2 ping statistics --- 00:31:10.932 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:10.932 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:31:10.932 14:04:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:10.932 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:10.932 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:31:10.932 00:31:10.932 --- 10.0.0.1 ping statistics --- 00:31:10.932 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:10.932 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:31:10.932 14:04:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:10.932 14:04:51 -- nvmf/common.sh@410 -- # return 0 00:31:10.932 14:04:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:10.932 14:04:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:10.932 14:04:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:10.932 14:04:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:10.932 14:04:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:10.932 14:04:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:10.932 14:04:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:10.932 14:04:51 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:10.932 14:04:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:10.932 14:04:51 -- common/autotest_common.sh@10 -- # set +x 00:31:10.932 14:04:51 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:10.932 14:04:51 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:10.932 14:04:51 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:10.932 14:04:51 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:10.932 14:04:51 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:10.932 14:04:51 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:10.932 14:04:51 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:10.932 14:04:51 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:10.932 14:04:51 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:10.932 14:04:51 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:10.932 14:04:51 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:10.932 14:04:51 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:10.932 14:04:51 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:10.932 14:04:51 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:10.932 14:04:51 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:10.932 14:04:51 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:10.932 14:04:51 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:10.932 14:04:51 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:10.932 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.124 14:04:55 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:15.124 14:04:55 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:15.124 14:04:55 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:15.124 14:04:55 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:15.124 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.309 14:04:59 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:19.309 14:04:59 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:19.309 14:04:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.309 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.309 14:04:59 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:19.309 14:04:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.309 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.309 14:04:59 -- target/identify_passthru.sh@31 -- # nvmfpid=2439182 00:31:19.310 14:04:59 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:19.310 14:04:59 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:19.310 14:04:59 -- target/identify_passthru.sh@35 -- # waitforlisten 2439182 00:31:19.310 14:04:59 -- common/autotest_common.sh@829 -- # '[' -z 2439182 ']' 00:31:19.310 14:04:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:19.310 14:04:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:19.310 14:04:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:19.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:19.310 14:04:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:19.310 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.310 [2024-11-29 14:04:59.577632] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:19.310 [2024-11-29 14:04:59.577745] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:19.567 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.568 [2024-11-29 14:04:59.648130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:19.568 [2024-11-29 14:04:59.734356] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:19.568 [2024-11-29 14:04:59.734546] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:19.568 [2024-11-29 14:04:59.734564] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:19.568 [2024-11-29 14:04:59.734577] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:19.568 [2024-11-29 14:04:59.734644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:19.568 [2024-11-29 14:04:59.734661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:19.568 [2024-11-29 14:04:59.734693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:19.568 [2024-11-29 14:04:59.734696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:19.568 14:04:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:19.568 14:04:59 -- common/autotest_common.sh@862 -- # return 0 00:31:19.568 14:04:59 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:19.568 14:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.568 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.568 INFO: Log level set to 20 00:31:19.568 INFO: Requests: 00:31:19.568 { 00:31:19.568 "jsonrpc": "2.0", 00:31:19.568 "method": "nvmf_set_config", 00:31:19.568 "id": 1, 00:31:19.568 "params": { 00:31:19.568 "admin_cmd_passthru": { 00:31:19.568 "identify_ctrlr": true 00:31:19.568 } 00:31:19.568 } 00:31:19.568 } 00:31:19.568 00:31:19.568 INFO: response: 00:31:19.568 { 00:31:19.568 "jsonrpc": "2.0", 00:31:19.568 "id": 1, 00:31:19.568 "result": true 00:31:19.568 } 00:31:19.568 00:31:19.568 14:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.568 14:04:59 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:19.568 14:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.568 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.568 INFO: Setting log level to 20 00:31:19.568 INFO: Setting log level to 20 00:31:19.568 INFO: Log level set to 20 00:31:19.568 INFO: Log level set to 20 00:31:19.568 INFO: Requests: 00:31:19.568 { 00:31:19.568 "jsonrpc": "2.0", 00:31:19.568 "method": "framework_start_init", 00:31:19.568 "id": 1 00:31:19.568 } 00:31:19.568 00:31:19.568 INFO: Requests: 00:31:19.568 { 00:31:19.568 "jsonrpc": "2.0", 00:31:19.568 "method": "framework_start_init", 00:31:19.568 "id": 1 00:31:19.568 } 00:31:19.568 00:31:19.825 [2024-11-29 14:04:59.908601] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:19.825 INFO: response: 00:31:19.825 { 00:31:19.825 "jsonrpc": "2.0", 00:31:19.825 "id": 1, 00:31:19.825 "result": true 00:31:19.825 } 00:31:19.825 00:31:19.825 INFO: response: 00:31:19.825 { 00:31:19.825 "jsonrpc": "2.0", 00:31:19.825 "id": 1, 00:31:19.825 "result": true 00:31:19.825 } 00:31:19.825 00:31:19.825 14:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.825 14:04:59 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:19.825 14:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.825 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.825 INFO: Setting log level to 40 00:31:19.825 INFO: Setting log level to 40 00:31:19.825 INFO: Setting log level to 40 00:31:19.825 [2024-11-29 14:04:59.918465] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:19.825 14:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.825 14:04:59 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:19.825 14:04:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.825 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:19.825 14:04:59 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:19.825 14:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.825 14:04:59 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 Nvme0n1 00:31:23.117 14:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:02 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:23.117 14:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:23.117 14:05:02 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 14:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:02 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:23.117 14:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:23.117 14:05:02 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 14:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:02 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:23.117 14:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:23.117 14:05:02 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 [2024-11-29 14:05:02.808687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:23.117 14:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:02 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:23.117 14:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:23.117 14:05:02 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 [2024-11-29 14:05:02.816363] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:23.117 [ 00:31:23.117 { 00:31:23.117 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:23.117 "subtype": "Discovery", 00:31:23.117 "listen_addresses": [], 00:31:23.117 "allow_any_host": true, 00:31:23.117 "hosts": [] 00:31:23.117 }, 00:31:23.117 { 00:31:23.117 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:23.117 "subtype": "NVMe", 00:31:23.117 "listen_addresses": [ 00:31:23.117 { 00:31:23.117 "transport": "TCP", 00:31:23.117 "trtype": "TCP", 00:31:23.117 "adrfam": "IPv4", 00:31:23.117 "traddr": "10.0.0.2", 00:31:23.117 "trsvcid": "4420" 00:31:23.117 } 00:31:23.117 ], 00:31:23.117 "allow_any_host": true, 00:31:23.117 "hosts": [], 00:31:23.117 "serial_number": "SPDK00000000000001", 00:31:23.117 "model_number": "SPDK bdev Controller", 00:31:23.117 "max_namespaces": 1, 00:31:23.117 "min_cntlid": 1, 00:31:23.117 "max_cntlid": 65519, 00:31:23.117 "namespaces": [ 00:31:23.117 { 00:31:23.117 "nsid": 1, 00:31:23.117 "bdev_name": "Nvme0n1", 00:31:23.117 "name": "Nvme0n1", 00:31:23.117 "nguid": "DAF5FE9954EC4E499F7F58CF9E0E80D3", 00:31:23.117 "uuid": "daf5fe99-54ec-4e49-9f7f-58cf9e0e80d3" 00:31:23.117 } 00:31:23.117 ] 00:31:23.117 } 00:31:23.117 ] 00:31:23.117 14:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:02 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:23.117 14:05:02 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:23.117 14:05:02 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:23.117 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.117 14:05:03 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:23.117 14:05:03 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:23.117 14:05:03 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:23.117 14:05:03 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:23.117 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.117 14:05:03 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:23.117 14:05:03 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:23.117 14:05:03 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:23.117 14:05:03 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:23.117 14:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:23.117 14:05:03 -- common/autotest_common.sh@10 -- # set +x 00:31:23.117 14:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:23.117 14:05:03 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:23.117 14:05:03 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:23.117 14:05:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:23.117 14:05:03 -- nvmf/common.sh@116 -- # sync 00:31:23.117 14:05:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:23.117 14:05:03 -- nvmf/common.sh@119 -- # set +e 00:31:23.117 14:05:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:23.117 14:05:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:23.117 rmmod nvme_tcp 00:31:23.117 rmmod nvme_fabrics 00:31:23.117 rmmod nvme_keyring 00:31:23.117 14:05:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:23.117 14:05:03 -- nvmf/common.sh@123 -- # set -e 00:31:23.117 14:05:03 -- nvmf/common.sh@124 -- # return 0 00:31:23.117 14:05:03 -- nvmf/common.sh@477 -- # '[' -n 2439182 ']' 00:31:23.117 14:05:03 -- nvmf/common.sh@478 -- # killprocess 2439182 00:31:23.117 14:05:03 -- common/autotest_common.sh@936 -- # '[' -z 2439182 ']' 00:31:23.117 14:05:03 -- common/autotest_common.sh@940 -- # kill -0 2439182 00:31:23.117 14:05:03 -- common/autotest_common.sh@941 -- # uname 00:31:23.117 14:05:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:23.117 14:05:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2439182 00:31:23.117 14:05:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:23.117 14:05:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:23.117 14:05:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2439182' 00:31:23.117 killing process with pid 2439182 00:31:23.117 14:05:03 -- common/autotest_common.sh@955 -- # kill 2439182 00:31:23.117 [2024-11-29 14:05:03.288145] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:23.117 14:05:03 -- common/autotest_common.sh@960 -- # wait 2439182 00:31:25.023 14:05:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:25.023 14:05:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:25.023 14:05:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:25.023 14:05:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:25.023 14:05:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:25.023 14:05:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:25.023 14:05:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:25.023 14:05:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:26.934 14:05:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:26.934 00:31:26.934 real 0m18.059s 00:31:26.934 user 0m26.939s 00:31:26.934 sys 0m2.276s 00:31:26.934 14:05:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:26.934 14:05:06 -- common/autotest_common.sh@10 -- # set +x 00:31:26.934 ************************************ 00:31:26.934 END TEST nvmf_identify_passthru 00:31:26.934 ************************************ 00:31:26.934 14:05:06 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:26.934 14:05:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:26.934 14:05:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:26.935 14:05:06 -- common/autotest_common.sh@10 -- # set +x 00:31:26.935 ************************************ 00:31:26.935 START TEST nvmf_dif 00:31:26.935 ************************************ 00:31:26.935 14:05:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:26.935 * Looking for test storage... 00:31:26.935 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:26.935 14:05:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:26.935 14:05:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:26.935 14:05:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:26.935 14:05:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:26.935 14:05:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:26.935 14:05:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:26.935 14:05:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:26.935 14:05:07 -- scripts/common.sh@335 -- # IFS=.-: 00:31:26.935 14:05:07 -- scripts/common.sh@335 -- # read -ra ver1 00:31:26.935 14:05:07 -- scripts/common.sh@336 -- # IFS=.-: 00:31:26.935 14:05:07 -- scripts/common.sh@336 -- # read -ra ver2 00:31:26.935 14:05:07 -- scripts/common.sh@337 -- # local 'op=<' 00:31:26.935 14:05:07 -- scripts/common.sh@339 -- # ver1_l=2 00:31:26.935 14:05:07 -- scripts/common.sh@340 -- # ver2_l=1 00:31:26.935 14:05:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:26.935 14:05:07 -- scripts/common.sh@343 -- # case "$op" in 00:31:26.935 14:05:07 -- scripts/common.sh@344 -- # : 1 00:31:26.935 14:05:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:26.935 14:05:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:26.935 14:05:07 -- scripts/common.sh@364 -- # decimal 1 00:31:26.935 14:05:07 -- scripts/common.sh@352 -- # local d=1 00:31:26.935 14:05:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:26.935 14:05:07 -- scripts/common.sh@354 -- # echo 1 00:31:26.935 14:05:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:26.935 14:05:07 -- scripts/common.sh@365 -- # decimal 2 00:31:26.935 14:05:07 -- scripts/common.sh@352 -- # local d=2 00:31:26.935 14:05:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:26.935 14:05:07 -- scripts/common.sh@354 -- # echo 2 00:31:26.935 14:05:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:26.935 14:05:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:26.935 14:05:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:26.935 14:05:07 -- scripts/common.sh@367 -- # return 0 00:31:26.935 14:05:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:26.935 14:05:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:26.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.935 --rc genhtml_branch_coverage=1 00:31:26.935 --rc genhtml_function_coverage=1 00:31:26.935 --rc genhtml_legend=1 00:31:26.935 --rc geninfo_all_blocks=1 00:31:26.935 --rc geninfo_unexecuted_blocks=1 00:31:26.935 00:31:26.935 ' 00:31:26.935 14:05:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:26.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.935 --rc genhtml_branch_coverage=1 00:31:26.935 --rc genhtml_function_coverage=1 00:31:26.935 --rc genhtml_legend=1 00:31:26.935 --rc geninfo_all_blocks=1 00:31:26.935 --rc geninfo_unexecuted_blocks=1 00:31:26.935 00:31:26.935 ' 00:31:26.935 14:05:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:26.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.935 --rc genhtml_branch_coverage=1 00:31:26.935 --rc genhtml_function_coverage=1 00:31:26.935 --rc genhtml_legend=1 00:31:26.935 --rc geninfo_all_blocks=1 00:31:26.935 --rc geninfo_unexecuted_blocks=1 00:31:26.935 00:31:26.935 ' 00:31:26.935 14:05:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:26.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.935 --rc genhtml_branch_coverage=1 00:31:26.935 --rc genhtml_function_coverage=1 00:31:26.935 --rc genhtml_legend=1 00:31:26.935 --rc geninfo_all_blocks=1 00:31:26.935 --rc geninfo_unexecuted_blocks=1 00:31:26.935 00:31:26.935 ' 00:31:26.935 14:05:07 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:26.935 14:05:07 -- nvmf/common.sh@7 -- # uname -s 00:31:26.935 14:05:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:26.935 14:05:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:26.935 14:05:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:26.935 14:05:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:26.935 14:05:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:26.935 14:05:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:26.935 14:05:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:26.935 14:05:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:26.935 14:05:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:26.935 14:05:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:26.935 14:05:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:26.935 14:05:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:26.935 14:05:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:26.935 14:05:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:26.935 14:05:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:26.935 14:05:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:26.935 14:05:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:26.935 14:05:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:26.935 14:05:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:26.935 14:05:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.935 14:05:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.935 14:05:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.935 14:05:07 -- paths/export.sh@5 -- # export PATH 00:31:26.935 14:05:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.935 14:05:07 -- nvmf/common.sh@46 -- # : 0 00:31:26.935 14:05:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:26.935 14:05:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:26.935 14:05:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:26.935 14:05:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:26.935 14:05:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:26.935 14:05:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:26.935 14:05:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:26.935 14:05:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:26.935 14:05:07 -- target/dif.sh@15 -- # NULL_META=16 00:31:26.935 14:05:07 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:26.935 14:05:07 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:26.935 14:05:07 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:26.935 14:05:07 -- target/dif.sh@135 -- # nvmftestinit 00:31:26.935 14:05:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:26.935 14:05:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:26.935 14:05:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:26.935 14:05:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:26.935 14:05:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:26.935 14:05:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:26.935 14:05:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:26.935 14:05:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:26.935 14:05:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:26.935 14:05:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:26.935 14:05:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:26.935 14:05:07 -- common/autotest_common.sh@10 -- # set +x 00:31:28.838 14:05:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:28.838 14:05:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:28.838 14:05:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:28.838 14:05:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:28.838 14:05:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:28.838 14:05:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:28.838 14:05:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:28.838 14:05:09 -- nvmf/common.sh@294 -- # net_devs=() 00:31:28.838 14:05:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:28.838 14:05:09 -- nvmf/common.sh@295 -- # e810=() 00:31:28.838 14:05:09 -- nvmf/common.sh@295 -- # local -ga e810 00:31:28.838 14:05:09 -- nvmf/common.sh@296 -- # x722=() 00:31:28.838 14:05:09 -- nvmf/common.sh@296 -- # local -ga x722 00:31:28.838 14:05:09 -- nvmf/common.sh@297 -- # mlx=() 00:31:28.838 14:05:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:28.838 14:05:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:28.838 14:05:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:28.838 14:05:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:28.838 14:05:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:28.838 14:05:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:28.838 14:05:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:28.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:28.838 14:05:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:28.838 14:05:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:28.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:28.838 14:05:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:28.838 14:05:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:28.838 14:05:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:28.838 14:05:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:28.838 14:05:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:28.838 14:05:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:28.838 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:28.838 14:05:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:28.838 14:05:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:28.838 14:05:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:28.838 14:05:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:28.838 14:05:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:28.838 14:05:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:28.838 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:28.838 14:05:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:28.838 14:05:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:28.838 14:05:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:28.838 14:05:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:28.838 14:05:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:28.838 14:05:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:28.838 14:05:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:28.839 14:05:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:28.839 14:05:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:28.839 14:05:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:28.839 14:05:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:28.839 14:05:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:28.839 14:05:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:28.839 14:05:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:28.839 14:05:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:28.839 14:05:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:28.839 14:05:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:28.839 14:05:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:29.098 14:05:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:29.098 14:05:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:29.098 14:05:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:29.098 14:05:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:29.098 14:05:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:29.098 14:05:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:29.098 14:05:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:29.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:29.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:31:29.098 00:31:29.098 --- 10.0.0.2 ping statistics --- 00:31:29.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:29.098 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:31:29.098 14:05:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:29.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:29.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:31:29.098 00:31:29.098 --- 10.0.0.1 ping statistics --- 00:31:29.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:29.098 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:31:29.098 14:05:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:29.098 14:05:09 -- nvmf/common.sh@410 -- # return 0 00:31:29.098 14:05:09 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:29.098 14:05:09 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:30.032 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:30.032 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:30.032 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:30.032 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:30.032 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:30.032 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:30.032 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:30.032 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:30.032 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:30.032 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:30.032 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:30.032 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:30.032 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:30.032 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:30.032 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:30.032 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:30.032 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:30.290 14:05:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:30.290 14:05:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:30.290 14:05:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:30.290 14:05:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:30.290 14:05:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:30.290 14:05:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:30.290 14:05:10 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:30.290 14:05:10 -- target/dif.sh@137 -- # nvmfappstart 00:31:30.290 14:05:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:30.290 14:05:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:30.290 14:05:10 -- common/autotest_common.sh@10 -- # set +x 00:31:30.290 14:05:10 -- nvmf/common.sh@469 -- # nvmfpid=2442504 00:31:30.290 14:05:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:30.290 14:05:10 -- nvmf/common.sh@470 -- # waitforlisten 2442504 00:31:30.290 14:05:10 -- common/autotest_common.sh@829 -- # '[' -z 2442504 ']' 00:31:30.290 14:05:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:30.290 14:05:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:30.290 14:05:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:30.290 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:30.290 14:05:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:30.290 14:05:10 -- common/autotest_common.sh@10 -- # set +x 00:31:30.290 [2024-11-29 14:05:10.544464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:30.290 [2024-11-29 14:05:10.544538] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:30.551 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.551 [2024-11-29 14:05:10.617256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:30.551 [2024-11-29 14:05:10.707111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:30.551 [2024-11-29 14:05:10.707279] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:30.551 [2024-11-29 14:05:10.707298] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:30.551 [2024-11-29 14:05:10.707314] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:30.551 [2024-11-29 14:05:10.707344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:31.486 14:05:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:31.486 14:05:11 -- common/autotest_common.sh@862 -- # return 0 00:31:31.486 14:05:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:31.486 14:05:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 14:05:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:31.486 14:05:11 -- target/dif.sh@139 -- # create_transport 00:31:31.486 14:05:11 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:31.486 14:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 [2024-11-29 14:05:11.544501] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:31.486 14:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.486 14:05:11 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:31.486 14:05:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:31.486 14:05:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 ************************************ 00:31:31.486 START TEST fio_dif_1_default 00:31:31.486 ************************************ 00:31:31.486 14:05:11 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:31.486 14:05:11 -- target/dif.sh@86 -- # create_subsystems 0 00:31:31.486 14:05:11 -- target/dif.sh@28 -- # local sub 00:31:31.486 14:05:11 -- target/dif.sh@30 -- # for sub in "$@" 00:31:31.486 14:05:11 -- target/dif.sh@31 -- # create_subsystem 0 00:31:31.486 14:05:11 -- target/dif.sh@18 -- # local sub_id=0 00:31:31.486 14:05:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:31.486 14:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 bdev_null0 00:31:31.486 14:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.486 14:05:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:31.486 14:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 14:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.486 14:05:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:31.486 14:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 14:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.486 14:05:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:31.486 14:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.486 14:05:11 -- common/autotest_common.sh@10 -- # set +x 00:31:31.486 [2024-11-29 14:05:11.580731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.486 14:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.486 14:05:11 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:31.486 14:05:11 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:31.486 14:05:11 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:31.486 14:05:11 -- nvmf/common.sh@520 -- # config=() 00:31:31.486 14:05:11 -- nvmf/common.sh@520 -- # local subsystem config 00:31:31.486 14:05:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:31.486 14:05:11 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.486 14:05:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:31.486 { 00:31:31.486 "params": { 00:31:31.486 "name": "Nvme$subsystem", 00:31:31.486 "trtype": "$TEST_TRANSPORT", 00:31:31.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:31.486 "adrfam": "ipv4", 00:31:31.486 "trsvcid": "$NVMF_PORT", 00:31:31.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:31.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:31.486 "hdgst": ${hdgst:-false}, 00:31:31.486 "ddgst": ${ddgst:-false} 00:31:31.486 }, 00:31:31.486 "method": "bdev_nvme_attach_controller" 00:31:31.486 } 00:31:31.486 EOF 00:31:31.486 )") 00:31:31.486 14:05:11 -- target/dif.sh@82 -- # gen_fio_conf 00:31:31.486 14:05:11 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.486 14:05:11 -- target/dif.sh@54 -- # local file 00:31:31.486 14:05:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:31.486 14:05:11 -- target/dif.sh@56 -- # cat 00:31:31.486 14:05:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:31.486 14:05:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:31.486 14:05:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.486 14:05:11 -- common/autotest_common.sh@1330 -- # shift 00:31:31.486 14:05:11 -- nvmf/common.sh@542 -- # cat 00:31:31.487 14:05:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:31.487 14:05:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.487 14:05:11 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:31.487 14:05:11 -- target/dif.sh@72 -- # (( file <= files )) 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.487 14:05:11 -- nvmf/common.sh@544 -- # jq . 00:31:31.487 14:05:11 -- nvmf/common.sh@545 -- # IFS=, 00:31:31.487 14:05:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:31.487 "params": { 00:31:31.487 "name": "Nvme0", 00:31:31.487 "trtype": "tcp", 00:31:31.487 "traddr": "10.0.0.2", 00:31:31.487 "adrfam": "ipv4", 00:31:31.487 "trsvcid": "4420", 00:31:31.487 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:31.487 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:31.487 "hdgst": false, 00:31:31.487 "ddgst": false 00:31:31.487 }, 00:31:31.487 "method": "bdev_nvme_attach_controller" 00:31:31.487 }' 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.487 14:05:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.487 14:05:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.487 14:05:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.487 14:05:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.487 14:05:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:31.487 14:05:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.743 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:31.743 fio-3.35 00:31:31.743 Starting 1 thread 00:31:31.743 EAL: No free 2048 kB hugepages reported on node 1 00:31:32.308 [2024-11-29 14:05:12.371566] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:32.308 [2024-11-29 14:05:12.371622] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:42.269 00:31:42.269 filename0: (groupid=0, jobs=1): err= 0: pid=2442868: Fri Nov 29 14:05:22 2024 00:31:42.269 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10013msec) 00:31:42.269 slat (usec): min=5, max=104, avg= 8.54, stdev= 4.07 00:31:42.269 clat (usec): min=40865, max=46052, avg=41006.09, stdev=349.64 00:31:42.269 lat (usec): min=40872, max=46083, avg=41014.63, stdev=350.43 00:31:42.269 clat percentiles (usec): 00:31:42.269 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:42.269 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:42.269 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:42.269 | 99.00th=[42206], 99.50th=[42730], 99.90th=[45876], 99.95th=[45876], 00:31:42.269 | 99.99th=[45876] 00:31:42.269 bw ( KiB/s): min= 384, max= 416, per=99.51%, avg=388.80, stdev=11.72, samples=20 00:31:42.269 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:42.269 lat (msec) : 50=100.00% 00:31:42.269 cpu : usr=91.44%, sys=8.26%, ctx=27, majf=0, minf=323 00:31:42.269 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:42.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.269 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.269 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:42.269 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:42.269 00:31:42.269 Run status group 0 (all jobs): 00:31:42.269 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10013-10013msec 00:31:42.528 14:05:22 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:42.528 14:05:22 -- target/dif.sh@43 -- # local sub 00:31:42.528 14:05:22 -- target/dif.sh@45 -- # for sub in "$@" 00:31:42.528 14:05:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:42.528 14:05:22 -- target/dif.sh@36 -- # local sub_id=0 00:31:42.528 14:05:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 00:31:42.528 real 0m11.158s 00:31:42.528 user 0m10.330s 00:31:42.528 sys 0m1.090s 00:31:42.528 14:05:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 ************************************ 00:31:42.528 END TEST fio_dif_1_default 00:31:42.528 ************************************ 00:31:42.528 14:05:22 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:42.528 14:05:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:42.528 14:05:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 ************************************ 00:31:42.528 START TEST fio_dif_1_multi_subsystems 00:31:42.528 ************************************ 00:31:42.528 14:05:22 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:42.528 14:05:22 -- target/dif.sh@92 -- # local files=1 00:31:42.528 14:05:22 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:42.528 14:05:22 -- target/dif.sh@28 -- # local sub 00:31:42.528 14:05:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:42.528 14:05:22 -- target/dif.sh@31 -- # create_subsystem 0 00:31:42.528 14:05:22 -- target/dif.sh@18 -- # local sub_id=0 00:31:42.528 14:05:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 bdev_null0 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 [2024-11-29 14:05:22.762499] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:42.528 14:05:22 -- target/dif.sh@31 -- # create_subsystem 1 00:31:42.528 14:05:22 -- target/dif.sh@18 -- # local sub_id=1 00:31:42.528 14:05:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 bdev_null1 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:42.528 14:05:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:42.528 14:05:22 -- common/autotest_common.sh@10 -- # set +x 00:31:42.528 14:05:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:42.528 14:05:22 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:42.528 14:05:22 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:42.528 14:05:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:42.528 14:05:22 -- nvmf/common.sh@520 -- # config=() 00:31:42.528 14:05:22 -- nvmf/common.sh@520 -- # local subsystem config 00:31:42.528 14:05:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:42.528 14:05:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.528 14:05:22 -- target/dif.sh@82 -- # gen_fio_conf 00:31:42.528 14:05:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:42.528 { 00:31:42.528 "params": { 00:31:42.528 "name": "Nvme$subsystem", 00:31:42.528 "trtype": "$TEST_TRANSPORT", 00:31:42.528 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:42.528 "adrfam": "ipv4", 00:31:42.528 "trsvcid": "$NVMF_PORT", 00:31:42.528 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:42.528 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:42.528 "hdgst": ${hdgst:-false}, 00:31:42.528 "ddgst": ${ddgst:-false} 00:31:42.528 }, 00:31:42.528 "method": "bdev_nvme_attach_controller" 00:31:42.528 } 00:31:42.528 EOF 00:31:42.528 )") 00:31:42.528 14:05:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.528 14:05:22 -- target/dif.sh@54 -- # local file 00:31:42.528 14:05:22 -- target/dif.sh@56 -- # cat 00:31:42.528 14:05:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:42.528 14:05:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:42.528 14:05:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:42.528 14:05:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.528 14:05:22 -- common/autotest_common.sh@1330 -- # shift 00:31:42.528 14:05:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:42.528 14:05:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:42.529 14:05:22 -- nvmf/common.sh@542 -- # cat 00:31:42.529 14:05:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:42.529 14:05:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:42.529 14:05:22 -- target/dif.sh@73 -- # cat 00:31:42.529 14:05:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.529 14:05:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:42.529 14:05:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:42.529 14:05:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:42.529 14:05:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:42.529 { 00:31:42.529 "params": { 00:31:42.529 "name": "Nvme$subsystem", 00:31:42.529 "trtype": "$TEST_TRANSPORT", 00:31:42.529 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:42.529 "adrfam": "ipv4", 00:31:42.529 "trsvcid": "$NVMF_PORT", 00:31:42.529 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:42.529 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:42.529 "hdgst": ${hdgst:-false}, 00:31:42.529 "ddgst": ${ddgst:-false} 00:31:42.529 }, 00:31:42.529 "method": "bdev_nvme_attach_controller" 00:31:42.529 } 00:31:42.529 EOF 00:31:42.529 )") 00:31:42.529 14:05:22 -- target/dif.sh@72 -- # (( file++ )) 00:31:42.529 14:05:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:42.529 14:05:22 -- nvmf/common.sh@542 -- # cat 00:31:42.529 14:05:22 -- nvmf/common.sh@544 -- # jq . 00:31:42.788 14:05:22 -- nvmf/common.sh@545 -- # IFS=, 00:31:42.788 14:05:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:42.788 "params": { 00:31:42.788 "name": "Nvme0", 00:31:42.788 "trtype": "tcp", 00:31:42.788 "traddr": "10.0.0.2", 00:31:42.788 "adrfam": "ipv4", 00:31:42.788 "trsvcid": "4420", 00:31:42.788 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:42.788 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:42.788 "hdgst": false, 00:31:42.788 "ddgst": false 00:31:42.788 }, 00:31:42.788 "method": "bdev_nvme_attach_controller" 00:31:42.788 },{ 00:31:42.788 "params": { 00:31:42.788 "name": "Nvme1", 00:31:42.788 "trtype": "tcp", 00:31:42.788 "traddr": "10.0.0.2", 00:31:42.788 "adrfam": "ipv4", 00:31:42.788 "trsvcid": "4420", 00:31:42.788 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:42.788 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:42.788 "hdgst": false, 00:31:42.788 "ddgst": false 00:31:42.788 }, 00:31:42.788 "method": "bdev_nvme_attach_controller" 00:31:42.788 }' 00:31:42.788 14:05:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:42.788 14:05:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:42.788 14:05:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:42.788 14:05:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.788 14:05:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:42.788 14:05:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:42.788 14:05:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:42.788 14:05:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:42.788 14:05:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:42.788 14:05:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.788 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:42.788 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:42.788 fio-3.35 00:31:42.788 Starting 2 threads 00:31:43.046 EAL: No free 2048 kB hugepages reported on node 1 00:31:43.303 [2024-11-29 14:05:23.582463] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:43.303 [2024-11-29 14:05:23.582521] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:55.494 00:31:55.494 filename0: (groupid=0, jobs=1): err= 0: pid=2444305: Fri Nov 29 14:05:33 2024 00:31:55.494 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10005msec) 00:31:55.494 slat (nsec): min=6624, max=28763, avg=8885.02, stdev=2386.59 00:31:55.494 clat (usec): min=580, max=44039, avg=21078.11, stdev=20360.37 00:31:55.494 lat (usec): min=588, max=44063, avg=21087.00, stdev=20360.01 00:31:55.494 clat percentiles (usec): 00:31:55.494 | 1.00th=[ 594], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 627], 00:31:55.494 | 30.00th=[ 635], 40.00th=[ 644], 50.00th=[41157], 60.00th=[41157], 00:31:55.494 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:55.494 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:31:55.494 | 99.99th=[43779] 00:31:55.494 bw ( KiB/s): min= 672, max= 768, per=65.87%, avg=756.80, stdev=26.01, samples=20 00:31:55.494 iops : min= 168, max= 192, avg=189.20, stdev= 6.50, samples=20 00:31:55.494 lat (usec) : 750=48.52%, 1000=1.27% 00:31:55.494 lat (msec) : 50=50.21% 00:31:55.494 cpu : usr=95.32%, sys=4.34%, ctx=16, majf=0, minf=127 00:31:55.494 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:55.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.494 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.494 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:55.494 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:55.494 filename1: (groupid=0, jobs=1): err= 0: pid=2444306: Fri Nov 29 14:05:33 2024 00:31:55.494 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:31:55.494 slat (nsec): min=5843, max=26518, avg=8963.30, stdev=2314.80 00:31:55.494 clat (usec): min=40632, max=43038, avg=40988.79, stdev=168.08 00:31:55.494 lat (usec): min=40639, max=43051, avg=40997.76, stdev=168.48 00:31:55.494 clat percentiles (usec): 00:31:55.494 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:55.494 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:55.494 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:55.494 | 99.00th=[41681], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:31:55.494 | 99.99th=[43254] 00:31:55.494 bw ( KiB/s): min= 384, max= 416, per=33.80%, avg=388.80, stdev=11.72, samples=20 00:31:55.494 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:55.494 lat (msec) : 50=100.00% 00:31:55.494 cpu : usr=95.25%, sys=4.44%, ctx=11, majf=0, minf=198 00:31:55.494 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:55.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.494 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.494 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:55.494 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:55.494 00:31:55.494 Run status group 0 (all jobs): 00:31:55.494 READ: bw=1148KiB/s (1175kB/s), 390KiB/s-758KiB/s (399kB/s-776kB/s), io=11.2MiB (11.8MB), run=10005-10009msec 00:31:55.494 14:05:33 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:55.494 14:05:33 -- target/dif.sh@43 -- # local sub 00:31:55.494 14:05:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:55.494 14:05:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:55.494 14:05:33 -- target/dif.sh@36 -- # local sub_id=0 00:31:55.494 14:05:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:55.494 14:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:33 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 14:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 14:05:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:55.494 14:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:33 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 14:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 14:05:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:55.494 14:05:33 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:55.494 14:05:33 -- target/dif.sh@36 -- # local sub_id=1 00:31:55.494 14:05:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:55.494 14:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:33 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 14:05:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:55.494 14:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 00:31:55.494 real 0m11.280s 00:31:55.494 user 0m20.361s 00:31:55.494 sys 0m1.189s 00:31:55.494 14:05:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:55.494 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 ************************************ 00:31:55.494 END TEST fio_dif_1_multi_subsystems 00:31:55.494 ************************************ 00:31:55.494 14:05:34 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:55.494 14:05:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:55.494 14:05:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:55.494 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 ************************************ 00:31:55.494 START TEST fio_dif_rand_params 00:31:55.494 ************************************ 00:31:55.494 14:05:34 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:55.494 14:05:34 -- target/dif.sh@100 -- # local NULL_DIF 00:31:55.494 14:05:34 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:55.494 14:05:34 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:55.494 14:05:34 -- target/dif.sh@103 -- # bs=128k 00:31:55.494 14:05:34 -- target/dif.sh@103 -- # numjobs=3 00:31:55.494 14:05:34 -- target/dif.sh@103 -- # iodepth=3 00:31:55.494 14:05:34 -- target/dif.sh@103 -- # runtime=5 00:31:55.494 14:05:34 -- target/dif.sh@105 -- # create_subsystems 0 00:31:55.494 14:05:34 -- target/dif.sh@28 -- # local sub 00:31:55.494 14:05:34 -- target/dif.sh@30 -- # for sub in "$@" 00:31:55.494 14:05:34 -- target/dif.sh@31 -- # create_subsystem 0 00:31:55.494 14:05:34 -- target/dif.sh@18 -- # local sub_id=0 00:31:55.494 14:05:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:55.494 14:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 bdev_null0 00:31:55.494 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 14:05:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:55.494 14:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.494 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.494 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.494 14:05:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:55.494 14:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.495 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.495 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.495 14:05:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:55.495 14:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.495 14:05:34 -- common/autotest_common.sh@10 -- # set +x 00:31:55.495 [2024-11-29 14:05:34.071279] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:55.495 14:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.495 14:05:34 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:55.495 14:05:34 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:55.495 14:05:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:55.495 14:05:34 -- nvmf/common.sh@520 -- # config=() 00:31:55.495 14:05:34 -- nvmf/common.sh@520 -- # local subsystem config 00:31:55.495 14:05:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:55.495 14:05:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:55.495 14:05:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:55.495 { 00:31:55.495 "params": { 00:31:55.495 "name": "Nvme$subsystem", 00:31:55.495 "trtype": "$TEST_TRANSPORT", 00:31:55.495 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:55.495 "adrfam": "ipv4", 00:31:55.495 "trsvcid": "$NVMF_PORT", 00:31:55.495 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:55.495 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:55.495 "hdgst": ${hdgst:-false}, 00:31:55.495 "ddgst": ${ddgst:-false} 00:31:55.495 }, 00:31:55.495 "method": "bdev_nvme_attach_controller" 00:31:55.495 } 00:31:55.495 EOF 00:31:55.495 )") 00:31:55.495 14:05:34 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:55.495 14:05:34 -- target/dif.sh@82 -- # gen_fio_conf 00:31:55.495 14:05:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:55.495 14:05:34 -- target/dif.sh@54 -- # local file 00:31:55.495 14:05:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:55.495 14:05:34 -- target/dif.sh@56 -- # cat 00:31:55.495 14:05:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:55.495 14:05:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:55.495 14:05:34 -- common/autotest_common.sh@1330 -- # shift 00:31:55.495 14:05:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:55.495 14:05:34 -- nvmf/common.sh@542 -- # cat 00:31:55.495 14:05:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:55.495 14:05:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:55.495 14:05:34 -- target/dif.sh@72 -- # (( file <= files )) 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:55.495 14:05:34 -- nvmf/common.sh@544 -- # jq . 00:31:55.495 14:05:34 -- nvmf/common.sh@545 -- # IFS=, 00:31:55.495 14:05:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:55.495 "params": { 00:31:55.495 "name": "Nvme0", 00:31:55.495 "trtype": "tcp", 00:31:55.495 "traddr": "10.0.0.2", 00:31:55.495 "adrfam": "ipv4", 00:31:55.495 "trsvcid": "4420", 00:31:55.495 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:55.495 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:55.495 "hdgst": false, 00:31:55.495 "ddgst": false 00:31:55.495 }, 00:31:55.495 "method": "bdev_nvme_attach_controller" 00:31:55.495 }' 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:55.495 14:05:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:55.495 14:05:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:55.495 14:05:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:55.495 14:05:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:55.495 14:05:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:55.495 14:05:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:55.495 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:55.495 ... 00:31:55.495 fio-3.35 00:31:55.495 Starting 3 threads 00:31:55.495 EAL: No free 2048 kB hugepages reported on node 1 00:31:55.495 [2024-11-29 14:05:34.820652] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:55.495 [2024-11-29 14:05:34.820731] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:59.795 00:31:59.795 filename0: (groupid=0, jobs=1): err= 0: pid=2445743: Fri Nov 29 14:05:39 2024 00:31:59.795 read: IOPS=213, BW=26.7MiB/s (28.0MB/s)(135MiB/5049msec) 00:31:59.795 slat (nsec): min=4617, max=35626, avg=12299.06, stdev=2367.29 00:31:59.795 clat (usec): min=4806, max=57582, avg=13981.92, stdev=8729.34 00:31:59.795 lat (usec): min=4817, max=57594, avg=13994.22, stdev=8729.24 00:31:59.795 clat percentiles (usec): 00:31:59.795 | 1.00th=[ 5800], 5.00th=[ 7635], 10.00th=[ 8291], 20.00th=[ 9634], 00:31:59.795 | 30.00th=[10945], 40.00th=[11731], 50.00th=[12518], 60.00th=[13173], 00:31:59.795 | 70.00th=[14222], 80.00th=[15139], 90.00th=[16319], 95.00th=[18482], 00:31:59.795 | 99.00th=[54789], 99.50th=[56886], 99.90th=[57410], 99.95th=[57410], 00:31:59.795 | 99.99th=[57410] 00:31:59.795 bw ( KiB/s): min=19712, max=32768, per=31.83%, avg=27551.10, stdev=4073.37, samples=10 00:31:59.795 iops : min= 154, max= 256, avg=215.20, stdev=31.82, samples=10 00:31:59.795 lat (msec) : 10=22.43%, 20=73.22%, 50=0.65%, 100=3.71% 00:31:59.795 cpu : usr=93.68%, sys=5.86%, ctx=16, majf=0, minf=149 00:31:59.795 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:59.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.795 issued rwts: total=1079,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:59.795 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:59.795 filename0: (groupid=0, jobs=1): err= 0: pid=2445744: Fri Nov 29 14:05:39 2024 00:31:59.795 read: IOPS=226, BW=28.3MiB/s (29.7MB/s)(143MiB/5049msec) 00:31:59.795 slat (nsec): min=4330, max=64867, avg=12526.00, stdev=3173.36 00:31:59.795 clat (usec): min=5032, max=57612, avg=13171.13, stdev=8185.42 00:31:59.795 lat (usec): min=5043, max=57624, avg=13183.66, stdev=8185.20 00:31:59.795 clat percentiles (usec): 00:31:59.795 | 1.00th=[ 5538], 5.00th=[ 7898], 10.00th=[ 8717], 20.00th=[ 9765], 00:31:59.795 | 30.00th=[10421], 40.00th=[10945], 50.00th=[11600], 60.00th=[12256], 00:31:59.795 | 70.00th=[12911], 80.00th=[13829], 90.00th=[15270], 95.00th=[16909], 00:31:59.795 | 99.00th=[52167], 99.50th=[53740], 99.90th=[56361], 99.95th=[57410], 00:31:59.795 | 99.99th=[57410] 00:31:59.795 bw ( KiB/s): min=23552, max=34048, per=33.78%, avg=29235.20, stdev=3442.65, samples=10 00:31:59.795 iops : min= 184, max= 266, avg=228.40, stdev=26.90, samples=10 00:31:59.795 lat (msec) : 10=22.53%, 20=73.36%, 50=1.31%, 100=2.79% 00:31:59.795 cpu : usr=93.15%, sys=6.36%, ctx=16, majf=0, minf=81 00:31:59.795 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:59.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.796 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.796 issued rwts: total=1145,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:59.796 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:59.796 filename0: (groupid=0, jobs=1): err= 0: pid=2445745: Fri Nov 29 14:05:39 2024 00:31:59.796 read: IOPS=235, BW=29.5MiB/s (30.9MB/s)(149MiB/5048msec) 00:31:59.796 slat (nsec): min=4387, max=77077, avg=12452.78, stdev=2886.83 00:31:59.796 clat (usec): min=5003, max=57216, avg=12674.79, stdev=6536.36 00:31:59.796 lat (usec): min=5015, max=57228, avg=12687.24, stdev=6536.47 00:31:59.796 clat percentiles (usec): 00:31:59.796 | 1.00th=[ 5407], 5.00th=[ 6587], 10.00th=[ 8094], 20.00th=[ 9372], 00:31:59.796 | 30.00th=[10552], 40.00th=[11338], 50.00th=[12125], 60.00th=[12780], 00:31:59.796 | 70.00th=[13304], 80.00th=[14484], 90.00th=[15533], 95.00th=[16581], 00:31:59.796 | 99.00th=[52691], 99.50th=[54264], 99.90th=[56361], 99.95th=[57410], 00:31:59.796 | 99.99th=[57410] 00:31:59.796 bw ( KiB/s): min=24832, max=39424, per=35.11%, avg=30387.20, stdev=4722.03, samples=10 00:31:59.796 iops : min= 194, max= 308, avg=237.40, stdev=36.89, samples=10 00:31:59.796 lat (msec) : 10=25.46%, 20=72.35%, 50=0.50%, 100=1.68% 00:31:59.796 cpu : usr=93.30%, sys=6.22%, ctx=16, majf=0, minf=182 00:31:59.796 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:59.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.796 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.796 issued rwts: total=1190,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:59.796 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:59.796 00:31:59.796 Run status group 0 (all jobs): 00:31:59.796 READ: bw=84.5MiB/s (88.6MB/s), 26.7MiB/s-29.5MiB/s (28.0MB/s-30.9MB/s), io=427MiB (447MB), run=5048-5049msec 00:32:00.054 14:05:40 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:00.054 14:05:40 -- target/dif.sh@43 -- # local sub 00:32:00.054 14:05:40 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.054 14:05:40 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:00.054 14:05:40 -- target/dif.sh@36 -- # local sub_id=0 00:32:00.054 14:05:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:00.054 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.054 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.054 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.054 14:05:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:00.054 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.054 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.054 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # bs=4k 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # numjobs=8 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # iodepth=16 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # runtime= 00:32:00.054 14:05:40 -- target/dif.sh@109 -- # files=2 00:32:00.054 14:05:40 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:00.054 14:05:40 -- target/dif.sh@28 -- # local sub 00:32:00.054 14:05:40 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.054 14:05:40 -- target/dif.sh@31 -- # create_subsystem 0 00:32:00.054 14:05:40 -- target/dif.sh@18 -- # local sub_id=0 00:32:00.054 14:05:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:00.054 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.054 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.054 bdev_null0 00:32:00.054 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.054 14:05:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:00.054 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.054 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.054 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.054 14:05:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:00.054 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.054 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 [2024-11-29 14:05:40.226805] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.055 14:05:40 -- target/dif.sh@31 -- # create_subsystem 1 00:32:00.055 14:05:40 -- target/dif.sh@18 -- # local sub_id=1 00:32:00.055 14:05:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 bdev_null1 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.055 14:05:40 -- target/dif.sh@31 -- # create_subsystem 2 00:32:00.055 14:05:40 -- target/dif.sh@18 -- # local sub_id=2 00:32:00.055 14:05:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 bdev_null2 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:00.055 14:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.055 14:05:40 -- common/autotest_common.sh@10 -- # set +x 00:32:00.055 14:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.055 14:05:40 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:00.055 14:05:40 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:00.055 14:05:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:00.055 14:05:40 -- nvmf/common.sh@520 -- # config=() 00:32:00.055 14:05:40 -- nvmf/common.sh@520 -- # local subsystem config 00:32:00.055 14:05:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.055 14:05:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.055 { 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme$subsystem", 00:32:00.055 "trtype": "$TEST_TRANSPORT", 00:32:00.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "$NVMF_PORT", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.055 "hdgst": ${hdgst:-false}, 00:32:00.055 "ddgst": ${ddgst:-false} 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 } 00:32:00.055 EOF 00:32:00.055 )") 00:32:00.055 14:05:40 -- target/dif.sh@82 -- # gen_fio_conf 00:32:00.055 14:05:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.055 14:05:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:00.055 14:05:40 -- target/dif.sh@54 -- # local file 00:32:00.055 14:05:40 -- target/dif.sh@56 -- # cat 00:32:00.055 14:05:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:00.055 14:05:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:00.055 14:05:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.055 14:05:40 -- common/autotest_common.sh@1330 -- # shift 00:32:00.055 14:05:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:00.055 14:05:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # cat 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.055 14:05:40 -- target/dif.sh@73 -- # cat 00:32:00.055 14:05:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.055 { 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme$subsystem", 00:32:00.055 "trtype": "$TEST_TRANSPORT", 00:32:00.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "$NVMF_PORT", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.055 "hdgst": ${hdgst:-false}, 00:32:00.055 "ddgst": ${ddgst:-false} 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 } 00:32:00.055 EOF 00:32:00.055 )") 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # cat 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.055 14:05:40 -- target/dif.sh@73 -- # cat 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.055 14:05:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.055 14:05:40 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.055 { 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme$subsystem", 00:32:00.055 "trtype": "$TEST_TRANSPORT", 00:32:00.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "$NVMF_PORT", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.055 "hdgst": ${hdgst:-false}, 00:32:00.055 "ddgst": ${ddgst:-false} 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 } 00:32:00.055 EOF 00:32:00.055 )") 00:32:00.055 14:05:40 -- nvmf/common.sh@542 -- # cat 00:32:00.055 14:05:40 -- nvmf/common.sh@544 -- # jq . 00:32:00.055 14:05:40 -- nvmf/common.sh@545 -- # IFS=, 00:32:00.055 14:05:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme0", 00:32:00.055 "trtype": "tcp", 00:32:00.055 "traddr": "10.0.0.2", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "4420", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:00.055 "hdgst": false, 00:32:00.055 "ddgst": false 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 },{ 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme1", 00:32:00.055 "trtype": "tcp", 00:32:00.055 "traddr": "10.0.0.2", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "4420", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:00.055 "hdgst": false, 00:32:00.055 "ddgst": false 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 },{ 00:32:00.055 "params": { 00:32:00.055 "name": "Nvme2", 00:32:00.055 "trtype": "tcp", 00:32:00.055 "traddr": "10.0.0.2", 00:32:00.055 "adrfam": "ipv4", 00:32:00.055 "trsvcid": "4420", 00:32:00.055 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:00.055 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:00.055 "hdgst": false, 00:32:00.055 "ddgst": false 00:32:00.055 }, 00:32:00.055 "method": "bdev_nvme_attach_controller" 00:32:00.055 }' 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.055 14:05:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.055 14:05:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:00.055 14:05:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.313 14:05:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.313 14:05:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.313 14:05:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:00.313 14:05:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.313 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.314 ... 00:32:00.314 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.314 ... 00:32:00.314 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.314 ... 00:32:00.314 fio-3.35 00:32:00.314 Starting 24 threads 00:32:00.571 EAL: No free 2048 kB hugepages reported on node 1 00:32:01.509 [2024-11-29 14:05:41.487352] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:01.509 [2024-11-29 14:05:41.487442] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.488 00:32:11.488 filename0: (groupid=0, jobs=1): err= 0: pid=2446547: Fri Nov 29 14:05:51 2024 00:32:11.488 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10056msec) 00:32:11.488 slat (nsec): min=4968, max=46831, avg=25593.73, stdev=8985.34 00:32:11.488 clat (msec): min=143, max=388, avg=334.95, stdev=58.30 00:32:11.488 lat (msec): min=143, max=388, avg=334.98, stdev=58.30 00:32:11.488 clat percentiles (msec): 00:32:11.488 | 1.00th=[ 144], 5.00th=[ 211], 10.00th=[ 220], 20.00th=[ 326], 00:32:11.488 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.488 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 384], 00:32:11.488 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.488 | 99.99th=[ 388] 00:32:11.488 bw ( KiB/s): min= 128, max= 256, per=3.86%, avg=185.60, stdev=65.33, samples=20 00:32:11.488 iops : min= 32, max= 64, avg=46.40, stdev=16.33, samples=20 00:32:11.488 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.488 cpu : usr=98.85%, sys=0.78%, ctx=13, majf=0, minf=34 00:32:11.488 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.488 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.488 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.488 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.488 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.488 filename0: (groupid=0, jobs=1): err= 0: pid=2446549: Fri Nov 29 14:05:51 2024 00:32:11.488 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10033msec) 00:32:11.488 slat (usec): min=5, max=134, avg=45.51, stdev=28.76 00:32:11.488 clat (msec): min=221, max=466, avg=345.60, stdev=48.36 00:32:11.488 lat (msec): min=221, max=466, avg=345.64, stdev=48.36 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 222], 5.00th=[ 239], 10.00th=[ 251], 20.00th=[ 330], 00:32:11.489 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.489 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 414], 00:32:11.489 | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 468], 99.95th=[ 468], 00:32:11.489 | 99.99th=[ 468] 00:32:11.489 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=61.33, samples=20 00:32:11.489 iops : min= 32, max= 64, avg=44.80, stdev=15.33, samples=20 00:32:11.489 lat (msec) : 250=7.33%, 500=92.67% 00:32:11.489 cpu : usr=98.76%, sys=0.80%, ctx=29, majf=0, minf=36 00:32:11.489 IO depths : 1=3.4%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446550: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=71, BW=286KiB/s (293kB/s)(2884KiB/10069msec) 00:32:11.489 slat (nsec): min=5410, max=92922, avg=19249.78, stdev=21566.84 00:32:11.489 clat (msec): min=24, max=369, avg=222.92, stdev=61.11 00:32:11.489 lat (msec): min=24, max=369, avg=222.94, stdev=61.10 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 45], 5.00th=[ 83], 10.00th=[ 144], 20.00th=[ 205], 00:32:11.489 | 30.00th=[ 213], 40.00th=[ 215], 50.00th=[ 226], 60.00th=[ 230], 00:32:11.489 | 70.00th=[ 247], 80.00th=[ 275], 90.00th=[ 288], 95.00th=[ 309], 00:32:11.489 | 99.00th=[ 368], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], 00:32:11.489 | 99.99th=[ 372] 00:32:11.489 bw ( KiB/s): min= 176, max= 488, per=5.89%, avg=282.00, stdev=73.18, samples=20 00:32:11.489 iops : min= 44, max= 122, avg=70.50, stdev=18.29, samples=20 00:32:11.489 lat (msec) : 50=2.22%, 100=5.27%, 250=63.11%, 500=29.40% 00:32:11.489 cpu : usr=98.38%, sys=1.06%, ctx=29, majf=0, minf=50 00:32:11.489 IO depths : 1=0.1%, 2=0.3%, 4=6.1%, 8=80.9%, 16=12.6%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=88.7%, 8=6.2%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=721,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446551: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=57, BW=230KiB/s (235kB/s)(2312KiB/10065msec) 00:32:11.489 slat (usec): min=6, max=136, avg=42.90, stdev=39.12 00:32:11.489 clat (msec): min=102, max=449, avg=277.63, stdev=66.45 00:32:11.489 lat (msec): min=102, max=449, avg=277.67, stdev=66.48 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 103], 5.00th=[ 199], 10.00th=[ 211], 20.00th=[ 224], 00:32:11.489 | 30.00th=[ 234], 40.00th=[ 249], 50.00th=[ 271], 60.00th=[ 284], 00:32:11.489 | 70.00th=[ 342], 80.00th=[ 351], 90.00th=[ 359], 95.00th=[ 372], 00:32:11.489 | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 451], 99.95th=[ 451], 00:32:11.489 | 99.99th=[ 451] 00:32:11.489 bw ( KiB/s): min= 128, max= 336, per=4.68%, avg=224.80, stdev=65.96, samples=20 00:32:11.489 iops : min= 32, max= 84, avg=56.20, stdev=16.49, samples=20 00:32:11.489 lat (msec) : 250=41.18%, 500=58.82% 00:32:11.489 cpu : usr=98.64%, sys=0.92%, ctx=9, majf=0, minf=29 00:32:11.489 IO depths : 1=1.9%, 2=5.2%, 4=15.9%, 8=66.3%, 16=10.7%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=91.4%, 8=3.1%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=578,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446552: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=47, BW=190KiB/s (195kB/s)(1912KiB/10052msec) 00:32:11.489 slat (usec): min=13, max=137, avg=94.77, stdev=22.91 00:32:11.489 clat (msec): min=100, max=474, avg=335.66, stdev=63.17 00:32:11.489 lat (msec): min=100, max=474, avg=335.76, stdev=63.18 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 102], 5.00th=[ 230], 10.00th=[ 247], 20.00th=[ 300], 00:32:11.489 | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 359], 00:32:11.489 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 384], 00:32:11.489 | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 477], 99.95th=[ 477], 00:32:11.489 | 99.99th=[ 477] 00:32:11.489 bw ( KiB/s): min= 128, max= 256, per=3.84%, avg=184.80, stdev=61.53, samples=20 00:32:11.489 iops : min= 32, max= 64, avg=46.20, stdev=15.38, samples=20 00:32:11.489 lat (msec) : 250=12.55%, 500=87.45% 00:32:11.489 cpu : usr=98.66%, sys=0.83%, ctx=32, majf=0, minf=37 00:32:11.489 IO depths : 1=3.3%, 2=9.6%, 4=25.1%, 8=52.9%, 16=9.0%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446553: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10052msec) 00:32:11.489 slat (usec): min=19, max=134, avg=95.16, stdev=21.60 00:32:11.489 clat (msec): min=100, max=385, avg=334.19, stdev=58.98 00:32:11.489 lat (msec): min=100, max=385, avg=334.29, stdev=58.99 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 102], 5.00th=[ 230], 10.00th=[ 234], 20.00th=[ 300], 00:32:11.489 | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.489 | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 384], 00:32:11.489 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:32:11.489 | 99.99th=[ 384] 00:32:11.489 bw ( KiB/s): min= 128, max= 256, per=3.86%, avg=185.60, stdev=65.33, samples=20 00:32:11.489 iops : min= 32, max= 64, avg=46.40, stdev=16.33, samples=20 00:32:11.489 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.489 cpu : usr=98.65%, sys=0.77%, ctx=14, majf=0, minf=30 00:32:11.489 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446554: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10035msec) 00:32:11.489 slat (nsec): min=9489, max=89798, avg=33409.77, stdev=8539.68 00:32:11.489 clat (msec): min=165, max=467, avg=345.60, stdev=49.86 00:32:11.489 lat (msec): min=165, max=467, avg=345.63, stdev=49.86 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 251], 20.00th=[ 330], 00:32:11.489 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.489 | 70.00th=[ 368], 80.00th=[ 376], 90.00th=[ 384], 95.00th=[ 435], 00:32:11.489 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 468], 99.95th=[ 468], 00:32:11.489 | 99.99th=[ 468] 00:32:11.489 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=62.85, samples=20 00:32:11.489 iops : min= 32, max= 64, avg=44.80, stdev=15.71, samples=20 00:32:11.489 lat (msec) : 250=7.33%, 500=92.67% 00:32:11.489 cpu : usr=98.72%, sys=0.85%, ctx=24, majf=0, minf=28 00:32:11.489 IO depths : 1=3.4%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename0: (groupid=0, jobs=1): err= 0: pid=2446555: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=47, BW=190KiB/s (195kB/s)(1912KiB/10039msec) 00:32:11.489 slat (usec): min=14, max=135, avg=89.13, stdev=24.93 00:32:11.489 clat (msec): min=101, max=388, avg=335.32, stdev=57.17 00:32:11.489 lat (msec): min=101, max=388, avg=335.41, stdev=57.17 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 103], 5.00th=[ 230], 10.00th=[ 247], 20.00th=[ 334], 00:32:11.489 | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 359], 00:32:11.489 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.489 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.489 | 99.99th=[ 388] 00:32:11.489 bw ( KiB/s): min= 128, max= 368, per=3.84%, avg=184.80, stdev=68.76, samples=20 00:32:11.489 iops : min= 32, max= 92, avg=46.20, stdev=17.19, samples=20 00:32:11.489 lat (msec) : 250=12.13%, 500=87.87% 00:32:11.489 cpu : usr=98.42%, sys=1.01%, ctx=8, majf=0, minf=30 00:32:11.489 IO depths : 1=0.6%, 2=6.9%, 4=25.1%, 8=55.6%, 16=11.7%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.489 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.489 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.489 filename1: (groupid=0, jobs=1): err= 0: pid=2446556: Fri Nov 29 14:05:51 2024 00:32:11.489 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10033msec) 00:32:11.489 slat (nsec): min=8749, max=79270, avg=34255.42, stdev=10609.38 00:32:11.489 clat (msec): min=143, max=467, avg=345.53, stdev=51.11 00:32:11.489 lat (msec): min=143, max=467, avg=345.57, stdev=51.11 00:32:11.489 clat percentiles (msec): 00:32:11.489 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 251], 20.00th=[ 326], 00:32:11.489 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.489 | 70.00th=[ 368], 80.00th=[ 376], 90.00th=[ 384], 95.00th=[ 435], 00:32:11.489 | 99.00th=[ 460], 99.50th=[ 464], 99.90th=[ 468], 99.95th=[ 468], 00:32:11.489 | 99.99th=[ 468] 00:32:11.489 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=62.85, samples=20 00:32:11.489 iops : min= 32, max= 64, avg=44.80, stdev=15.71, samples=20 00:32:11.489 lat (msec) : 250=7.97%, 500=92.03% 00:32:11.489 cpu : usr=98.45%, sys=1.01%, ctx=29, majf=0, minf=40 00:32:11.489 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:32:11.489 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446557: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10035msec) 00:32:11.490 slat (nsec): min=5676, max=58998, avg=30973.17, stdev=8924.14 00:32:11.490 clat (msec): min=222, max=437, avg=345.61, stdev=40.58 00:32:11.490 lat (msec): min=222, max=437, avg=345.64, stdev=40.58 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 251], 20.00th=[ 334], 00:32:11.490 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.490 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 439], 99.95th=[ 439], 00:32:11.490 | 99.99th=[ 439] 00:32:11.490 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=58.18, samples=20 00:32:11.490 iops : min= 32, max= 64, avg=44.80, stdev=14.54, samples=20 00:32:11.490 lat (msec) : 250=6.90%, 500=93.10% 00:32:11.490 cpu : usr=98.31%, sys=1.07%, ctx=23, majf=0, minf=38 00:32:11.490 IO depths : 1=1.7%, 2=8.0%, 4=25.0%, 8=54.5%, 16=10.8%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446559: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10046msec) 00:32:11.490 slat (usec): min=5, max=141, avg=41.31, stdev=35.26 00:32:11.490 clat (msec): min=161, max=574, avg=334.51, stdev=62.62 00:32:11.490 lat (msec): min=161, max=575, avg=334.56, stdev=62.62 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 163], 5.00th=[ 188], 10.00th=[ 234], 20.00th=[ 300], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 384], 00:32:11.490 | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 575], 99.95th=[ 575], 00:32:11.490 | 99.99th=[ 575] 00:32:11.490 bw ( KiB/s): min= 112, max= 256, per=3.86%, avg=185.60, stdev=61.07, samples=20 00:32:11.490 iops : min= 28, max= 64, avg=46.40, stdev=15.27, samples=20 00:32:11.490 lat (msec) : 250=15.42%, 500=82.50%, 750=2.08% 00:32:11.490 cpu : usr=98.27%, sys=0.98%, ctx=25, majf=0, minf=42 00:32:11.490 IO depths : 1=2.9%, 2=9.2%, 4=25.0%, 8=53.3%, 16=9.6%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446560: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10045msec) 00:32:11.490 slat (nsec): min=8009, max=51077, avg=27514.94, stdev=10383.61 00:32:11.490 clat (msec): min=112, max=388, avg=334.57, stdev=56.89 00:32:11.490 lat (msec): min=112, max=388, avg=334.60, stdev=56.89 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 121], 5.00th=[ 222], 10.00th=[ 247], 20.00th=[ 330], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.490 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 384], 00:32:11.490 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.490 | 99.99th=[ 388] 00:32:11.490 bw ( KiB/s): min= 128, max= 272, per=3.86%, avg=185.60, stdev=65.54, samples=20 00:32:11.490 iops : min= 32, max= 68, avg=46.40, stdev=16.38, samples=20 00:32:11.490 lat (msec) : 250=10.00%, 500=90.00% 00:32:11.490 cpu : usr=98.94%, sys=0.69%, ctx=14, majf=0, minf=26 00:32:11.490 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446561: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10055msec) 00:32:11.490 slat (nsec): min=7519, max=53256, avg=27262.71, stdev=8535.67 00:32:11.490 clat (msec): min=130, max=466, avg=334.94, stdev=64.95 00:32:11.490 lat (msec): min=130, max=466, avg=334.97, stdev=64.95 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 131], 5.00th=[ 222], 10.00th=[ 224], 20.00th=[ 288], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 388], 00:32:11.490 | 99.00th=[ 464], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], 00:32:11.490 | 99.99th=[ 468] 00:32:11.490 bw ( KiB/s): min= 128, max= 256, per=3.86%, avg=185.60, stdev=60.85, samples=20 00:32:11.490 iops : min= 32, max= 64, avg=46.40, stdev=15.21, samples=20 00:32:11.490 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.490 cpu : usr=98.36%, sys=0.95%, ctx=25, majf=0, minf=32 00:32:11.490 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446562: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10051msec) 00:32:11.490 slat (usec): min=13, max=144, avg=92.01, stdev=25.12 00:32:11.490 clat (msec): min=143, max=572, avg=334.23, stdev=76.07 00:32:11.490 lat (msec): min=143, max=572, avg=334.33, stdev=76.09 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 163], 5.00th=[ 188], 10.00th=[ 220], 20.00th=[ 266], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 355], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 388], 00:32:11.490 | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 575], 99.95th=[ 575], 00:32:11.490 | 99.99th=[ 575] 00:32:11.490 bw ( KiB/s): min= 112, max= 256, per=3.86%, avg=185.60, stdev=59.51, samples=20 00:32:11.490 iops : min= 28, max= 64, avg=46.40, stdev=14.88, samples=20 00:32:11.490 lat (msec) : 250=17.92%, 500=77.92%, 750=4.17% 00:32:11.490 cpu : usr=98.26%, sys=1.00%, ctx=62, majf=0, minf=34 00:32:11.490 IO depths : 1=3.8%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.8%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446563: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=49, BW=197KiB/s (202kB/s)(1984KiB/10067msec) 00:32:11.490 slat (usec): min=7, max=154, avg=84.08, stdev=25.74 00:32:11.490 clat (msec): min=43, max=436, avg=323.94, stdev=80.77 00:32:11.490 lat (msec): min=43, max=436, avg=324.02, stdev=80.79 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 44], 5.00th=[ 94], 10.00th=[ 222], 20.00th=[ 326], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 384], 00:32:11.490 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 435], 99.95th=[ 435], 00:32:11.490 | 99.99th=[ 435] 00:32:11.490 bw ( KiB/s): min= 128, max= 384, per=3.99%, avg=192.00, stdev=72.68, samples=20 00:32:11.490 iops : min= 32, max= 96, avg=48.00, stdev=18.17, samples=20 00:32:11.490 lat (msec) : 50=3.23%, 100=2.82%, 250=11.29%, 500=82.66% 00:32:11.490 cpu : usr=98.33%, sys=1.09%, ctx=28, majf=0, minf=35 00:32:11.490 IO depths : 1=1.6%, 2=7.9%, 4=25.0%, 8=54.6%, 16=10.9%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename1: (groupid=0, jobs=1): err= 0: pid=2446564: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10035msec) 00:32:11.490 slat (usec): min=9, max=108, avg=33.43, stdev=10.11 00:32:11.490 clat (msec): min=222, max=389, avg=345.59, stdev=39.14 00:32:11.490 lat (msec): min=222, max=389, avg=345.63, stdev=39.14 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 300], 20.00th=[ 334], 00:32:11.490 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.490 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.490 | 99.99th=[ 388] 00:32:11.490 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=58.18, samples=20 00:32:11.490 iops : min= 32, max= 64, avg=44.80, stdev=14.54, samples=20 00:32:11.490 lat (msec) : 250=6.47%, 500=93.53% 00:32:11.490 cpu : usr=98.59%, sys=0.83%, ctx=34, majf=0, minf=33 00:32:11.490 IO depths : 1=0.4%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.1%, 32=0.0%, >=64=0.0% 00:32:11.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.490 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.490 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.490 filename2: (groupid=0, jobs=1): err= 0: pid=2446565: Fri Nov 29 14:05:51 2024 00:32:11.490 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10051msec) 00:32:11.490 slat (usec): min=10, max=137, avg=93.00, stdev=22.93 00:32:11.490 clat (msec): min=102, max=574, avg=334.27, stdev=79.81 00:32:11.490 lat (msec): min=102, max=574, avg=334.36, stdev=79.82 00:32:11.490 clat percentiles (msec): 00:32:11.490 | 1.00th=[ 126], 5.00th=[ 184], 10.00th=[ 220], 20.00th=[ 264], 00:32:11.490 | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 347], 60.00th=[ 355], 00:32:11.490 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 422], 00:32:11.490 | 99.00th=[ 567], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], 00:32:11.490 | 99.99th=[ 575] 00:32:11.490 bw ( KiB/s): min= 112, max= 256, per=3.86%, avg=185.60, stdev=61.29, samples=20 00:32:11.491 iops : min= 28, max= 64, avg=46.40, stdev=15.32, samples=20 00:32:11.491 lat (msec) : 250=17.92%, 500=77.08%, 750=5.00% 00:32:11.491 cpu : usr=98.17%, sys=1.05%, ctx=30, majf=0, minf=28 00:32:11.491 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446566: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=66, BW=266KiB/s (272kB/s)(2672KiB/10063msec) 00:32:11.491 slat (nsec): min=3867, max=71492, avg=14780.93, stdev=11861.17 00:32:11.491 clat (msec): min=130, max=371, avg=240.50, stdev=44.01 00:32:11.491 lat (msec): min=130, max=371, avg=240.51, stdev=44.01 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 133], 5.00th=[ 163], 10.00th=[ 188], 20.00th=[ 215], 00:32:11.491 | 30.00th=[ 222], 40.00th=[ 232], 50.00th=[ 239], 60.00th=[ 251], 00:32:11.491 | 70.00th=[ 268], 80.00th=[ 275], 90.00th=[ 284], 95.00th=[ 321], 00:32:11.491 | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], 00:32:11.491 | 99.99th=[ 372] 00:32:11.491 bw ( KiB/s): min= 176, max= 336, per=5.43%, avg=260.80, stdev=33.68, samples=20 00:32:11.491 iops : min= 44, max= 84, avg=65.20, stdev= 8.42, samples=20 00:32:11.491 lat (msec) : 250=59.43%, 500=40.57% 00:32:11.491 cpu : usr=98.95%, sys=0.67%, ctx=9, majf=0, minf=35 00:32:11.491 IO depths : 1=0.7%, 2=3.1%, 4=13.3%, 8=71.0%, 16=11.8%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=90.8%, 8=3.7%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=668,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446567: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10030msec) 00:32:11.491 slat (nsec): min=8305, max=63065, avg=31198.16, stdev=7668.48 00:32:11.491 clat (msec): min=222, max=388, avg=345.54, stdev=40.02 00:32:11.491 lat (msec): min=222, max=388, avg=345.57, stdev=40.02 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 251], 20.00th=[ 334], 00:32:11.491 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.491 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.491 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.491 | 99.99th=[ 388] 00:32:11.491 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=64.34, samples=20 00:32:11.491 iops : min= 32, max= 64, avg=44.80, stdev=16.08, samples=20 00:32:11.491 lat (msec) : 250=6.90%, 500=93.10% 00:32:11.491 cpu : usr=98.89%, sys=0.68%, ctx=16, majf=0, minf=32 00:32:11.491 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446569: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10039msec) 00:32:11.491 slat (nsec): min=5324, max=91516, avg=18250.01, stdev=14452.60 00:32:11.491 clat (msec): min=102, max=470, avg=334.46, stdev=62.11 00:32:11.491 lat (msec): min=102, max=470, avg=334.48, stdev=62.10 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 104], 5.00th=[ 230], 10.00th=[ 234], 20.00th=[ 300], 00:32:11.491 | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.491 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.491 | 99.00th=[ 447], 99.50th=[ 456], 99.90th=[ 472], 99.95th=[ 472], 00:32:11.491 | 99.99th=[ 472] 00:32:11.491 bw ( KiB/s): min= 128, max= 384, per=3.86%, avg=185.60, stdev=76.19, samples=20 00:32:11.491 iops : min= 32, max= 96, avg=46.40, stdev=19.05, samples=20 00:32:11.491 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.491 cpu : usr=98.95%, sys=0.65%, ctx=15, majf=0, minf=35 00:32:11.491 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446570: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10050msec) 00:32:11.491 slat (usec): min=8, max=106, avg=35.26, stdev=18.36 00:32:11.491 clat (msec): min=181, max=480, avg=334.54, stdev=57.60 00:32:11.491 lat (msec): min=181, max=481, avg=334.58, stdev=57.59 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 182], 5.00th=[ 230], 10.00th=[ 234], 20.00th=[ 288], 00:32:11.491 | 30.00th=[ 334], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.491 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 388], 00:32:11.491 | 99.00th=[ 460], 99.50th=[ 468], 99.90th=[ 481], 99.95th=[ 481], 00:32:11.491 | 99.99th=[ 481] 00:32:11.491 bw ( KiB/s): min= 128, max= 368, per=3.86%, avg=185.60, stdev=72.19, samples=20 00:32:11.491 iops : min= 32, max= 92, avg=46.40, stdev=18.05, samples=20 00:32:11.491 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.491 cpu : usr=98.53%, sys=0.90%, ctx=43, majf=0, minf=37 00:32:11.491 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446571: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10037msec) 00:32:11.491 slat (nsec): min=3786, max=67702, avg=31441.46, stdev=9833.49 00:32:11.491 clat (msec): min=222, max=388, avg=345.81, stdev=39.90 00:32:11.491 lat (msec): min=222, max=388, avg=345.84, stdev=39.90 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 222], 5.00th=[ 241], 10.00th=[ 251], 20.00th=[ 334], 00:32:11.491 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:11.491 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 384], 00:32:11.491 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.491 | 99.99th=[ 388] 00:32:11.491 bw ( KiB/s): min= 128, max= 256, per=3.74%, avg=179.20, stdev=64.34, samples=20 00:32:11.491 iops : min= 32, max= 64, avg=44.80, stdev=16.08, samples=20 00:32:11.491 lat (msec) : 250=6.90%, 500=93.10% 00:32:11.491 cpu : usr=98.63%, sys=0.83%, ctx=50, majf=0, minf=47 00:32:11.491 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446572: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10045msec) 00:32:11.491 slat (usec): min=8, max=104, avg=19.57, stdev= 9.78 00:32:11.491 clat (msec): min=187, max=389, avg=334.64, stdev=49.11 00:32:11.491 lat (msec): min=187, max=389, avg=334.66, stdev=49.11 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 188], 5.00th=[ 230], 10.00th=[ 234], 20.00th=[ 300], 00:32:11.491 | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 355], 00:32:11.491 | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 380], 00:32:11.491 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:11.491 | 99.99th=[ 388] 00:32:11.491 bw ( KiB/s): min= 128, max= 256, per=3.86%, avg=185.60, stdev=65.33, samples=20 00:32:11.491 iops : min= 32, max= 64, avg=46.40, stdev=16.33, samples=20 00:32:11.491 lat (msec) : 250=13.33%, 500=86.67% 00:32:11.491 cpu : usr=98.58%, sys=0.78%, ctx=32, majf=0, minf=39 00:32:11.491 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 filename2: (groupid=0, jobs=1): err= 0: pid=2446573: Fri Nov 29 14:05:51 2024 00:32:11.491 read: IOPS=58, BW=234KiB/s (239kB/s)(2352KiB/10067msec) 00:32:11.491 slat (usec): min=7, max=154, avg=51.15, stdev=43.96 00:32:11.491 clat (msec): min=43, max=459, avg=272.85, stdev=81.40 00:32:11.491 lat (msec): min=43, max=460, avg=272.90, stdev=81.43 00:32:11.491 clat percentiles (msec): 00:32:11.491 | 1.00th=[ 44], 5.00th=[ 94], 10.00th=[ 163], 20.00th=[ 222], 00:32:11.491 | 30.00th=[ 241], 40.00th=[ 253], 50.00th=[ 279], 60.00th=[ 292], 00:32:11.491 | 70.00th=[ 347], 80.00th=[ 351], 90.00th=[ 355], 95.00th=[ 368], 00:32:11.491 | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 460], 99.95th=[ 460], 00:32:11.491 | 99.99th=[ 460] 00:32:11.491 bw ( KiB/s): min= 128, max= 384, per=4.76%, avg=228.80, stdev=68.30, samples=20 00:32:11.491 iops : min= 32, max= 96, avg=57.20, stdev=17.07, samples=20 00:32:11.491 lat (msec) : 50=2.72%, 100=2.38%, 250=29.08%, 500=65.82% 00:32:11.491 cpu : usr=98.10%, sys=1.10%, ctx=91, majf=0, minf=38 00:32:11.491 IO depths : 1=1.9%, 2=6.8%, 4=20.9%, 8=59.7%, 16=10.7%, 32=0.0%, >=64=0.0% 00:32:11.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 complete : 0=0.0%, 4=92.9%, 8=1.5%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.491 issued rwts: total=588,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.491 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.491 00:32:11.491 Run status group 0 (all jobs): 00:32:11.491 READ: bw=4789KiB/s (4904kB/s), 185KiB/s-286KiB/s (189kB/s-293kB/s), io=47.1MiB (49.4MB), run=10030-10069msec 00:32:11.750 14:05:51 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:11.750 14:05:51 -- target/dif.sh@43 -- # local sub 00:32:11.750 14:05:51 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.750 14:05:51 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.750 14:05:51 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.750 14:05:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.750 14:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:51 -- common/autotest_common.sh@10 -- # set +x 00:32:11.750 14:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.750 14:05:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:11.750 14:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:51 -- common/autotest_common.sh@10 -- # set +x 00:32:11.750 14:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.750 14:05:51 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.750 14:05:51 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:11.750 14:05:51 -- target/dif.sh@36 -- # local sub_id=1 00:32:11.750 14:05:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:11.750 14:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:51 -- common/autotest_common.sh@10 -- # set +x 00:32:11.750 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.750 14:05:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:11.750 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:11.750 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.750 14:05:52 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.750 14:05:52 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:11.750 14:05:52 -- target/dif.sh@36 -- # local sub_id=2 00:32:11.750 14:05:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:11.750 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:11.750 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.750 14:05:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:11.750 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.750 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # numjobs=2 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # iodepth=8 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # runtime=5 00:32:12.007 14:05:52 -- target/dif.sh@115 -- # files=1 00:32:12.007 14:05:52 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:12.007 14:05:52 -- target/dif.sh@28 -- # local sub 00:32:12.007 14:05:52 -- target/dif.sh@30 -- # for sub in "$@" 00:32:12.007 14:05:52 -- target/dif.sh@31 -- # create_subsystem 0 00:32:12.007 14:05:52 -- target/dif.sh@18 -- # local sub_id=0 00:32:12.007 14:05:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 bdev_null0 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 [2024-11-29 14:05:52.059252] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@30 -- # for sub in "$@" 00:32:12.007 14:05:52 -- target/dif.sh@31 -- # create_subsystem 1 00:32:12.007 14:05:52 -- target/dif.sh@18 -- # local sub_id=1 00:32:12.007 14:05:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 bdev_null1 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.007 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.007 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.007 14:05:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:12.007 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.008 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.008 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.008 14:05:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:12.008 14:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.008 14:05:52 -- common/autotest_common.sh@10 -- # set +x 00:32:12.008 14:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.008 14:05:52 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:12.008 14:05:52 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:12.008 14:05:52 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:12.008 14:05:52 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.008 14:05:52 -- target/dif.sh@82 -- # gen_fio_conf 00:32:12.008 14:05:52 -- nvmf/common.sh@520 -- # config=() 00:32:12.008 14:05:52 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.008 14:05:52 -- nvmf/common.sh@520 -- # local subsystem config 00:32:12.008 14:05:52 -- target/dif.sh@54 -- # local file 00:32:12.008 14:05:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:12.008 14:05:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:12.008 14:05:52 -- target/dif.sh@56 -- # cat 00:32:12.008 14:05:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:12.008 14:05:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:12.008 { 00:32:12.008 "params": { 00:32:12.008 "name": "Nvme$subsystem", 00:32:12.008 "trtype": "$TEST_TRANSPORT", 00:32:12.008 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:12.008 "adrfam": "ipv4", 00:32:12.008 "trsvcid": "$NVMF_PORT", 00:32:12.008 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:12.008 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:12.008 "hdgst": ${hdgst:-false}, 00:32:12.008 "ddgst": ${ddgst:-false} 00:32:12.008 }, 00:32:12.008 "method": "bdev_nvme_attach_controller" 00:32:12.008 } 00:32:12.008 EOF 00:32:12.008 )") 00:32:12.008 14:05:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:12.008 14:05:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.008 14:05:52 -- common/autotest_common.sh@1330 -- # shift 00:32:12.008 14:05:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:12.008 14:05:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:12.008 14:05:52 -- nvmf/common.sh@542 -- # cat 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.008 14:05:52 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:12.008 14:05:52 -- target/dif.sh@72 -- # (( file <= files )) 00:32:12.008 14:05:52 -- target/dif.sh@73 -- # cat 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:12.008 14:05:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:12.008 14:05:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:12.008 { 00:32:12.008 "params": { 00:32:12.008 "name": "Nvme$subsystem", 00:32:12.008 "trtype": "$TEST_TRANSPORT", 00:32:12.008 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:12.008 "adrfam": "ipv4", 00:32:12.008 "trsvcid": "$NVMF_PORT", 00:32:12.008 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:12.008 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:12.008 "hdgst": ${hdgst:-false}, 00:32:12.008 "ddgst": ${ddgst:-false} 00:32:12.008 }, 00:32:12.008 "method": "bdev_nvme_attach_controller" 00:32:12.008 } 00:32:12.008 EOF 00:32:12.008 )") 00:32:12.008 14:05:52 -- target/dif.sh@72 -- # (( file++ )) 00:32:12.008 14:05:52 -- target/dif.sh@72 -- # (( file <= files )) 00:32:12.008 14:05:52 -- nvmf/common.sh@542 -- # cat 00:32:12.008 14:05:52 -- nvmf/common.sh@544 -- # jq . 00:32:12.008 14:05:52 -- nvmf/common.sh@545 -- # IFS=, 00:32:12.008 14:05:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:12.008 "params": { 00:32:12.008 "name": "Nvme0", 00:32:12.008 "trtype": "tcp", 00:32:12.008 "traddr": "10.0.0.2", 00:32:12.008 "adrfam": "ipv4", 00:32:12.008 "trsvcid": "4420", 00:32:12.008 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:12.008 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:12.008 "hdgst": false, 00:32:12.008 "ddgst": false 00:32:12.008 }, 00:32:12.008 "method": "bdev_nvme_attach_controller" 00:32:12.008 },{ 00:32:12.008 "params": { 00:32:12.008 "name": "Nvme1", 00:32:12.008 "trtype": "tcp", 00:32:12.008 "traddr": "10.0.0.2", 00:32:12.008 "adrfam": "ipv4", 00:32:12.008 "trsvcid": "4420", 00:32:12.008 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:12.008 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:12.008 "hdgst": false, 00:32:12.008 "ddgst": false 00:32:12.008 }, 00:32:12.008 "method": "bdev_nvme_attach_controller" 00:32:12.008 }' 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:12.008 14:05:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:12.008 14:05:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:12.008 14:05:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:12.008 14:05:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:12.008 14:05:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:12.008 14:05:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.265 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:12.265 ... 00:32:12.265 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:12.265 ... 00:32:12.265 fio-3.35 00:32:12.265 Starting 4 threads 00:32:12.265 EAL: No free 2048 kB hugepages reported on node 1 00:32:13.195 [2024-11-29 14:05:53.113842] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:13.195 [2024-11-29 14:05:53.113893] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:18.453 00:32:18.453 filename0: (groupid=0, jobs=1): err= 0: pid=2448085: Fri Nov 29 14:05:58 2024 00:32:18.453 read: IOPS=1917, BW=15.0MiB/s (15.7MB/s)(74.9MiB/5002msec) 00:32:18.453 slat (nsec): min=3915, max=65626, avg=15763.75, stdev=8713.33 00:32:18.453 clat (usec): min=677, max=7787, avg=4115.15, stdev=602.06 00:32:18.453 lat (usec): min=690, max=7799, avg=4130.91, stdev=601.56 00:32:18.453 clat percentiles (usec): 00:32:18.453 | 1.00th=[ 2343], 5.00th=[ 3392], 10.00th=[ 3687], 20.00th=[ 3884], 00:32:18.453 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4113], 00:32:18.453 | 70.00th=[ 4228], 80.00th=[ 4293], 90.00th=[ 4621], 95.00th=[ 5145], 00:32:18.453 | 99.00th=[ 6390], 99.50th=[ 6718], 99.90th=[ 7373], 99.95th=[ 7439], 00:32:18.453 | 99.99th=[ 7767] 00:32:18.453 bw ( KiB/s): min=14592, max=15712, per=24.67%, avg=15299.78, stdev=391.12, samples=9 00:32:18.453 iops : min= 1824, max= 1964, avg=1912.44, stdev=48.92, samples=9 00:32:18.453 lat (usec) : 750=0.02%, 1000=0.14% 00:32:18.453 lat (msec) : 2=0.59%, 4=39.23%, 10=60.01% 00:32:18.453 cpu : usr=93.72%, sys=5.60%, ctx=18, majf=0, minf=151 00:32:18.453 IO depths : 1=0.1%, 2=14.0%, 4=58.0%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.453 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.453 issued rwts: total=9591,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.453 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.453 filename0: (groupid=0, jobs=1): err= 0: pid=2448086: Fri Nov 29 14:05:58 2024 00:32:18.453 read: IOPS=1956, BW=15.3MiB/s (16.0MB/s)(76.4MiB/5002msec) 00:32:18.453 slat (usec): min=6, max=129, avg=17.12, stdev= 8.11 00:32:18.453 clat (usec): min=861, max=8345, avg=4030.75, stdev=557.87 00:32:18.453 lat (usec): min=875, max=8365, avg=4047.87, stdev=557.89 00:32:18.453 clat percentiles (usec): 00:32:18.453 | 1.00th=[ 2474], 5.00th=[ 3195], 10.00th=[ 3523], 20.00th=[ 3818], 00:32:18.453 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4080], 00:32:18.453 | 70.00th=[ 4178], 80.00th=[ 4228], 90.00th=[ 4424], 95.00th=[ 4817], 00:32:18.453 | 99.00th=[ 6128], 99.50th=[ 6718], 99.90th=[ 7570], 99.95th=[ 8029], 00:32:18.453 | 99.99th=[ 8356] 00:32:18.453 bw ( KiB/s): min=14528, max=16176, per=25.23%, avg=15649.78, stdev=494.41, samples=9 00:32:18.453 iops : min= 1816, max= 2022, avg=1956.22, stdev=61.80, samples=9 00:32:18.453 lat (usec) : 1000=0.05% 00:32:18.453 lat (msec) : 2=0.50%, 4=44.98%, 10=54.47% 00:32:18.453 cpu : usr=93.92%, sys=5.24%, ctx=16, majf=0, minf=100 00:32:18.454 IO depths : 1=0.1%, 2=12.7%, 4=59.7%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 issued rwts: total=9784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.454 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.454 filename1: (groupid=0, jobs=1): err= 0: pid=2448087: Fri Nov 29 14:05:58 2024 00:32:18.454 read: IOPS=1948, BW=15.2MiB/s (16.0MB/s)(76.1MiB/5003msec) 00:32:18.454 slat (nsec): min=6347, max=68376, avg=14699.14, stdev=7830.95 00:32:18.454 clat (usec): min=663, max=7385, avg=4056.26, stdev=560.66 00:32:18.454 lat (usec): min=675, max=7393, avg=4070.96, stdev=560.51 00:32:18.454 clat percentiles (usec): 00:32:18.454 | 1.00th=[ 2474], 5.00th=[ 3228], 10.00th=[ 3523], 20.00th=[ 3851], 00:32:18.454 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:32:18.454 | 70.00th=[ 4178], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 4948], 00:32:18.454 | 99.00th=[ 6259], 99.50th=[ 6587], 99.90th=[ 7177], 99.95th=[ 7242], 00:32:18.454 | 99.99th=[ 7373] 00:32:18.454 bw ( KiB/s): min=15086, max=15888, per=25.14%, avg=15591.80, stdev=232.62, samples=10 00:32:18.454 iops : min= 1885, max= 1986, avg=1948.90, stdev=29.26, samples=10 00:32:18.454 lat (usec) : 750=0.01%, 1000=0.11% 00:32:18.454 lat (msec) : 2=0.30%, 4=41.22%, 10=58.36% 00:32:18.454 cpu : usr=93.42%, sys=6.00%, ctx=18, majf=0, minf=147 00:32:18.454 IO depths : 1=0.1%, 2=11.1%, 4=60.8%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 issued rwts: total=9747,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.454 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.454 filename1: (groupid=0, jobs=1): err= 0: pid=2448088: Fri Nov 29 14:05:58 2024 00:32:18.454 read: IOPS=1932, BW=15.1MiB/s (15.8MB/s)(75.5MiB/5001msec) 00:32:18.454 slat (nsec): min=6563, max=68049, avg=15972.69, stdev=8617.92 00:32:18.454 clat (usec): min=620, max=7497, avg=4082.78, stdev=583.98 00:32:18.454 lat (usec): min=633, max=7504, avg=4098.75, stdev=583.80 00:32:18.454 clat percentiles (usec): 00:32:18.454 | 1.00th=[ 2245], 5.00th=[ 3359], 10.00th=[ 3654], 20.00th=[ 3851], 00:32:18.454 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:32:18.454 | 70.00th=[ 4178], 80.00th=[ 4293], 90.00th=[ 4490], 95.00th=[ 5145], 00:32:18.454 | 99.00th=[ 6259], 99.50th=[ 6718], 99.90th=[ 7308], 99.95th=[ 7373], 00:32:18.454 | 99.99th=[ 7504] 00:32:18.454 bw ( KiB/s): min=14560, max=15920, per=24.88%, avg=15434.67, stdev=446.00, samples=9 00:32:18.454 iops : min= 1820, max= 1990, avg=1929.33, stdev=55.75, samples=9 00:32:18.454 lat (usec) : 750=0.02%, 1000=0.07% 00:32:18.454 lat (msec) : 2=0.48%, 4=41.68%, 10=57.75% 00:32:18.454 cpu : usr=93.42%, sys=5.84%, ctx=14, majf=0, minf=81 00:32:18.454 IO depths : 1=0.1%, 2=13.3%, 4=58.8%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.454 issued rwts: total=9666,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.454 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.454 00:32:18.454 Run status group 0 (all jobs): 00:32:18.454 READ: bw=60.6MiB/s (63.5MB/s), 15.0MiB/s-15.3MiB/s (15.7MB/s-16.0MB/s), io=303MiB (318MB), run=5001-5003msec 00:32:18.454 14:05:58 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:18.454 14:05:58 -- target/dif.sh@43 -- # local sub 00:32:18.454 14:05:58 -- target/dif.sh@45 -- # for sub in "$@" 00:32:18.454 14:05:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:18.454 14:05:58 -- target/dif.sh@36 -- # local sub_id=0 00:32:18.454 14:05:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@45 -- # for sub in "$@" 00:32:18.454 14:05:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:18.454 14:05:58 -- target/dif.sh@36 -- # local sub_id=1 00:32:18.454 14:05:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 00:32:18.454 real 0m24.514s 00:32:18.454 user 4m35.139s 00:32:18.454 sys 0m5.152s 00:32:18.454 14:05:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 ************************************ 00:32:18.454 END TEST fio_dif_rand_params 00:32:18.454 ************************************ 00:32:18.454 14:05:58 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:18.454 14:05:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:18.454 14:05:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 ************************************ 00:32:18.454 START TEST fio_dif_digest 00:32:18.454 ************************************ 00:32:18.454 14:05:58 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:18.454 14:05:58 -- target/dif.sh@123 -- # local NULL_DIF 00:32:18.454 14:05:58 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:18.454 14:05:58 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:18.454 14:05:58 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:18.454 14:05:58 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:18.454 14:05:58 -- target/dif.sh@127 -- # numjobs=3 00:32:18.454 14:05:58 -- target/dif.sh@127 -- # iodepth=3 00:32:18.454 14:05:58 -- target/dif.sh@127 -- # runtime=10 00:32:18.454 14:05:58 -- target/dif.sh@128 -- # hdgst=true 00:32:18.454 14:05:58 -- target/dif.sh@128 -- # ddgst=true 00:32:18.454 14:05:58 -- target/dif.sh@130 -- # create_subsystems 0 00:32:18.454 14:05:58 -- target/dif.sh@28 -- # local sub 00:32:18.454 14:05:58 -- target/dif.sh@30 -- # for sub in "$@" 00:32:18.454 14:05:58 -- target/dif.sh@31 -- # create_subsystem 0 00:32:18.454 14:05:58 -- target/dif.sh@18 -- # local sub_id=0 00:32:18.454 14:05:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 bdev_null0 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:18.454 14:05:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.454 14:05:58 -- common/autotest_common.sh@10 -- # set +x 00:32:18.454 [2024-11-29 14:05:58.618213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:18.454 14:05:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.454 14:05:58 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:18.454 14:05:58 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:18.454 14:05:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.454 14:05:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.454 14:05:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:18.454 14:05:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:18.454 14:05:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:18.454 14:05:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:18.454 14:05:58 -- nvmf/common.sh@520 -- # config=() 00:32:18.454 14:05:58 -- target/dif.sh@82 -- # gen_fio_conf 00:32:18.454 14:05:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.454 14:05:58 -- nvmf/common.sh@520 -- # local subsystem config 00:32:18.454 14:05:58 -- common/autotest_common.sh@1330 -- # shift 00:32:18.454 14:05:58 -- target/dif.sh@54 -- # local file 00:32:18.454 14:05:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:18.454 14:05:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:18.454 14:05:58 -- target/dif.sh@56 -- # cat 00:32:18.454 14:05:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:18.454 14:05:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:18.454 { 00:32:18.454 "params": { 00:32:18.454 "name": "Nvme$subsystem", 00:32:18.454 "trtype": "$TEST_TRANSPORT", 00:32:18.454 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:18.454 "adrfam": "ipv4", 00:32:18.454 "trsvcid": "$NVMF_PORT", 00:32:18.454 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:18.454 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:18.454 "hdgst": ${hdgst:-false}, 00:32:18.454 "ddgst": ${ddgst:-false} 00:32:18.454 }, 00:32:18.454 "method": "bdev_nvme_attach_controller" 00:32:18.454 } 00:32:18.454 EOF 00:32:18.454 )") 00:32:18.454 14:05:58 -- nvmf/common.sh@542 -- # cat 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:18.454 14:05:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:18.454 14:05:58 -- target/dif.sh@72 -- # (( file <= files )) 00:32:18.454 14:05:58 -- nvmf/common.sh@544 -- # jq . 00:32:18.454 14:05:58 -- nvmf/common.sh@545 -- # IFS=, 00:32:18.454 14:05:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:18.454 "params": { 00:32:18.454 "name": "Nvme0", 00:32:18.454 "trtype": "tcp", 00:32:18.454 "traddr": "10.0.0.2", 00:32:18.454 "adrfam": "ipv4", 00:32:18.454 "trsvcid": "4420", 00:32:18.454 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:18.454 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:18.454 "hdgst": true, 00:32:18.454 "ddgst": true 00:32:18.454 }, 00:32:18.454 "method": "bdev_nvme_attach_controller" 00:32:18.454 }' 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:18.454 14:05:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:18.454 14:05:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:18.454 14:05:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:18.454 14:05:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:18.454 14:05:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:18.454 14:05:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.713 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:18.713 ... 00:32:18.713 fio-3.35 00:32:18.713 Starting 3 threads 00:32:18.713 EAL: No free 2048 kB hugepages reported on node 1 00:32:19.278 [2024-11-29 14:05:59.374341] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:19.278 [2024-11-29 14:05:59.374424] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:31.498 00:32:31.498 filename0: (groupid=0, jobs=1): err= 0: pid=2448906: Fri Nov 29 14:06:09 2024 00:32:31.498 read: IOPS=206, BW=25.8MiB/s (27.0MB/s)(259MiB/10046msec) 00:32:31.498 slat (nsec): min=5165, max=36962, avg=13981.15, stdev=3395.19 00:32:31.498 clat (usec): min=10995, max=54279, avg=14520.56, stdev=1594.65 00:32:31.498 lat (usec): min=11008, max=54292, avg=14534.54, stdev=1594.68 00:32:31.498 clat percentiles (usec): 00:32:31.498 | 1.00th=[11863], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:32:31.498 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:31.498 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15795], 95.00th=[16319], 00:32:31.498 | 99.00th=[17171], 99.50th=[17433], 99.90th=[21365], 99.95th=[49546], 00:32:31.498 | 99.99th=[54264] 00:32:31.498 bw ( KiB/s): min=25344, max=28160, per=33.72%, avg=26470.40, stdev=832.23, samples=20 00:32:31.498 iops : min= 198, max= 220, avg=206.80, stdev= 6.50, samples=20 00:32:31.498 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:31.498 cpu : usr=91.41%, sys=8.09%, ctx=34, majf=0, minf=143 00:32:31.498 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:31.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.498 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.499 issued rwts: total=2070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.499 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:31.499 filename0: (groupid=0, jobs=1): err= 0: pid=2448907: Fri Nov 29 14:06:09 2024 00:32:31.499 read: IOPS=199, BW=25.0MiB/s (26.2MB/s)(251MiB/10047msec) 00:32:31.499 slat (nsec): min=5382, max=43853, avg=13777.23, stdev=3311.83 00:32:31.499 clat (usec): min=11485, max=48116, avg=14978.07, stdev=1546.20 00:32:31.499 lat (usec): min=11500, max=48129, avg=14991.85, stdev=1546.25 00:32:31.499 clat percentiles (usec): 00:32:31.499 | 1.00th=[12387], 5.00th=[13173], 10.00th=[13566], 20.00th=[13960], 00:32:31.499 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:32:31.499 | 70.00th=[15533], 80.00th=[15795], 90.00th=[16450], 95.00th=[16909], 00:32:31.499 | 99.00th=[17695], 99.50th=[18220], 99.90th=[23987], 99.95th=[46400], 00:32:31.499 | 99.99th=[47973] 00:32:31.499 bw ( KiB/s): min=24112, max=27392, per=32.70%, avg=25666.40, stdev=923.84, samples=20 00:32:31.499 iops : min= 188, max= 214, avg=200.50, stdev= 7.25, samples=20 00:32:31.499 lat (msec) : 20=99.75%, 50=0.25% 00:32:31.499 cpu : usr=91.38%, sys=8.12%, ctx=26, majf=0, minf=106 00:32:31.499 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:31.499 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.499 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.499 issued rwts: total=2007,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.499 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:31.499 filename0: (groupid=0, jobs=1): err= 0: pid=2448908: Fri Nov 29 14:06:09 2024 00:32:31.499 read: IOPS=208, BW=26.0MiB/s (27.3MB/s)(261MiB/10006msec) 00:32:31.499 slat (nsec): min=4441, max=84672, avg=13474.39, stdev=3537.21 00:32:31.499 clat (usec): min=9487, max=20900, avg=14387.02, stdev=1087.45 00:32:31.499 lat (usec): min=9499, max=20926, avg=14400.49, stdev=1087.51 00:32:31.499 clat percentiles (usec): 00:32:31.499 | 1.00th=[11863], 5.00th=[12649], 10.00th=[13042], 20.00th=[13566], 00:32:31.499 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:32:31.499 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15664], 95.00th=[16188], 00:32:31.499 | 99.00th=[16909], 99.50th=[17433], 99.90th=[20841], 99.95th=[20841], 00:32:31.499 | 99.99th=[20841] 00:32:31.499 bw ( KiB/s): min=25344, max=28160, per=33.93%, avg=26636.80, stdev=772.37, samples=20 00:32:31.499 iops : min= 198, max= 220, avg=208.10, stdev= 6.03, samples=20 00:32:31.499 lat (msec) : 10=0.05%, 20=99.81%, 50=0.14% 00:32:31.499 cpu : usr=91.72%, sys=7.80%, ctx=21, majf=0, minf=172 00:32:31.499 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:31.499 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.499 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.499 issued rwts: total=2084,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.499 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:31.499 00:32:31.499 Run status group 0 (all jobs): 00:32:31.499 READ: bw=76.7MiB/s (80.4MB/s), 25.0MiB/s-26.0MiB/s (26.2MB/s-27.3MB/s), io=770MiB (808MB), run=10006-10047msec 00:32:31.499 14:06:09 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:31.499 14:06:09 -- target/dif.sh@43 -- # local sub 00:32:31.499 14:06:09 -- target/dif.sh@45 -- # for sub in "$@" 00:32:31.499 14:06:09 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:31.499 14:06:09 -- target/dif.sh@36 -- # local sub_id=0 00:32:31.499 14:06:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:31.499 14:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:31.499 14:06:09 -- common/autotest_common.sh@10 -- # set +x 00:32:31.499 14:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:31.499 14:06:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:31.499 14:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:31.499 14:06:09 -- common/autotest_common.sh@10 -- # set +x 00:32:31.499 14:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:31.499 00:32:31.499 real 0m11.239s 00:32:31.499 user 0m28.741s 00:32:31.499 sys 0m2.662s 00:32:31.499 14:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:31.499 14:06:09 -- common/autotest_common.sh@10 -- # set +x 00:32:31.499 ************************************ 00:32:31.499 END TEST fio_dif_digest 00:32:31.499 ************************************ 00:32:31.499 14:06:09 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:31.499 14:06:09 -- target/dif.sh@147 -- # nvmftestfini 00:32:31.499 14:06:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:31.499 14:06:09 -- nvmf/common.sh@116 -- # sync 00:32:31.499 14:06:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:31.499 14:06:09 -- nvmf/common.sh@119 -- # set +e 00:32:31.499 14:06:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:31.499 14:06:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:31.499 rmmod nvme_tcp 00:32:31.499 rmmod nvme_fabrics 00:32:31.499 rmmod nvme_keyring 00:32:31.499 14:06:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:31.499 14:06:09 -- nvmf/common.sh@123 -- # set -e 00:32:31.499 14:06:09 -- nvmf/common.sh@124 -- # return 0 00:32:31.499 14:06:09 -- nvmf/common.sh@477 -- # '[' -n 2442504 ']' 00:32:31.499 14:06:09 -- nvmf/common.sh@478 -- # killprocess 2442504 00:32:31.499 14:06:09 -- common/autotest_common.sh@936 -- # '[' -z 2442504 ']' 00:32:31.499 14:06:09 -- common/autotest_common.sh@940 -- # kill -0 2442504 00:32:31.499 14:06:09 -- common/autotest_common.sh@941 -- # uname 00:32:31.499 14:06:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:31.499 14:06:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2442504 00:32:31.499 14:06:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:31.499 14:06:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:31.499 14:06:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2442504' 00:32:31.499 killing process with pid 2442504 00:32:31.499 14:06:09 -- common/autotest_common.sh@955 -- # kill 2442504 00:32:31.499 14:06:09 -- common/autotest_common.sh@960 -- # wait 2442504 00:32:31.499 14:06:10 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:31.499 14:06:10 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:31.499 Waiting for block devices as requested 00:32:31.499 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:31.499 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:31.499 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:31.499 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:31.499 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:31.499 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:31.758 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:31.758 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:31.758 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:31.758 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:32.017 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:32.017 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:32.017 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:32.017 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:32.276 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:32.276 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:32.276 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:32.276 14:06:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:32.276 14:06:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:32.276 14:06:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:32.276 14:06:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:32.276 14:06:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:32.276 14:06:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:32.276 14:06:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:34.809 14:06:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:34.810 00:32:34.810 real 1m7.653s 00:32:34.810 user 6m32.933s 00:32:34.810 sys 0m16.572s 00:32:34.810 14:06:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:34.810 14:06:14 -- common/autotest_common.sh@10 -- # set +x 00:32:34.810 ************************************ 00:32:34.810 END TEST nvmf_dif 00:32:34.810 ************************************ 00:32:34.810 14:06:14 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:34.810 14:06:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:34.810 14:06:14 -- common/autotest_common.sh@10 -- # set +x 00:32:34.810 ************************************ 00:32:34.810 START TEST nvmf_abort_qd_sizes 00:32:34.810 ************************************ 00:32:34.810 14:06:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:34.810 * Looking for test storage... 00:32:34.810 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:34.810 14:06:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:34.810 14:06:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:34.810 14:06:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:34.810 14:06:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:34.810 14:06:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:34.810 14:06:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:34.810 14:06:14 -- scripts/common.sh@335 -- # IFS=.-: 00:32:34.810 14:06:14 -- scripts/common.sh@335 -- # read -ra ver1 00:32:34.810 14:06:14 -- scripts/common.sh@336 -- # IFS=.-: 00:32:34.810 14:06:14 -- scripts/common.sh@336 -- # read -ra ver2 00:32:34.810 14:06:14 -- scripts/common.sh@337 -- # local 'op=<' 00:32:34.810 14:06:14 -- scripts/common.sh@339 -- # ver1_l=2 00:32:34.810 14:06:14 -- scripts/common.sh@340 -- # ver2_l=1 00:32:34.810 14:06:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:34.810 14:06:14 -- scripts/common.sh@343 -- # case "$op" in 00:32:34.810 14:06:14 -- scripts/common.sh@344 -- # : 1 00:32:34.810 14:06:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:34.810 14:06:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:34.810 14:06:14 -- scripts/common.sh@364 -- # decimal 1 00:32:34.810 14:06:14 -- scripts/common.sh@352 -- # local d=1 00:32:34.810 14:06:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:34.810 14:06:14 -- scripts/common.sh@354 -- # echo 1 00:32:34.810 14:06:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:34.810 14:06:14 -- scripts/common.sh@365 -- # decimal 2 00:32:34.810 14:06:14 -- scripts/common.sh@352 -- # local d=2 00:32:34.810 14:06:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:34.810 14:06:14 -- scripts/common.sh@354 -- # echo 2 00:32:34.810 14:06:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:34.810 14:06:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:34.810 14:06:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:34.810 14:06:14 -- scripts/common.sh@367 -- # return 0 00:32:34.810 14:06:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:34.810 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.810 --rc genhtml_branch_coverage=1 00:32:34.810 --rc genhtml_function_coverage=1 00:32:34.810 --rc genhtml_legend=1 00:32:34.810 --rc geninfo_all_blocks=1 00:32:34.810 --rc geninfo_unexecuted_blocks=1 00:32:34.810 00:32:34.810 ' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:34.810 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.810 --rc genhtml_branch_coverage=1 00:32:34.810 --rc genhtml_function_coverage=1 00:32:34.810 --rc genhtml_legend=1 00:32:34.810 --rc geninfo_all_blocks=1 00:32:34.810 --rc geninfo_unexecuted_blocks=1 00:32:34.810 00:32:34.810 ' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:34.810 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.810 --rc genhtml_branch_coverage=1 00:32:34.810 --rc genhtml_function_coverage=1 00:32:34.810 --rc genhtml_legend=1 00:32:34.810 --rc geninfo_all_blocks=1 00:32:34.810 --rc geninfo_unexecuted_blocks=1 00:32:34.810 00:32:34.810 ' 00:32:34.810 14:06:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:34.810 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.810 --rc genhtml_branch_coverage=1 00:32:34.810 --rc genhtml_function_coverage=1 00:32:34.810 --rc genhtml_legend=1 00:32:34.810 --rc geninfo_all_blocks=1 00:32:34.810 --rc geninfo_unexecuted_blocks=1 00:32:34.810 00:32:34.810 ' 00:32:34.810 14:06:14 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:34.810 14:06:14 -- nvmf/common.sh@7 -- # uname -s 00:32:34.810 14:06:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:34.810 14:06:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:34.810 14:06:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:34.810 14:06:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:34.810 14:06:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:34.810 14:06:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:34.810 14:06:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:34.810 14:06:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:34.810 14:06:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:34.810 14:06:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:34.810 14:06:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:34.810 14:06:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:34.810 14:06:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:34.810 14:06:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:34.810 14:06:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:34.810 14:06:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:34.810 14:06:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:34.810 14:06:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:34.810 14:06:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:34.810 14:06:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.810 14:06:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.810 14:06:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.810 14:06:14 -- paths/export.sh@5 -- # export PATH 00:32:34.810 14:06:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.810 14:06:14 -- nvmf/common.sh@46 -- # : 0 00:32:34.810 14:06:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:34.810 14:06:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:34.810 14:06:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:34.810 14:06:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:34.810 14:06:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:34.810 14:06:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:34.810 14:06:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:34.810 14:06:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:34.810 14:06:14 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:34.810 14:06:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:34.810 14:06:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:34.810 14:06:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:34.810 14:06:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:34.810 14:06:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:34.810 14:06:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:34.810 14:06:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:34.810 14:06:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:34.810 14:06:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:34.810 14:06:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:34.810 14:06:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:34.810 14:06:14 -- common/autotest_common.sh@10 -- # set +x 00:32:36.708 14:06:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:36.708 14:06:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:36.708 14:06:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:36.708 14:06:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:36.708 14:06:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:36.708 14:06:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:36.708 14:06:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:36.708 14:06:16 -- nvmf/common.sh@294 -- # net_devs=() 00:32:36.708 14:06:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:36.708 14:06:16 -- nvmf/common.sh@295 -- # e810=() 00:32:36.708 14:06:16 -- nvmf/common.sh@295 -- # local -ga e810 00:32:36.708 14:06:16 -- nvmf/common.sh@296 -- # x722=() 00:32:36.708 14:06:16 -- nvmf/common.sh@296 -- # local -ga x722 00:32:36.708 14:06:16 -- nvmf/common.sh@297 -- # mlx=() 00:32:36.708 14:06:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:36.708 14:06:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:36.708 14:06:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:36.708 14:06:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:36.708 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:36.708 14:06:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:36.708 14:06:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:36.708 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:36.708 14:06:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:36.708 14:06:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.708 14:06:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.708 14:06:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:36.708 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:36.708 14:06:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:36.708 14:06:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.708 14:06:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.708 14:06:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:36.708 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:36.708 14:06:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:36.708 14:06:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:36.708 14:06:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:36.708 14:06:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:36.708 14:06:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:36.708 14:06:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:36.708 14:06:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:36.708 14:06:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:36.708 14:06:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:36.708 14:06:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:36.708 14:06:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:36.708 14:06:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:36.708 14:06:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:36.708 14:06:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:36.708 14:06:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:36.708 14:06:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:36.708 14:06:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:36.708 14:06:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:36.708 14:06:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:36.708 14:06:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:36.708 14:06:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:36.708 14:06:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:36.708 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:36.708 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:32:36.708 00:32:36.708 --- 10.0.0.2 ping statistics --- 00:32:36.708 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:36.708 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:32:36.708 14:06:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:36.708 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:36.708 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:32:36.708 00:32:36.708 --- 10.0.0.1 ping statistics --- 00:32:36.708 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:36.708 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:32:36.708 14:06:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:36.708 14:06:16 -- nvmf/common.sh@410 -- # return 0 00:32:36.708 14:06:16 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:36.708 14:06:16 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:38.082 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:38.082 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:38.082 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:39.017 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:39.017 14:06:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:39.017 14:06:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:39.017 14:06:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:39.017 14:06:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:39.017 14:06:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:39.017 14:06:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:39.017 14:06:19 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:39.017 14:06:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:39.017 14:06:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:39.017 14:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:39.017 14:06:19 -- nvmf/common.sh@469 -- # nvmfpid=2454500 00:32:39.017 14:06:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:39.017 14:06:19 -- nvmf/common.sh@470 -- # waitforlisten 2454500 00:32:39.017 14:06:19 -- common/autotest_common.sh@829 -- # '[' -z 2454500 ']' 00:32:39.017 14:06:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:39.017 14:06:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:39.017 14:06:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:39.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:39.017 14:06:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:39.017 14:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:39.017 [2024-11-29 14:06:19.266777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:39.017 [2024-11-29 14:06:19.266846] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:39.275 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.275 [2024-11-29 14:06:19.342380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:39.275 [2024-11-29 14:06:19.433783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:39.275 [2024-11-29 14:06:19.433941] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:39.275 [2024-11-29 14:06:19.433961] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:39.275 [2024-11-29 14:06:19.433975] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:39.275 [2024-11-29 14:06:19.434038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:39.275 [2024-11-29 14:06:19.434106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:39.275 [2024-11-29 14:06:19.434129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:39.275 [2024-11-29 14:06:19.434132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:40.207 14:06:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:40.207 14:06:20 -- common/autotest_common.sh@862 -- # return 0 00:32:40.207 14:06:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:40.207 14:06:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:40.207 14:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:40.207 14:06:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:40.207 14:06:20 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:40.207 14:06:20 -- scripts/common.sh@312 -- # local nvmes 00:32:40.207 14:06:20 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:40.207 14:06:20 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:40.207 14:06:20 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:40.207 14:06:20 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:40.207 14:06:20 -- scripts/common.sh@322 -- # uname -s 00:32:40.207 14:06:20 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:40.207 14:06:20 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:40.207 14:06:20 -- scripts/common.sh@327 -- # (( 1 )) 00:32:40.207 14:06:20 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:40.207 14:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:40.207 14:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:40.207 14:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:40.207 ************************************ 00:32:40.207 START TEST spdk_target_abort 00:32:40.207 ************************************ 00:32:40.207 14:06:20 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:40.207 14:06:20 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:40.207 14:06:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.207 14:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:43.490 spdk_targetn1 00:32:43.490 14:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:43.490 14:06:23 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:43.490 14:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:43.490 14:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:43.490 [2024-11-29 14:06:23.103526] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:43.491 14:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:43.491 14:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:43.491 14:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:43.491 14:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:43.491 14:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:43.491 14:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:43.491 14:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:43.491 14:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:43.491 14:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:43.491 [2024-11-29 14:06:23.135817] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:43.491 14:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:43.491 14:06:23 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:43.491 EAL: No free 2048 kB hugepages reported on node 1 00:32:46.769 Initializing NVMe Controllers 00:32:46.769 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:46.769 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:46.769 Initialization complete. Launching workers. 00:32:46.769 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12339, failed: 0 00:32:46.769 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1209, failed to submit 11130 00:32:46.769 success 723, unsuccess 486, failed 0 00:32:46.769 14:06:26 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:46.769 14:06:26 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:46.769 EAL: No free 2048 kB hugepages reported on node 1 00:32:50.109 [2024-11-29 14:06:29.655456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x95c530 is same with the state(5) to be set 00:32:50.109 [2024-11-29 14:06:29.655516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x95c530 is same with the state(5) to be set 00:32:50.109 [2024-11-29 14:06:29.655531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x95c530 is same with the state(5) to be set 00:32:50.109 Initializing NVMe Controllers 00:32:50.109 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:50.109 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:50.109 Initialization complete. Launching workers. 00:32:50.109 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8740, failed: 0 00:32:50.109 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1221, failed to submit 7519 00:32:50.109 success 358, unsuccess 863, failed 0 00:32:50.109 14:06:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:50.109 14:06:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:50.109 EAL: No free 2048 kB hugepages reported on node 1 00:32:52.635 Initializing NVMe Controllers 00:32:52.635 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:52.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:52.635 Initialization complete. Launching workers. 00:32:52.635 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31987, failed: 0 00:32:52.635 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2630, failed to submit 29357 00:32:52.635 success 562, unsuccess 2068, failed 0 00:32:52.635 14:06:32 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:52.635 14:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.635 14:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:52.635 14:06:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.635 14:06:32 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:52.635 14:06:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.635 14:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:54.004 14:06:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:54.004 14:06:34 -- target/abort_qd_sizes.sh@62 -- # killprocess 2454500 00:32:54.004 14:06:34 -- common/autotest_common.sh@936 -- # '[' -z 2454500 ']' 00:32:54.004 14:06:34 -- common/autotest_common.sh@940 -- # kill -0 2454500 00:32:54.004 14:06:34 -- common/autotest_common.sh@941 -- # uname 00:32:54.004 14:06:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:54.004 14:06:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2454500 00:32:54.004 14:06:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:54.004 14:06:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:54.004 14:06:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2454500' 00:32:54.004 killing process with pid 2454500 00:32:54.004 14:06:34 -- common/autotest_common.sh@955 -- # kill 2454500 00:32:54.004 14:06:34 -- common/autotest_common.sh@960 -- # wait 2454500 00:32:54.262 00:32:54.262 real 0m14.218s 00:32:54.262 user 0m56.575s 00:32:54.262 sys 0m2.507s 00:32:54.262 14:06:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:54.262 14:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:54.262 ************************************ 00:32:54.262 END TEST spdk_target_abort 00:32:54.262 ************************************ 00:32:54.262 14:06:34 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:54.262 14:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:54.262 14:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:54.262 14:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:54.262 ************************************ 00:32:54.262 START TEST kernel_target_abort 00:32:54.262 ************************************ 00:32:54.262 14:06:34 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:54.262 14:06:34 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:54.262 14:06:34 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:54.262 14:06:34 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:54.262 14:06:34 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:54.262 14:06:34 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:54.262 14:06:34 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:54.262 14:06:34 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:54.262 14:06:34 -- nvmf/common.sh@627 -- # local block nvme 00:32:54.262 14:06:34 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:54.262 14:06:34 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:54.262 14:06:34 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:54.262 14:06:34 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:55.636 Waiting for block devices as requested 00:32:55.636 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:55.636 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:55.636 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:55.893 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:55.893 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:55.893 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:56.150 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:56.150 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:56.150 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:56.150 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:56.407 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:56.407 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:56.407 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:56.407 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:56.665 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:56.665 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:56.665 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:56.924 14:06:37 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:56.924 14:06:37 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:56.924 14:06:37 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:56.924 14:06:37 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:56.924 14:06:37 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:56.924 No valid GPT data, bailing 00:32:56.924 14:06:37 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:56.924 14:06:37 -- scripts/common.sh@393 -- # pt= 00:32:56.924 14:06:37 -- scripts/common.sh@394 -- # return 1 00:32:56.924 14:06:37 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:56.924 14:06:37 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:56.924 14:06:37 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:56.924 14:06:37 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:56.924 14:06:37 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:56.924 14:06:37 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:56.924 14:06:37 -- nvmf/common.sh@654 -- # echo 1 00:32:56.924 14:06:37 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:56.924 14:06:37 -- nvmf/common.sh@656 -- # echo 1 00:32:56.924 14:06:37 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:56.924 14:06:37 -- nvmf/common.sh@663 -- # echo tcp 00:32:56.924 14:06:37 -- nvmf/common.sh@664 -- # echo 4420 00:32:56.924 14:06:37 -- nvmf/common.sh@665 -- # echo ipv4 00:32:56.924 14:06:37 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:56.924 14:06:37 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:56.924 00:32:56.924 Discovery Log Number of Records 2, Generation counter 2 00:32:56.924 =====Discovery Log Entry 0====== 00:32:56.924 trtype: tcp 00:32:56.924 adrfam: ipv4 00:32:56.924 subtype: current discovery subsystem 00:32:56.924 treq: not specified, sq flow control disable supported 00:32:56.924 portid: 1 00:32:56.924 trsvcid: 4420 00:32:56.924 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:56.924 traddr: 10.0.0.1 00:32:56.924 eflags: none 00:32:56.924 sectype: none 00:32:56.924 =====Discovery Log Entry 1====== 00:32:56.924 trtype: tcp 00:32:56.924 adrfam: ipv4 00:32:56.924 subtype: nvme subsystem 00:32:56.924 treq: not specified, sq flow control disable supported 00:32:56.924 portid: 1 00:32:56.924 trsvcid: 4420 00:32:56.924 subnqn: kernel_target 00:32:56.924 traddr: 10.0.0.1 00:32:56.924 eflags: none 00:32:56.924 sectype: none 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:56.924 14:06:37 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:57.182 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.459 Initializing NVMe Controllers 00:33:00.459 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:00.459 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:00.459 Initialization complete. Launching workers. 00:33:00.459 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 41973, failed: 0 00:33:00.459 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 41973, failed to submit 0 00:33:00.459 success 0, unsuccess 41973, failed 0 00:33:00.459 14:06:40 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:00.459 14:06:40 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:00.459 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.737 Initializing NVMe Controllers 00:33:03.737 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:03.737 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:03.737 Initialization complete. Launching workers. 00:33:03.737 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 77739, failed: 0 00:33:03.737 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19606, failed to submit 58133 00:33:03.737 success 0, unsuccess 19606, failed 0 00:33:03.737 14:06:43 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:03.737 14:06:43 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:03.737 EAL: No free 2048 kB hugepages reported on node 1 00:33:06.264 Initializing NVMe Controllers 00:33:06.264 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:06.264 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:06.264 Initialization complete. Launching workers. 00:33:06.264 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 75532, failed: 0 00:33:06.264 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18862, failed to submit 56670 00:33:06.264 success 0, unsuccess 18862, failed 0 00:33:06.264 14:06:46 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:06.264 14:06:46 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:06.264 14:06:46 -- nvmf/common.sh@677 -- # echo 0 00:33:06.264 14:06:46 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:06.264 14:06:46 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:06.264 14:06:46 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:06.264 14:06:46 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:06.264 14:06:46 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:06.264 14:06:46 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:06.523 00:33:06.523 real 0m12.052s 00:33:06.523 user 0m5.627s 00:33:06.523 sys 0m2.409s 00:33:06.523 14:06:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:06.523 14:06:46 -- common/autotest_common.sh@10 -- # set +x 00:33:06.523 ************************************ 00:33:06.523 END TEST kernel_target_abort 00:33:06.523 ************************************ 00:33:06.523 14:06:46 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:06.523 14:06:46 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:06.523 14:06:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:06.523 14:06:46 -- nvmf/common.sh@116 -- # sync 00:33:06.523 14:06:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:06.523 14:06:46 -- nvmf/common.sh@119 -- # set +e 00:33:06.523 14:06:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:06.523 14:06:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:06.523 rmmod nvme_tcp 00:33:06.523 rmmod nvme_fabrics 00:33:06.523 rmmod nvme_keyring 00:33:06.523 14:06:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:06.523 14:06:46 -- nvmf/common.sh@123 -- # set -e 00:33:06.523 14:06:46 -- nvmf/common.sh@124 -- # return 0 00:33:06.523 14:06:46 -- nvmf/common.sh@477 -- # '[' -n 2454500 ']' 00:33:06.523 14:06:46 -- nvmf/common.sh@478 -- # killprocess 2454500 00:33:06.523 14:06:46 -- common/autotest_common.sh@936 -- # '[' -z 2454500 ']' 00:33:06.523 14:06:46 -- common/autotest_common.sh@940 -- # kill -0 2454500 00:33:06.523 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2454500) - No such process 00:33:06.523 14:06:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2454500 is not found' 00:33:06.523 Process with pid 2454500 is not found 00:33:06.523 14:06:46 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:06.523 14:06:46 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:07.898 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:07.898 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:07.898 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:07.898 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:07.898 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:07.898 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:07.898 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:07.898 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.898 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:07.898 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:07.898 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:07.898 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:07.898 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:07.898 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:07.898 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:07.898 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.898 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:07.898 14:06:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:07.898 14:06:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:07.898 14:06:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:07.898 14:06:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:07.898 14:06:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:07.898 14:06:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:07.898 14:06:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:10.432 14:06:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:10.432 00:33:10.432 real 0m35.495s 00:33:10.432 user 1m4.638s 00:33:10.432 sys 0m8.315s 00:33:10.432 14:06:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:10.432 14:06:50 -- common/autotest_common.sh@10 -- # set +x 00:33:10.432 ************************************ 00:33:10.432 END TEST nvmf_abort_qd_sizes 00:33:10.432 ************************************ 00:33:10.432 14:06:50 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:10.432 14:06:50 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:10.432 14:06:50 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:10.432 14:06:50 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:10.432 14:06:50 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:10.432 14:06:50 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:10.432 14:06:50 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:10.432 14:06:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:10.432 14:06:50 -- common/autotest_common.sh@10 -- # set +x 00:33:10.432 14:06:50 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:10.432 14:06:50 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:10.432 14:06:50 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:10.432 14:06:50 -- common/autotest_common.sh@10 -- # set +x 00:33:11.807 INFO: APP EXITING 00:33:11.807 INFO: killing all VMs 00:33:11.807 INFO: killing vhost app 00:33:11.807 INFO: EXIT DONE 00:33:13.183 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:13.183 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:13.183 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:13.183 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:13.183 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:13.183 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:13.183 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:13.183 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:13.183 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:13.183 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:13.183 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:13.183 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:13.183 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:13.183 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:13.183 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:13.183 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:13.183 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:14.557 Cleaning 00:33:14.557 Removing: /var/run/dpdk/spdk0/config 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:14.557 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:14.557 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:14.557 Removing: /var/run/dpdk/spdk1/config 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:14.557 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:14.557 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:14.557 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:14.557 Removing: /var/run/dpdk/spdk2/config 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:14.557 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:14.557 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:14.557 Removing: /var/run/dpdk/spdk3/config 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:14.557 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:14.557 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:14.557 Removing: /var/run/dpdk/spdk4/config 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:14.557 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:14.557 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:14.557 Removing: /dev/shm/bdev_svc_trace.1 00:33:14.557 Removing: /dev/shm/nvmf_trace.0 00:33:14.557 Removing: /dev/shm/spdk_tgt_trace.pid2174302 00:33:14.557 Removing: /var/run/dpdk/spdk0 00:33:14.557 Removing: /var/run/dpdk/spdk1 00:33:14.557 Removing: /var/run/dpdk/spdk2 00:33:14.557 Removing: /var/run/dpdk/spdk3 00:33:14.557 Removing: /var/run/dpdk/spdk4 00:33:14.557 Removing: /var/run/dpdk/spdk_pid2172031 00:33:14.557 Removing: /var/run/dpdk/spdk_pid2172903 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2174302 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2174798 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2176151 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2177099 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2177370 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2177628 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2177970 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2178173 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2178442 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2178616 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2178810 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2179195 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2181697 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2181988 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2182275 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2182320 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2182739 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2182884 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183190 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183330 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183590 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183644 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183899 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2183952 00:33:14.558 Removing: /var/run/dpdk/spdk_pid2184459 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2184615 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2184821 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185114 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185147 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185208 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185466 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185628 00:33:14.814 Removing: /var/run/dpdk/spdk_pid2185768 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2185927 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2186192 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2186349 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2186493 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2186650 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2186913 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187078 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187216 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187377 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187634 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187805 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2187943 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2188098 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2188361 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2188526 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2188670 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2188825 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189078 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189251 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189391 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189550 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189809 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2189970 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2190118 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2190275 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2190540 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2190695 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2190843 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2191002 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2191264 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2191430 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2191579 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2191735 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192000 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192157 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192309 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192568 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192664 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2192877 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2195100 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2252700 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2255369 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2263260 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2266609 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2268996 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2269525 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2273432 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2273436 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2274107 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2274663 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2275337 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2275750 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2275756 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2276022 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2276044 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2276108 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2276722 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2277391 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2278072 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2278488 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2278493 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2278638 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2279815 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2280676 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2286177 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2286458 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2289122 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2293543 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2295787 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2302425 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2307963 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2309193 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2309889 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2320657 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2322907 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2325868 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2327197 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2329079 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2329346 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2329504 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2329652 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2330329 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2331735 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2332754 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2333208 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2336752 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2340291 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2343936 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2368356 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2371075 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2375044 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2376133 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2377255 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2379846 00:33:14.815 Removing: /var/run/dpdk/spdk_pid2382366 00:33:15.072 Removing: /var/run/dpdk/spdk_pid2386771 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2386777 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2389753 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2389983 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2390215 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2390508 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2390513 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2392127 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2393350 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2394582 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2395799 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2397012 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2398324 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2402247 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2402588 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2404024 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2404782 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2408573 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2410619 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2414354 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2417998 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2422296 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2422718 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2423138 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2423605 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2424150 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2424708 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2425256 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2425812 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2428482 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2428629 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2432492 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2432675 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2434445 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2439609 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2439615 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2442686 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2444132 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2445567 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2446352 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2447907 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2448803 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2454937 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2455337 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2455750 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2457246 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2457636 00:33:15.073 Removing: /var/run/dpdk/spdk_pid2458045 00:33:15.073 Clean 00:33:15.073 killing process with pid 2144128 00:33:25.038 killing process with pid 2144125 00:33:25.038 killing process with pid 2144127 00:33:25.038 killing process with pid 2144126 00:33:25.038 14:07:04 -- common/autotest_common.sh@1446 -- # return 0 00:33:25.038 14:07:04 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:25.038 14:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:25.038 14:07:04 -- common/autotest_common.sh@10 -- # set +x 00:33:25.038 14:07:04 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:25.038 14:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:25.038 14:07:04 -- common/autotest_common.sh@10 -- # set +x 00:33:25.038 14:07:04 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:25.038 14:07:04 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:25.038 14:07:04 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:25.038 14:07:04 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:25.038 14:07:04 -- spdk/autotest.sh@383 -- # hostname 00:33:25.038 14:07:04 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:25.038 geninfo: WARNING: invalid characters removed from testname! 00:33:51.577 14:07:31 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:55.758 14:07:35 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:58.344 14:07:38 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:00.867 14:07:41 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:04.151 14:07:43 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:06.678 14:07:46 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:09.205 14:07:49 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:09.205 14:07:49 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:09.205 14:07:49 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:09.205 14:07:49 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:09.205 14:07:49 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:09.205 14:07:49 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:09.205 14:07:49 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:09.205 14:07:49 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:09.205 14:07:49 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:09.205 14:07:49 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:09.205 14:07:49 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:09.205 14:07:49 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:09.205 14:07:49 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:09.205 14:07:49 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:09.205 14:07:49 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:09.205 14:07:49 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:09.205 14:07:49 -- scripts/common.sh@343 -- $ case "$op" in 00:34:09.205 14:07:49 -- scripts/common.sh@344 -- $ : 1 00:34:09.205 14:07:49 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:09.205 14:07:49 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:09.205 14:07:49 -- scripts/common.sh@364 -- $ decimal 1 00:34:09.205 14:07:49 -- scripts/common.sh@352 -- $ local d=1 00:34:09.205 14:07:49 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:09.205 14:07:49 -- scripts/common.sh@354 -- $ echo 1 00:34:09.205 14:07:49 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:09.205 14:07:49 -- scripts/common.sh@365 -- $ decimal 2 00:34:09.205 14:07:49 -- scripts/common.sh@352 -- $ local d=2 00:34:09.205 14:07:49 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:09.205 14:07:49 -- scripts/common.sh@354 -- $ echo 2 00:34:09.205 14:07:49 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:09.205 14:07:49 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:09.205 14:07:49 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:09.205 14:07:49 -- scripts/common.sh@367 -- $ return 0 00:34:09.205 14:07:49 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:09.205 14:07:49 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:09.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:09.205 --rc genhtml_branch_coverage=1 00:34:09.205 --rc genhtml_function_coverage=1 00:34:09.205 --rc genhtml_legend=1 00:34:09.205 --rc geninfo_all_blocks=1 00:34:09.205 --rc geninfo_unexecuted_blocks=1 00:34:09.205 00:34:09.205 ' 00:34:09.205 14:07:49 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:09.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:09.205 --rc genhtml_branch_coverage=1 00:34:09.205 --rc genhtml_function_coverage=1 00:34:09.205 --rc genhtml_legend=1 00:34:09.205 --rc geninfo_all_blocks=1 00:34:09.205 --rc geninfo_unexecuted_blocks=1 00:34:09.205 00:34:09.205 ' 00:34:09.205 14:07:49 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:09.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:09.205 --rc genhtml_branch_coverage=1 00:34:09.205 --rc genhtml_function_coverage=1 00:34:09.205 --rc genhtml_legend=1 00:34:09.205 --rc geninfo_all_blocks=1 00:34:09.205 --rc geninfo_unexecuted_blocks=1 00:34:09.205 00:34:09.205 ' 00:34:09.205 14:07:49 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:09.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:09.205 --rc genhtml_branch_coverage=1 00:34:09.205 --rc genhtml_function_coverage=1 00:34:09.205 --rc genhtml_legend=1 00:34:09.205 --rc geninfo_all_blocks=1 00:34:09.205 --rc geninfo_unexecuted_blocks=1 00:34:09.205 00:34:09.205 ' 00:34:09.205 14:07:49 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:09.205 14:07:49 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:09.205 14:07:49 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:09.205 14:07:49 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:09.205 14:07:49 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:09.205 14:07:49 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:09.205 14:07:49 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:09.205 14:07:49 -- paths/export.sh@5 -- $ export PATH 00:34:09.205 14:07:49 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:09.205 14:07:49 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:09.205 14:07:49 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:09.205 14:07:49 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732885669.XXXXXX 00:34:09.205 14:07:49 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732885669.1qaOHc 00:34:09.205 14:07:49 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:09.205 14:07:49 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:09.205 14:07:49 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:09.205 14:07:49 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:09.205 14:07:49 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:09.205 14:07:49 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:09.205 14:07:49 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:09.205 14:07:49 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:09.205 14:07:49 -- common/autotest_common.sh@10 -- $ set +x 00:34:09.205 14:07:49 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:09.205 14:07:49 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:09.206 14:07:49 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:09.206 14:07:49 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:09.206 14:07:49 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:09.206 14:07:49 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:09.206 14:07:49 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:09.206 14:07:49 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:09.206 14:07:49 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:09.206 14:07:49 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:09.465 14:07:49 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:09.465 + [[ -n 2089004 ]] 00:34:09.465 + sudo kill 2089004 00:34:09.476 [Pipeline] } 00:34:09.493 [Pipeline] // stage 00:34:09.498 [Pipeline] } 00:34:09.511 [Pipeline] // timeout 00:34:09.515 [Pipeline] } 00:34:09.530 [Pipeline] // catchError 00:34:09.535 [Pipeline] } 00:34:09.549 [Pipeline] // wrap 00:34:09.555 [Pipeline] } 00:34:09.567 [Pipeline] // catchError 00:34:09.576 [Pipeline] stage 00:34:09.579 [Pipeline] { (Epilogue) 00:34:09.592 [Pipeline] catchError 00:34:09.594 [Pipeline] { 00:34:09.606 [Pipeline] echo 00:34:09.608 Cleanup processes 00:34:09.614 [Pipeline] sh 00:34:09.901 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:09.901 2470477 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:09.916 [Pipeline] sh 00:34:10.201 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:10.201 ++ grep -v 'sudo pgrep' 00:34:10.201 ++ awk '{print $1}' 00:34:10.201 + sudo kill -9 00:34:10.201 + true 00:34:10.213 [Pipeline] sh 00:34:10.497 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:20.496 [Pipeline] sh 00:34:20.784 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:20.784 Artifacts sizes are good 00:34:20.799 [Pipeline] archiveArtifacts 00:34:20.805 Archiving artifacts 00:34:20.983 [Pipeline] sh 00:34:21.286 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:21.301 [Pipeline] cleanWs 00:34:21.312 [WS-CLEANUP] Deleting project workspace... 00:34:21.312 [WS-CLEANUP] Deferred wipeout is used... 00:34:21.319 [WS-CLEANUP] done 00:34:21.321 [Pipeline] } 00:34:21.340 [Pipeline] // catchError 00:34:21.355 [Pipeline] sh 00:34:21.635 + logger -p user.info -t JENKINS-CI 00:34:21.643 [Pipeline] } 00:34:21.657 [Pipeline] // stage 00:34:21.662 [Pipeline] } 00:34:21.677 [Pipeline] // node 00:34:21.683 [Pipeline] End of Pipeline 00:34:21.724 Finished: SUCCESS